AMD-powered LUMI supercomputer accelerates creation of AI models for TurkuNLP

Date:

AMD-powered LUMI Supercomputer Accelerates AI Model Creation for TurkuNLP

TurkuNLP, a leading research group based at the University of Turku in Finland, has harnessed the power of the LUMI supercomputer, equipped with advanced microprocessors from AMD, to create new AI models quickly. The LUMI supercomputer has recently been recognized as the fastest and most energy-efficient supercomputer in Europe.

The demand for large language models (LLMs) that drive generative AI solutions like ChatGPT is on the rise. However, training LLMs requires substantial computational power, and existing models are often proprietary and limited to the English language. TurkuNLP Research Fellow, Sampo Pyysalo, recognized the need to extend the application of LLMs to wider research areas but required a significant performance boost to train models within a reasonable timeframe.

Powered by AMD’s Epyc CPUs and Instinct GPUs, the LUMI supercomputer provides the scale and computational capabilities needed to meet these research demands. In fact, LUMI is two orders of magnitude larger than its predecessors in Finland, offering unprecedented computing capacity. While it used to take the TurkuNLP team six months to pre-train a billion-parameter language model on their previous machines, LUMI can now process around 40 billion tokens, equivalent to characters, syllables, or words, in just two weeks.

Väinö Hatanpää, a machine learning specialist at CSC, expressed excitement about LUMI’s computing capacity, stating that it allows their customers to push the boundaries of machine learning and AI. Pyysalo and his partners in TurkuNLP, Risto Luukkonen and Ville Komulainen, aim to make LLMs more accessible for academic use. They seek practical access to these models, as they believe the current models produced by large multinational corporations are often kept closed to outside use. This led them to create their own models, requiring the use of a supercomputer like LUMI.

See also  ChatGPT's capabilities decline with age: New study suggests.

Beginning with the Finnish language, which aligns with Turku’s Finnish roots, TurkuNLP leverages advanced AI and machine learning tools in collaboration with Hugging Face. However, building models of this magnitude necessitates significant computational resources, and LUMI has proven to be an invaluable asset in this regard.

LUMI is owned by the EuroHPC Joint Undertaking and was funded jointly by the EuroHPC JU and the LUMI consortium, consisting of ten European countries. The supercomputer is housed in Finland at CSC’s data center, hosted by the LUMI consortium. Notably, LUMI’s GPU partition dwarfs other GPU partitions at CSC, with a staggering 2,560 nodes powered by AMD Epyc processors and 10,240 GPUs.

The collaboration between TurkuNLP and AMD-powered LUMI marks a significant milestone in the advancement of AI research and development. With LUMI’s unparalleled computing capabilities, researchers can accelerate the creation of AI models and expand their applications across various disciplines. This breakthrough reinforces Finland’s position as a leading force in the AI landscape and paves the way for future innovation and collaboration in the field.

Frequently Asked Questions (FAQs) Related to the Above News

What is the LUMI supercomputer?

The LUMI supercomputer is a high-performance computing system equipped with advanced microprocessors from AMD. It is recognized as the fastest and most energy-efficient supercomputer in Europe.

What research group is using the LUMI supercomputer?

The LUMI supercomputer is being used by TurkuNLP, a leading research group based at the University of Turku in Finland.

Why was the LUMI supercomputer chosen by TurkuNLP?

TurkuNLP needed substantial computational power to train large language models (LLMs) for AI research, and the LUMI supercomputer provided the scale and capabilities required to meet these demands.

What benefits does the LUMI supercomputer offer to TurkuNLP?

With the LUMI supercomputer, TurkuNLP is able to train models much faster, allowing them to process around 40 billion tokens in just two weeks, a task that used to take six months on their previous machines.

How does the LUMI supercomputer contribute to the advancement of AI research?

The LUMI supercomputer's computational power accelerates the creation of AI models, making them more accessible for academic use and expanding their applications across various disciplines. This collaboration marks a significant milestone in AI research and development.

Who funded the LUMI supercomputer?

The LUMI supercomputer was funded jointly by the EuroHPC Joint Undertaking and the LUMI consortium, which consists of ten European countries.

What is the significance of the collaboration between TurkuNLP and the LUMI supercomputer?

The collaboration between TurkuNLP and the LUMI supercomputer pushes the boundaries of machine learning and AI, making large language models more accessible and reinforcing Finland's position as a leading force in the AI landscape. It paves the way for future innovation and collaboration in the field.

Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.

Advait Gupta
Advait Gupta
Advait is our expert writer and manager for the Artificial Intelligence category. His passion for AI research and its advancements drives him to deliver in-depth articles that explore the frontiers of this rapidly evolving field. Advait's articles delve into the latest breakthroughs, trends, and ethical considerations, keeping readers at the forefront of AI knowledge.

Share post:

Subscribe

Popular

More like this
Related

MMA Global Leads AI Revolution at Possible Event

Join MMA Global at Possible Event as AI leads the revolution in marketing. Over 300 marketers driving advancements in the industry.

Samsung Surpasses Apple in Global Smartphone Market Share Amid Growing Competition

Samsung overtakes Apple in global smartphone market share amid rising competition, with iPhone sales declining by 10% in Q1 2024.

Meta Unveils AR Glasses with OLED Display & Snapdragon Chip, Set for 2027 Release

Discover what to expect from Meta's upcoming AR Glasses with OLED display & Snapdragon chip, set for a 2027 release. Stay updated on the latest features!

Canada Boosts Arctic Defence Amid Climate Change Threats

Canada ramps up Arctic defense amid climate change threats with new policy, Arctic-compatible vehicles, and potential nuclear submarines.