Microsoft Unveils New Coding LLM Program Following GPT 4 Development

Date:

Microsoft has made yet another stride in artificial intelligence (AI) development with its release of a new 1.3B-parameter model coding LLM called phi-1. The language model for code was trained in just four days, over 7B tokens, followed by finetuning on less than 200M tokens. Despite being relatively small compared to its competition, phi-1 managed to attain 50.6% [email protected] accuracy on HumanEval and 55.5% [email protected] accuracy on MBPP. These numbers are some of the best self-reported ones using only one LLM generation. Additionally, phi-1 reorganized and consolidated knowledge acquired during pre-training, even without explicit instructions, allowing it to adapt and improve beyond its initial design. This breakthrough achievement in AI research adds to Microsoft’s impressive lineup, including Copilot, Recap Ai tool for Microsoft Teams, and many more. By funding and promoting AI research and development, Microsoft is helping the world and itself move towards a future of smarter technology.

See also  Tap into the Limitless Potential of GPT-4: Mastering the Revolutionary AI with this Comprehensive Guide

Frequently Asked Questions (FAQs) Related to the Above News

What is Microsoft's latest development in artificial intelligence?

Microsoft has released a new 1.3B-parameter model coding LLM called phi-1.

How long did it take to train the phi-1 language model for coding?

The phi-1 language model for coding was trained in just four days over 7B tokens.

What was the finetuning process for phi-1?

Phi-1 was finetuned on less than 200M tokens.

What were the accuracy results achieved by phi-1?

Phi-1 achieved 50.6% [email protected] accuracy on HumanEval and 55.5% [email protected] accuracy on MBPP, which are some of the best self-reported numbers using only one LLM generation.

How did phi-1 improve beyond its initial design?

Phi-1 reorganized and consolidated knowledge acquired during pre-training, even without explicit instructions, allowing it to adapt and improve beyond its initial design.

What other AI developments has Microsoft achieved?

Microsoft has achieved a number of other AI developments, such as Copilot, Recap Ai tool for Microsoft Teams, and many more.

What is Microsoft's goal with funding and promoting AI research and development?

By funding and promoting AI research and development, Microsoft is helping the world and itself move towards a future of smarter technology.

Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.

Diya Kapoor
Diya Kapoor
Diya is our talented writer and manager for the GPT-4 category. With her keen interest in language models and natural language processing, Diya uncovers the exciting developments surrounding GPT-4. Her articles not only highlight the capabilities of this powerful model but also shed light on its implications across various industries.

Share post:

Subscribe

Popular

More like this
Related

Microsoft Unveils Copilot+ PCs: Mind-Blowing AI Speed and Smarts Await!

Experience mind-blowing AI speed and smarts with Microsoft's Copilot+ PCs. Pre-order now and revolutionize your computing experience!

Global AI Summit in Seoul: Leaders Discuss Safe and Sustainable Regulations

Join global leaders at the AI Seoul Summit 2024 to discuss safe and sustainable AI regulations. Learn more about the future of AI development!

PwC Study: AI Skills Boost Wages by 25% Globally

Discover how AI skills can boost wages by 25% globally and revolutionize productivity in the global economy. Gain insights from the PwC study.

Scarlett Johansson Accuses OpenAI of Cloning Her Voice

Scarlett Johansson accuses OpenAI of cloning her voice without consent for their ChatGPT project. Debate on ethics of voice cloning sparked.