Chinese tech giant Baidu’s AI chatbot, Ernie Bot, has outperformed OpenAI’s ChatGPT in benchmark and Chinese language tests, according to the company. Ernie Bot exceeded ChatGPT and the advanced GPT-4 in benchmark tests and attained outstanding Chinese ability, even surpassing GPT-4, while its comprehensive ability is slightly inferior to GPT-4, according to China Science Daily. Baidu’s emphasis on progress highlights the rivalry and race between the US and China in the field of generative AI.
Ernie Bot scored better than GPT-4 in the AGIEval benchmark test in the Chinese section, while GPT-4 performed better in English. The AGIEval uses 20 exams to assess chatbots’ performance in human standardized tests, including general university entrance exams, judicial exams, math competitions, bar exams, and national civil service exams. Meanwhile, Ernie Bot beat both ChatGPT and GPT-4 in the C-Eval test, which contains 14,000 multiple-choice questions in over 50 subjects.
Baidu publicly released Ernie Bot in March, but its debut was unsuccessful, resulting in a fall in the company’s shares. However, Ernie 3.5 has now made significant strides in beta testing, surpassing ChatGPT (3.5) in comprehensive ability scores and outperforming GPT-4 in several Chinese language capabilities, according to a blog post.
In terms of the English MMLU test, which evaluates chatbots’ professional skills in nearly 60 disciplines, including STEM, humanities, and social sciences, both ChatGPT and GPT-4 performed better than Ernie Bot. While Baidu has not officially stated which sectors they intend to use the AI chatbot, Ernie Bot’s breakthrough in China is notable.
Frequently Asked Questions (FAQs) Related to the Above News
What is Ernie Bot?
Ernie Bot is an AI chatbot developed by Chinese tech giant Baidu.
How does Ernie Bot compare to other AI chatbots?
Baidu claims that Ernie Bot outperforms OpenAI's ChatGPT in benchmark and Chinese language tests.
Which benchmark tests did Ernie Bot perform well in?
Ernie Bot scored better than GPT-4 in the AGIEval benchmark test in the Chinese section, while GPT-4 performed better in English. Ernie Bot beat both ChatGPT and GPT-4 in the C-Eval test, which contains 14,000 multiple-choice questions in over 50 subjects.
When was Ernie Bot released?
Ernie Bot was publicly released in March by Baidu.
Did the release of Ernie Bot have an impact on Baidu's shares?
Yes, when Ernie Bot was first released, its debut was unsuccessful, resulting in a fall in Baidu's shares.
How has Ernie Bot performed in beta testing?
Ernie Bot 3.5 has made significant strides in beta testing, surpassing ChatGPT (3.5) in comprehensive ability scores and outperforming GPT-4 in several Chinese language capabilities, according to a blog post.
Is Ernie Bot proficient in English?
Ernie Bot's proficiency in English is slightly inferior compared to ChatGPT and GPT-4 in terms of the English MMLU test, which evaluates chatbots' professional skills in nearly 60 disciplines, including STEM, humanities, and social sciences.
What sectors does Baidu intend to use Ernie Bot in?
Baidu has not officially stated which sectors they intend to use the AI chatbot, but Ernie Bot's breakthrough in China is notable for its outstanding Chinese ability.
Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.
