Study Finds AI Models like ChatGPT Not Yet a Substitute for Human Programmers


A recent study has shown that while AI models like ChatGPT have the potential to boost productivity, they are not yet capable of replacing human programmers. The study, published in IEEE Transactions on Software Engineering, compared the performance of ChatGPT in generating code to that of human programmers, focusing on functionality, complexity, and security.

The research found that ChatGPT’s success rate in producing functional code varied widely depending on the task difficulty, programming language, and other factors. While the AI could sometimes match or even surpass human programmers, it also displayed significant limitations. The study highlighted the importance of understanding both the strengths and weaknesses of AI models like ChatGPT.

The study further tested ChatGPT’s ability to solve coding problems from the LeetCode platform across five programming languages. While the AI performed well on pre-2021 coding problems, its success rate dropped significantly when faced with newer challenges introduced after 2021. This suggests that ChatGPT struggles with unfamiliar, more recent coding problems due to its training data not including these challenges.

Yutian Tang, a lecturer at the University of Glasgow involved in the study, emphasized the need for ongoing development and training for AI models like ChatGPT to keep up with the evolving field of software engineering. While AI can enhance productivity and automate certain coding tasks, it is not yet a substitute for human programmers.

The study’s findings underscore the importance of continuous improvement and training for AI models like ChatGPT to effectively address the ever-changing landscape of software engineering. While AI can excel in solving familiar problems, it still lacks the critical thinking skills of human programmers when faced with new and complex challenges.

See also  Using ChatGPT to Trade Stocks

Frequently Asked Questions (FAQs) Related to the Above News

Please note that the FAQs provided on this page are based on the news article published. While we strive to provide accurate and up-to-date information, it is always recommended to consult relevant authorities or professionals before making any decisions or taking action based on the FAQs or the news article.

Aniket Patel
Aniket Patel
Aniket is a skilled writer at ChatGPT Global News, contributing to the ChatGPT News category. With a passion for exploring the diverse applications of ChatGPT, Aniket brings informative and engaging content to our readers. His articles cover a wide range of topics, showcasing the versatility and impact of ChatGPT in various domains.

Share post:



More like this

Apple Inc. AI Stocks Rank 6th on Analyst List, With High Growth Potential

Apple Inc. AI Stocks ranked 6th with high growth potential, experts bullish on tech giant's AI capabilities amidst market shifts.

Anthropic Launches Advanced Claude AI Chatbot for Android Users, Revolutionizing Conversations and Document Analysis

Anthropic's Claude AI Chatbot for Android offers advanced features for seamless conversations and document analysis, revolutionizing user experience.

ChatGPT Plus: Is it Worth the Investment for Advanced Content Generation?

Discover if ChatGPT Plus is worth the investment for advanced content generation. Compare features and benefits for improved AI language model.

Tech Giants Invest Billions in Aragon’s Renewable Cloud Centers

Tech giants invest billions in Aragon's renewable cloud centers, making it Europe's leading hub for cloud storage. Don't miss out on this cutting-edge development!