Artificial intelligence startup Cognition Labs has launched its first artificial intelligence software engineer named Devin. developed. This tool seems to force traditional software engineers to be cautious.
Devin, the AI chatbot from Cognition Labs, is designed to solve complex coding problems like cleaning up code marathons as well as successfully passing “sophisticated” coding interviews.
Today we’re excited to introduce Devin, the first AI software engineer.
Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork.
Devin is… pic.twitter.com/ladBicxEat
— Cognition (@cognition_labs) March 12, 2024
Devin is designed with a “dynamic” way of interpreting data rather than automatically completing pieces of code, and the company says it has made major progress in models that include using reasoning rather than relying solely on traditional data sets.
Based on the company’s testing, Devin was able to generate API keys through code he wrote himself and by tweaking different LLM models. This is surprising because artificial intelligence has not yet reached such a level of “coding”. In SWE-Bench benchmarks, the AI solved 13.86% of the problems without assistance. This is almost 10 times higher than what OpenAI’s ChatGPT can offer.
While there are such AI coders in the market, many people raise the question of whether AI will replace human coders.
