As developers find new ways to get more done by using generative AI-powered coding assistants, a recent study has found that large language models (LLMs) are more parrot than 10x developer when it comes to the relatively simple task of summarizing code.
“I’ve talked to a lot of people in the area and their instinct is that you can ask these language models to do any task for you, and they’ll do it,” says Rajarshi Haldar, a researcher at the University of Illinois Urbana-Champaign and co-author of the paper. “It’s great how often they do work, but you also have to know when they don’t work.