Code analysis firm sees no major benefits from AI dev tool when measuring key programming metrics, though others report incremental gains from coding copilots with emphasis on code review.

“Many developers say AI coding assistants make them more productive, but a recent study set forth to measure their output and found no significant gains. Use of GitHub Copilot also introduced 41% more bugs, according to the study from Uplevel”

study referenced: Can GenAI Actually Improve Developer Productivity? (requires email)

  • parpol@programming.dev
    50·
    3 months ago

    Not only was it not that useful to me, it decreased the most fun part of programming (writing code) and increased the least fun part of programming (reviewing code), so it overall gave me a worse experience.