Log In
GET A DEMO

What We Researched

Our study aimed to answer three main questions about GenAI for coding: 

np_rocket_881936_EA5F20

Does Copilot access help developers ship faster code?

What was the impact on delivery metrics like cycle time and PR throughput?

np_quality_4872913_EA5F20

Does it help developers ship higher quality code?

Is there a higher or lower incidence of PRs with bugs? Of retained issues?

np_low-battery_4824113_EA5F20

Does it mitigate the risk of developer burnout?

Are we seeing a change in the amount of time developers are working over hours?

bug-rate-increase

Key Insight:

Developers with Copilot access saw a significantly higher bug rate while their issue throughput remained consistent. 

This suggests that Copilot may negatively impact code quality. Engineering leaders may wish to dig deeper to find the PRs with bugs and put guardrails in place for the responsible use of generative AI.