zlacker

[return to "Measuring the impact of AI on experienced open-source developer productivity"]
1. tcdent+27[view] [source] 2025-07-10 17:15:38
>>dheera+(OP)
This study neglects to incorporate the fact that I have forgotten how to write code.
◧◩
2. narush+2m[view] [source] 2025-07-10 18:39:48
>>tcdent+27
Honestly, this is a fair point -- and speaks the difficulty of figuring out the right baseline to measure against here!

If we studied folks with _no_ AI experience, then we might underestimate speedup, as these folks are learning tools (see a discussion of learning effects in section (C.2.7) - Below-average use of AI tools - in the paper). If we studied folks with _only_ AI experience, then we might overestimate speedup, as perhaps these folks can't really program without AI at all.

In some sense, these are just two separate and interesting questions - I'm excited for future work to really dig in on both!

[go to top]