zlacker

>>dheera+(OP)
Very interesting methodology, but the sample size (16) is way too low. Would love to see this repeated with more participants.

>>Jabrov+m2
Noting that most of our power comes from the number of tasks that developers complete; it's 246 total completed issues in the course of this study -- developers do about 15 issues (7.5 with AI and 7.5 without AI) on average.

>>narush+mf
Did you compare the variance within individuals (due to treatment) to the variance between individuals (due to other stuff)?