

Remember last week when that study on AIās impact on development speed dropped?
A lot of peeps take away on this little graphic was āsee, impacts of AI on sw development are a net negative!ā I think the real take away is that METR, the AI safety group running the study, is a motley collection of deeply unserious clowns pretending to do science and their experimental set up is garbage.
https://substack.com/home/post/p-168077291
āFirst, I donāt like calling this study an āRCT.ā There is no control group! There are 16 people and they receive both treatments. Weāre supposed to believe that the ātreated unitsā here are the coding assignments. Weāll see in a second that this characterization isnāt so simple.ā
(I am once again shilling Ben Rechtās substack. )
True. They building city sized data centers and offering people 9 figure salaries for no reason. They are trying to front load the cost of paying for labour for the rest of time.