

https://www.patreon.com/MaxRead/posts/ai-x-risk-and-ai-173181621
worth the full read, but hereās the parts I liked
But āx-riskā is not the only kind of āexistentialā risk about which AI enthusiasts and their converts tend to worry. This recent Ezra Klein column, written in the wake of OpenAIās release of hundreds of mathematical proofs, is a nice articulation of something Iāve come to think of as ān-risk,ā for āennui riskā (with the mutual understanding that itās not pronunciation-accurate so donāt bother making a nitpicky little comment about it): fear of the loss of comprehension, control, and meaning in the face of impossibly sophisticated godlike machines poses.
We see the threat of ān-riskā in some of the emotional reaction of mathematicians faced with the results of OpenAI models bulldozing through open problems: a sense of having been surpassed and left behind, having the meaning from which one derives oneās worth totally emptied. In some sense, on a conceptual level and as a discursive object, x-risk is preferable to n-risk: itās striking, dramatic, and offers us humans an ongoing chance at great feats of heroism and genius. N-risk has no such narrative reassurances. Maybe itās better to burn out (as your body is turned into a paperclip) than to fade away.
Here you might ask: Is the cause of melancholy and despair on the part of some mathematicians simply the knowledge that a computer system has surpassed their ability to understand or produce proofs? Or is it the realization that said computer system is privately owned and confidentially developed in service of accumulation rather than the pursuit of shared human knowledge? Or is it the contempt with which the people who work for the computer system companies and the hanger-on fans of these computer systems seem to regard the mathematicians? Or is it the sudden recognition that the pursuit of mathematical truths has already been so totally devalued by an anti-intellectual social system that you can no longer feel secure that the tradition to which you have devoted your life will continue as a space of intellectual inquiry, even given the development of these new tools? And so on.
I mean, realistically, itās all of the above.



man, Iām aiming for a Christmas tree farm myself. 23 years to go.