• 1 Post
  • 287 Comments
Joined 2 years ago
cake
Cake day: March 22nd, 2024

help-circle


  • It’s interesting to see how many ways they can find to try and brand ā€œLLMs are fundamentally unreliableā€ as a security vulnerability. Like, they’re not entirely wrong, but it’s also not something that fits into the normal framework around software security. You almost need to treat the LLM as though it were an actual person not because it’s anywhere near capable of that but because the way it fits into the broader system is as close as IT has yet come to a direct in-place replacement for a human doing the task. Like, the fundamental ā€œvulnerabilityā€ here is that everyone who designs and approves these implementations acts like LLMs are simultaneously as capable and independent as an actual person but also have the mechanical reliability and consistency of a normal computer program, when in practice they are neither of those things.







  • It’s fascinating to watch Hanania try and do politics in a comment space more focused on academic inquiry, and how silly he looks here. He can’t participate in this conversation without trying to make it about social interventions and class warfare (against the poor), even though I don’t know that Bessis would disagree that the thing social interventions can’t significantly increase the number of mathematical or scientific geniuses in a country (1). Instead, Hanania throws out a few brief, unsupported arguments, gets asked for clarification and validation, accuses everyone of being woke, and gets basically ignored as the conversation continues around him.

    This feels like the kind of environment that Siskind and friends claim to be wanting to create, but it feels like they’re constitutionally incapable of actually doing the ā€œignore Nazis until they go awayā€ part.

    1. From his other post linked in the thread he credits that level of aptitude to idiosyncratic ways of thinking that are neither genetically nor socially determined, but can be cultivated actively through various means. The reason that the average poor Indian boy doesn’t become Ramanujan is the same reason you or I or his own hypothetical twin brother didn’t; we’re not Ramanujan. This doesn’t mean that we can’t significantly improve our own ability to understand and use mathematical thinking.)











  • Yud seems to have the same conception of insanity that Lovecraft did, where you learn too much and end up gibbering in a heap on the floor and needing to be fed through a tube in an asylum or whatever. Even beyond the absurdity of pretending that your authorial intent has some kind of ability to manifest reality as long as you don’t let yourself be the subject (this is what no postmodernism does to a person), the actual fear of ā€œgoing madā€ seems fundamentally disconnected from any real sense of failing to handle the stress of being famously certain that the end times are indeed upon us. I guess prophets of doom aren’t really known for being stable or immune to narcissistic flights of fancy.