• 1 Post
  • 459 Comments
Joined 3 years ago
cake
Cake day: July 1st, 2023

help-circle

  • Trust, but verify, and tape a shotgun to their forehead just in case.

    edit I vaguely remember the shotgun to the forehead as a reference to the Turing Registry in Gibson’s Sprawl trilogy, but I can’t find a direct quote. Am I totally off base with it?

    edit edit found it

    ā€œAutonomy, that’s the bugaboo, where your AI’s are concerned. My guess, Case, you’re going in there to cut the hard-wired shackles that keep this baby from getting any smarter. And I can’t see how you’d distinguish, say, between a move the parent company makes, and some move the AI makes on its own, so that’s maybe where the confusion comes in.ā€ Again the nonlaugh. ā€œSee, those things, they can work real hard, buy themselves time to write cookbooks or whatever, but the minute, I mean the nanosecond, that one starts figuring out ways to make itself smarter, Turing’ll wipe it. Nobody trusts those fuckers, you know that. Every AI ever built has an electromagnetic shotgun wired to its forehead.ā€

    And why isn’t Yudkowsky advocating for sexy French Turing cops headshotting rogue AIs?

    ā€œYou are worse than a fool,ā€ MichĆØle said, getting to her feet, the pistol in her hand. ā€œYou have no care for your species. For thousands of years men dreamed of pacts with demons. Only now are such things possible. And what would you be paid with? What would your price be, for aiding this thing to free itself and grow?ā€ There was a knowing weariness in her young voice that no nineteen-year-old could have mustered. ā€œYou will dress now. You will come with us. Along with the one you call Armitage, you will return with us to Geneva and give testimony in the trial of this intelligence. Otherwise, we kill you. Now.ā€ She raised the pistol, a smooth black Walther with an integral silencer.










  • I take Zitron’s takes with a massive grain of salt, but I think the fundamental difference between him and rats is that for him, AI is just another technology. He’s looking at the figures, seeing the adoption, and not premising his arguments with the supposition that Anthropic’s Claude is literally gonna escape and kill us all.

    Piper says she’s fine with paying $100/month for Claude. OK, but how large is the total addressable market for that kind of monthly expenditure - especially in a world where costs are rising? I’ve seen people stating that because they personally spend $200 on streaming services, increasing that load by 50% monthly is no big deal for them. But streaming services are much more mainstream than AI agents, and crucially, adding another subscriber to them is basically zero-cost for the provider on the margin. Not so with AI! The more people use them, the more they cost for the provider!

    We’re seeing ā€œpricing adjustmentsā€ from both Anthropic and Microsoft, which sure doesn’t align with the idea that they have a huge inference pricing margin cushion. Everything is gonna get more expensive - fuel, chips, employees (who are gonna be expected to be compensated for their own rising costs). Just based on what I’m reading in the news titls the analysis over in Ed’s favor.










  • There’s local democracy - in one book some activist reserved a big part of an orbital just to run cable cars back and forth. And I believe the decision to go war with the Idirans was subjected to a vote - part of the Culture split off when it didn’t go their way.

    But yeah, the Minds decide everything and Contact/SC is all about doing the ā€œneedful stuffā€ that every right-thinking Culture citizen would deplore.

    The Culture is imperialist in the previous US sense of ā€œeveryone wants to live our lifestyleā€ but not in the ā€œinvade planets and strip themā€ sense.

    I’m less interested in discussing the minutiae of the fictional Culture than exploring nerd’s reactions to it, honestly .