• ComradePenguin@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    9 hours ago

    It is already winning thanks to Chinese companies. The US frontier models are better, but not by much. They are also a bad deal. I’d rather have 10-20x usage of a almost as good model, that makes it possible for me to actually get shit done.

  • Sims@lemmy.ml
    link
    fedilink
    arrow-up
    15
    arrow-down
    1
    ·
    2 days ago

    Nice initiative, but F**K I’m tired of Mericans that think that the “Merica” dump is the hub of the world, and have to specifically pull out that nation as if something special. Merica is NOT the world - get it into your propagandized minds !

    "America should not fall behind on the freedom to run, inspect, modify, benchmark, teach, and preserve intelligence infrastructure. The practical posture is American capacity with global open standards. ".

    Merican self-grandization/exceptionalism is annoying as F… To local Merican activists: "Broaden your effing scope to include the huge world out there beyond insignificant ‘Merica’, or F’ off with your local problems/activism.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      8
      ·
      2 days ago

      It’s kind of funny how China is actually doing these things right now while Americans are talking it up. I think what we’ll see in practice will be this manifesto applied to China.

  • VoxAliorum@lemmy.ml
    link
    fedilink
    arrow-up
    5
    ·
    edit-2
    20 hours ago

    I agree. And one stop further: commercial models (not commercial model hosting) have to largely die due to copyright violations. Only chance for that is that the EU makes a move with the president after Trump.

    You cannot really ban the violating models that exist nowadays, but you can decide that these models themself cannot be commercialized due to their violations.

  • rob200@retrofed.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    I’m not as up to date (like at all lol) with specifically open source ai. Is it any better then corporate ai? Including data center-like resources use? or otherwise?

    • brucethemoose@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      9 hours ago

      For corporate use, it’s very good. But the immediate advantage is cost.

      • The open source models are sparse, and use an efficient architecture. They are very efficient to run.

      • You can pick from hundreds of competing providers (including those using specialized ASICs), rent GPUs, or run your own server internally.

      I’d say the big unrealized advantage is flexibility. Companies can fine tune the big open models to their specific tasks, and even host a “mixture of Loras” as a set of specialized models. They can constrain output at the sampling level, and cache context programmatically. They can use raw completion syntax creatively, or train task vectors real quick. There’s all sorts of neat hacking to be done, but the issue is that 99.9% of businesses have no idea because they’re used to getting chat response tokens from a black box like Claude.


      Now… as a pure, turnkey, “cost is no object” agenic worker? Clause is a but better, most of the time. But not always, these days, especially if speed, long context or other things are factors.


      Also… the “unspoken” business issue is that most big open models are from China.

      It’s stupid. It’s just a block of weights in an open source harness, no more security risk than (say) a tire on a car. But try explaining that to decision makers who don’t really understand the tech and are afraid of getting hacked.

      But Nvidia has a pretty good big MoE now, and there a number of “laundered” finetunes of Chinese models, so even that’s hardly an excuse anymore. It’s just a matter of time before word gets around, businesses realize Claude is never going to replace their employees (just augment them), and look for cheaper and more controlled solutions.

    • chicken@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      2
      ·
      21 hours ago

      Don’t know exactly how it compares but I’ve measured the electricity increase while running it, something you can run on one graphics card is around the same as a resource intensive video game.

    • Maeve @lemmygrad.ml
      link
      fedilink
      arrow-up
      8
      ·
      2 days ago

      We’re not stopping it, failing a major Carrington event that destroys all satellites. We may as well aim to make it less harmful and more beneficial.