• Sparrow_1029@programming.dev
    link
    fedilink
    arrow-up
    62
    arrow-down
    20
    ·
    4 days ago

    TLDW:

    • China is good at compressing the existing models by stealing the answers they give you to make models that have equivalent performance that are way cheaper (plagiarism)
    • shares a bunch of clips of Ed Zitron repeating a lot of the things he said over the last six months about there not being a path to profitability for American AI companies
    • the bond market looks similar to how it did back before 2008
    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      71
      arrow-down
      3
      ·
      4 days ago

      It’s worth noting that the whole China is distilling our glorious models narrative is largely nonsense. First of all, everybody distills, so it’s not like it’s unique to Chinese companies. Second, most of actual research that’s published is now coming out of China.

      • loathsome dongeater@lemmygrad.ml
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        3
        ·
        4 days ago

        Making a new cheaper model involves nothing more than taking output from an openathropic model and feeding it into your own. Don’t worry about why only Chinese companies are able to do it.

        • John@lemmy.ml
          link
          fedilink
          English
          arrow-up
          33
          arrow-down
          1
          ·
          4 days ago

          Why do ya’ll always ad hominem our instance the moment somebody gives a different perspective? Like, honestly… lmfao

            • Lucius_Sweet@lemmy.world
              link
              fedilink
              arrow-up
              1
              arrow-down
              19
              ·
              3 days ago

              .ml is the only place I have seen so far on Lemmy that regularly removes comments and bans users. ml crowd can’t deal with opinions that differ from theirs so just ban and censor them.

              • Nonconfrontational@lemmy.ml
                link
                fedilink
                arrow-up
                10
                ·
                3 days ago

                I get banned from .world communities like once a week lol. My comments are sometimes removed for civility, but more often than not the mod just doesn’t like to hear America get trash talked.

                • Lucius_Sweet@lemmy.world
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  9
                  ·
                  3 days ago

                  I was banned and had comments removed for suggesting that China was far from a socialist country and have just figured out a different approach to exploiting workers surplus labor.

                  Seems like this is a common theme for power tripping mods as well as any other system of power. Proves the main point I was trying to make about vertical power structures being the problem. Give most people any degree of power and it goes to their heads. Our monkey brains can’t handle power.

              • ZeroHora@lemmy.ml
                link
                fedilink
                English
                arrow-up
                7
                arrow-down
                1
                ·
                3 days ago

                When the “opinions” is like that bullshit above why not remove it? What the moron is adding to the discussion?

                • Lucius_Sweet@lemmy.world
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  9
                  ·
                  3 days ago

                  I’m sure the irony of responding to a bullshit comment with a bullshit comment of your own is lost on you. Your comment is a great example of the mentality of those who are pro censorship.

                  I would suggest learning basic grammar before responding to anyone else.

                  What the moron is adding to the discussion?

                  My 8 year old can write at a more intelligible sentence than this. I do not trust the opinions of those with an inferior intellect to him.

    • HiddenLayer555@lemmy.ml
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      1
      ·
      edit-2
      4 days ago

      China is good at compressing the existing models by stealing the answers they give you to make models that have equivalent performance that are way cheaper (plagiarism)

      Lol plagerism is when they take your shitty product and actually make it better apparently. Begs the question why China manages to succeed at this when Western companies that own the original product can’t. You’d think they’d always be one step ahead of those damn plagerising Chinese scum or at least would be able to do the exact same thing China does.

      Also if you’re calling plagerism on this I’m calling plagerism on all of AI. You can’t accept any generative AI while simultaneously pearl clutching when someone else plagerises your country’s AI. So pick one. Either we ban all AI for plagerising all of humanity or we don’t give a shit when one AI company plagerises another.

      • Sparrow_1029@programming.dev
        link
        fedilink
        arrow-up
        9
        ·
        edit-2
        3 days ago

        I didn’t really intend “plagiarism” to convey my opinion (which is that the AI companies can get fucked), but more as a neutral term to mean Chinese companies are copying to make cheaper models, as asserted by the video

  • I Cast Fist@programming.dev
    link
    fedilink
    arrow-up
    24
    ·
    4 days ago

    “They don’t have anything for hypergrowth anymore. They don’t have the next iphone, the next google search, they don’t have anything, they’re completely out of ideas” - Ed Zitron

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      51
      arrow-down
      1
      ·
      4 days ago

      TLDW: American companies spend insane amounts of money and have no path towards profitability, and Chinese companies are spending a tiny fraction of that to deliver a product that’s mostly as good. On top of that, countries and companies are uncomfortable relying on closed models. So, Chinese providers offering open models at far lower rates mean they’re quickly taking over the market. And it turns out that simply having the best model isn’t really the most important thing. If a cheaper model can do the work then there’s no point paying order of magnitude for a more capable one.

        • 666dollarfootlong@lemmy.world
          link
          fedilink
          arrow-up
          9
          ·
          4 days ago

          And the video points out that the reason AI has trouble getting profitable is because it doesn’t just work like how tech “traditionally” works: software pretty much only has development costs, and after that copying and selling infinite copies of the product is pretty much free, where as AI not only has development costs, but it also costs a ton to provide outputs to the customers.

            • whatiswrongwithyou@lemmy.ml
              link
              fedilink
              arrow-up
              3
              ·
              3 days ago

              No, now that “cognition” of a sort can be smeared on any task at the cost of electricity the future belongs to those who control the generation of electricity.

              Local models are much less efficient in terms of both power consumption and cost per token.

              I am currently running a local model. It’s not efficient.

              • tracyspcy@lemmy.ml
                link
                fedilink
                arrow-up
                1
                ·
                3 days ago

                Concept of global knowledge available locally sounds plausible to me. I’m not expert in this topic though.