No, maybe that wasn’t it. Words precede and surpass me, they tempt and alter me, and if I am not careful it will be too late: things will be said without my having said them. Or, at the very least, that wasn’t the only thing. My entanglement comes from how a carpet is made of so many threads that I can’t resign myself to following just one; my ensnarement comes from how one story is made of many stories. And I can’t even tell them all— a more truthful word could from echo to echo cause my highest glaciers to crumble down the precipice.” - Clarice Lispector

  • 5.68K Posts
  • 7.58K Comments
Joined 3 years ago
cake
Cake day: December 9th, 2023

help-circle





  • I think all this AI technology is pretty much crap, but what I will say is that these tools are only useful when used in ensembles where multiple different models of disparate origins are consulted with the same question and then compared by a human to determine the quality of the results.

    Not only are single modality trained models always going to outperform generalist ones given the way these tools work, they are also never going to be useful unless there are multiple discrete models trained to accomplish the same task being consulted.

    What makes this all so broken is that nobody makes money by setting something up like Chatbot Arena where you can quickly feed the same data into multiple entirely different models, so the entire structure of the industry is problematic before even the first brick was laid down.

    https://arena.ai/text/side-by-side

    It is only when you input the same data into a tool like the above one that you can sketch a picture you can begin to trust. You can get quite good information out of very simple chatbots too because given comparisons against more complex ones it is far easier to establish trust, determine where innaccuracies and systematic issues lie, and route around problematic AI models if they are responding weirdly to a particular input of data.

    I still don’t think it is worth the effort unless large corporations buy up all the training data and destroy it/remove it from public access… at which point we will have a different more human problem.











  • How so?

    I am a human posting, there is nothing automated about what I do.

    I always try to post high quality stuff and I encourage you to contribute!

    I want more interesting science news here that isn’t superficial, I want science news that links right to papers encouraging people to open them up and poke around. This is why I post so much to mander.xyz, I am tired of waiting for that future.