all the free stuff i came to expect, like spell check, ocr, search, word completion, video skips, content, are now behind a stupid ai that usually is wrong/useless. they want money now?
Bad news, it won’t.
What will happen is could providers will run thousands of small models instead of a couple large ones. Increasing inefficiencies and causing the rapid decline of our planet.
this feels shortsighted.
a ton less people actually use a desktop computer that would allow use for an slm. the world has moved on from desktops, sorry. those same users, however are sure as fuck already users of LLMs whether they want to know it or not. its being piped in as tooling fucking everywhere.
you arent doing that kind of mass scaling using slms. ‘4 out of 5’ use cases is not going to be running on your local desktop, nope. thats just ignoring the practical implimentations that exist now let alone in 5 years.
i watched broadcast tv for the first time in a long, long time and its amaing how 25% of ads seem like they are for ai driven services. no desktop required.
@originalucifer@moist.catsweat.com @cm0002@europe.pub
a ton less people actually use a desktop computer that would allow use for an slm.
I once tried 2B-parameter SLMs in my Nokia 5.4 (which is far from being a flagship phone), and they kind of worked (namely, distilled DeepSeek R1 and distilled Qwen). Therefore, one does not need a computer in order to run SLMs.
