Honestly just jump in with whatever hardware you have available and a small 1.5b/7b model. You’ll figure out all the difficult uncertainties as you go and try to improve things.

I’m hosting a few lighter models that are somewhat useful and fun without even using a dedicated GPU- just a lot of ram and fast NVMe so the models don’t take forever to spin up.

Of course I’ve got an upgrade path in mind for the hardware and to add a GPU but there are other places I’d rather put the money atm and I do appreciate that it all currently runs on a 250w PSU.

Myron Cook - A very hands on and educational geology channel

USCSB - US Chemical Safety Board that recreates incident investigations and gives recommendations.

It would probably get much less hate if it was just called “Burger Cheese”

We just have to convince the conservatives that this would be a DEI program and it’ll be a slam dunk case. /s

Here’s a longer video that includes him getting cuffed on the floor. https://youtu.be/DsQ5YvT_28Y