lai, a supersonic warrior@piefed.social to Artificial Intelligence@lemmy.worldEnglish · edit-28 days agoi just got another 10 tons of poloniumimagemessage-square8linkfedilinkarrow-up14arrow-down10file-text
arrow-up14arrow-down1imagei just got another 10 tons of poloniumlai, a supersonic warrior@piefed.social to Artificial Intelligence@lemmy.worldEnglish · edit-28 days agomessage-square8linkfedilinkfile-text
minus-squareMyNamesTotallyRobert@lemmynsfw.comlinkfedilinkEnglisharrow-up1·8 days agoSelf hosting FTW
minus-squarebulwark@lemmy.worldlinkfedilinkEnglisharrow-up0·8 days agoI also self host, but I use OpenWebUI as a front end and ollama as a backend. Which one is this?
minus-squareikidd@lemmy.worldMlinkfedilinkEnglisharrow-up0·edit-28 days agoLooks like Kobold. You can set it up as a shared LLM model server. Looks like Dark Champion model. Edit: https://huggingface.co/DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF
Self hosting FTW
I also self host, but I use OpenWebUI as a front end and ollama as a backend. Which one is this?
Looks like Kobold. You can set it up as a shared LLM model server. Looks like Dark Champion model.
Edit: https://huggingface.co/DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF