I use them mostly for helping me write emails or meal prepping tbh lol. I’ve used deep seek to help me with python before but if you’re not just dicking around like me you’d definitely want something more powerful.
For image generation it sounds like this tool called comfy UI is the way to go. I have it running in docker but haven’t set anything up inside it yet.
It’s pretty neat, I really set this up to help keep my data out of the hands of the corps and the feds lol.
I got an old machine off eBay(see pic) I only run models that are 8b parameters or less.
I got Ubuntu server on it. Then docker running in that. In docker I have olama, open web UI, jellyfin and a game sever. No issues running any of that.
Edit: if you want something that can run better LLMs I recommend more RAM and a better GPU
Nice! Do you use the models for coding? Or image generation, for example?
I use them mostly for helping me write emails or meal prepping tbh lol. I’ve used deep seek to help me with python before but if you’re not just dicking around like me you’d definitely want something more powerful.
For image generation it sounds like this tool called comfy UI is the way to go. I have it running in docker but haven’t set anything up inside it yet.
It’s pretty neat, I really set this up to help keep my data out of the hands of the corps and the feds lol.