Has anyone considered a home server? Assuming mobility is not important if we pick components to match a similar hardware would it be more value for money?

I specifically chose a Mac Studio 128GB as my home server that's also running LLMs to be always online, in part due to the minimal idle power consumption and mostly fan-less operation. It's definitely expensive, especially nowadays, but I can still recommend Mac Minis as a cheaper alternative for someone to just get started with an affordable, always-on home server that won't annoy any housemates. I think both are in some sweet spot in terms of value for money, depending on what you're looking for in a home server. If image or video generation is your thing, look further though, definitely look into a proper GPU then. Macs are quite slow at that. They're just great at MoE LLMs because it's mostly a matter of (V)RAM size.

A decent gaming machine perfectly doubles as your friendly local inference server. Just start llama-server with the model of your choosing and start chatting with it through its Web interface or connect any chat completion-compatible client (agentic or not) which will use REST to send requests and receive responses. From any device on your network. Voila.

Generally speaking a home server/workstation set up is going to provide better performance at lower cost. You don't sacrifice much mobility either so long as you have an internet connection and can either SSH tunnel or use Tailscale (never used, just know it's popular).

Which components are you thinking about?

Am unsure - was hoping someone tried this and there is a tested component list of consumer grade pc parts that can do the trick

Curious : why would you say no design patterns?

Because design patterns are only applicable at a scale. I noticed codex inventing factories, components, etc when the task was simply to draft HTML page. Instead, it build the entire layered architecture for imaginary future complexity - classical right-after-graduation student - it knows how to build the cool stuff, but does not know it is not applicable everywhere

Woah! Never thought this would be crawled by the google bot. Thanks for sharing

Well, what concerns me most here is this: The US Government is in a spot wrt US citizens and US homeland, blanket surveillance on the rest of the world seems fair game. Sure, the law would not protect the 'aliens'. Concerned citizens should look at being aware of alternative tools that would minimize possibility of the US Gov eavesdropping, inadvertently or otherwise. Perhaps a system of opensource OSs, TOR logins and specially crafted logins, on pre-identified low risk networks. thoughts?