• 37 Posts
  • 2.36K Comments
Joined 2 years ago
Aquileo | cake
Cake day: March 16th, 2024

Aquileo | help-circle










  • It’s a good reference guide, yes, but it’s not good for beginners. The linked TRaSH guide seems better but I think are still a lot.

    The issue I’ve found when searching for resources for them is that there’s really no guide me for people who know very little but want to do this and guides them in the proper steps from beginning to end. I have an IT degree and even I remember struggling a little bit when I first delved into self hosting because I never really studied networking, and networking feels like a different field entirely. Right now self hosting in general reminds me of the early days of Slackware (maybe even SLS) Linux (for those that remember) - you kind of have to ask around and figure things out on your own through a bunch of lookup.

    I’m trying to ease the friction a little bit for those that want too start, and want to see if an LLM that can quickly define some words and tell you not only where to start but the steps after that based on your skill/knowledge level can ease some of that friction.

    At least until one day self hosting becomes about as easy as modern Linux.



  • I am interested in this in general too. I have a 3090 which I know isn’t much but have been thinking of trying to get a second 3090 and using an NVLink to increase to 48Gb. Mostly for learning and testing purposes, and then to eventually offer to donate to my wife’s local school district a local model they own (since teachers aren’t supposed to put student info online, that includes private LLM models like ChatGPT, but they keep accidentally doing so anyway).

    But one project at a time, and setting up this LLM would help my two friends if they have issues (it’s easy to forget for people like us that to nearly everyone else, setting up Jellyfin properly with remote access as well as things like Docker are not easy, even when they have base level knowledge), but it might help others in the future too that might then get interested in self hosting. A 24/7 guide can make a difference I think in someone actually trying self hosting or not.