• 1 Post
  • 169 Comments
Joined 2 years ago
cake
Cake day: July 2nd, 2023

help-circle







  • Yea I’m aware but I appreciate the insight :) so far my local ai experience has been lack luster so I’m hoping that training and RAG will make up for the context size at least a little. Ifnit can answer accurately in the first place, it may not need as big of a context window.

    If you haven’t tried using RAG in some form, I would recommend giving it a go. Its pretty cool stuff, helps make models answer more accurately based on the documentation you give them though in my case, ive had limited success. Tbh, chatgpt has become my last resort when I just wanna get something done but I don’t like using it due to the privacy concerns, not to mention the ethical issues I have with ai training in general from big tech.

    How is searxng BTW? Would you say its good to host or do you use a normal search engine more often? Or do you just use it for the AI search plugin?

    Ive actually been thinking about using it rather than duckduckgo but was also hopeful the search index they are working on would be enough to satisfy my needs, or that a self hosted AI enabled search engine would work well enough when I need it.



  • Thats why i was considering training my own model if possible. Ive been toying around with kobold.CPP and gpt4all which both have RAG implementations.

    My idea is to essentially chat with documentation and as a separate use case, have it potentially be a AI search engine but locally hosted. I do still prefer to search myself, but fuck man, searches have gotten so bad, and the kobold.CPP web lookup feature was pretty neat IMO.

    So yea you’re not wrong, I’m just hoping that if in train it and or give it documentation it can reference when answering, it will be suitable. Mostly AI has been good for me as kind of a rubber ducky when troubleshooting and helping me search for things when I have some specific question and in don’t want “top 5 things vaguely related to your question” results.


  • Getting ready to move from out of the woods and back to civilization with my partner.

    Not looking forward to having neighbors above or below me but I’m very excited to have internet that doesnt fucking suck.

    Once were moved and a bit more settled, I’m gonna start really digging into to selfhosting things. I have the hardware, a couple HP mini PCs that will run home assistant and probably a server for various docker things. Nextcloud and immich seem to be the things I’ve found i wanna use so far. I already have a NAS set up, but was having am issue with it not booting if a monitor isnt plugged in. I bought a dummy plug for it but haven’t tried it out yet.

    Will also be setting up an AI server for local LLM use. Hope to train one to fit my needs once I pull the trigger on 3060 12GB card but need to figure out what other parts I’ll use. Might upgrade my main rig and use the parts from that, or maybe I’ll buy a old dell and fix it up. Not sure yet.

    Lots of ideas, so little time lol.








  • Since you mentioned having ADHD in another comment which I also have, some things that have helped me and may also help those without ADHD as well:

    • Remove friction from everyday tasks whenever possible. If you make it easier to get stuff done around the house, you’ll have more bandwidth for other things.

    • Setting alarms for things that you have to do is awesome. really helps with staying organized and just being on top of things. same goes for calendar reminders. keeping a calendar took me a while to get into the habit of but its super helpful.

    • Anything you can have on autopay that you intend to keep like cell service, internet, utilities* etc. you should. It just makes sense rather than going through it each month for so many different things. *Utilities might not be good to have on autopay just in case you have weird discrepancies. one month I had to pay $1000 for electric. I called before I paid that lol.

    • Use a credit card for small things each month to help build credit. i have a card that all its for is my cell service. Its on autopay as well as the payments for that card.

    • Keep things in a cart for a while before buying them, it can help you to determine if you actually want that thing or really need it.

    Also just cause others were talking about it, I find using videos as well a tutorials and documentation to all be helpful when troubleshooting/figuring things out, everyone learns differently and ADHD makes things like that harder. Having multiple ways to ingest that info can be helpful IMO. Not that anyone here is necessarily wrong in what they said, just coming from someone that also has ADHD, I get the struggles.