Website Github GPG keys

I write code, that’s about all I’m rn

  • 25 Posts
  • 157 Comments
Joined 2 years ago
cake
Cake day: July 3rd, 2023

help-circle
  • I’m working on self-hosting my own LLMs.

    I realized there are things I wanna talk about and research but I don’t want to send it to open AI. Frankly I feel gross about how much I’ve sent to open AI. My desktop is a beefy gaming rig that I don’t use for gaming much. I have a 20thread core, 64gb ram, an Nvidia gtx 3060 and 5 spare TB so why not.

    • I keep a few ollama models downloaded and I’m slowly getting to know them and what they can do. Gemma seems to answer the fastest so I’ve been using that. Deepseek is like the reasoning button on chatgpt.
    • I use openai-whisper to transcribe meetings I record using OBS. It’s really slow so I have a cronjob transcribe all my meetings for that day overnight.
    • Open Web UI is a fantastic LLM frontend. It provides tools, rags, web searching, and model ranking all as a simple to use UI.
    • My desktop has a Wireguard server which makes it easy to use my OpenWebUI on my phone.

    Now I want to work on giving the LLM access to my Google calendar so it can create reminders for me. I’m sick of forgetting to think about remembering to do things so I hope if I can just ramble at the LLM about what I’m doing or what’s on my mind it can organize my thoughts. What else are these LLM actually for?


















  • So you’re right… To an extent… I usually say I’m making a new button when I’m figuring out an alias.

    I guess a better way to express my point is that I’m not geared for interpreting graphics to tell what a button is supposed to do, nor am I cool with needing to press the same buttons in order multiple times.

    On the CLI, all the buttons are named with (impo) meaningful names, and I can combine them into new just-as-accessable buttons whenever I want for free! It might align more with my working frustrations, I hate dragging my eyes over the same text/iconography every time I wanna do something, I want it to just ‘happen’. I need a user interface that can react to me faster than I can think and to achieve that I just limit my UI to exactly what I want and I keep it easy for me to expand as I need it.