• 3 Posts
  • 1.98K Comments
Joined 3 years ago
cake
Cake day: July 11th, 2023

help-circle









  • Nah, I think we just need a dialog box - could be like osx - “are you sure you want to allow the plugin that you said you wanted to use? It was built by: you, not signed by Mozilla.” Maybe put a “You have unsigned plugins running” tool tip - that gets displayed at startup or every 8 hours.

    that won’t help to warn the largest part of the target audience, those who were trained by big tech to dismiss those dialogs by reflex without reading a word in it


  • You can’t just do “ollama run” and expect good performance, as the local LLM scene is finicky and highly experimental. You have to compile forks and PRs, learn about sampling and chat formatting, perplexity and KL divergence, about quantization and MoEs and benchmarking. Everything is moving too fast, and is too performance sensitive, to make it that easy, unfortunately.

    how do you have the time to figure all these out and keep being up to date? do you do this at work?










  • I think that’s a big project for a first one, and unless things changed its configuration is not documented too well.

    both because of the complexity, and because of security risks, it would be better to start with something local, like a home assistant, or a forgejo/gitea, a jellyfin, things like that. don’t expose them to the internet directly, that’s risky, sometimes they have security bugs. rather if you want remote access, set up a wireguard VPN server. It’s simpler than it sounds