For sure, the popular opinion on reddit/Lemmy skews towards absolutely self-hosting everything they can, and multi-trillion dollar tech companies controlling AI skews the opinions of the technology negative. I have a BIL who runs self-hosted AI though (requiring 2 x 4090s in series for his use-case), so it can be done. The tech is only as shit as the user allows it to be (environmental concerns, obviously its pretty objectively shit)
I do much of my image work with local models, at least when it comes to trying to get something specific. All audio transcription is done with a local model, and a lot of the summarization and categorization of those transcripts is also local models.
The comment where I explained this all got downvoted too, though, so yeah. Still a lot of “AI=bad” regardless of self-hosted or not.
For sure, the popular opinion on reddit/Lemmy skews towards absolutely self-hosting everything they can, and multi-trillion dollar tech companies controlling AI skews the opinions of the technology negative. I have a BIL who runs self-hosted AI though (requiring 2 x 4090s in series for his use-case), so it can be done. The tech is only as shit as the user allows it to be (environmental concerns, obviously its pretty objectively shit)
I do much of my image work with local models, at least when it comes to trying to get something specific. All audio transcription is done with a local model, and a lot of the summarization and categorization of those transcripts is also local models.
The comment where I explained this all got downvoted too, though, so yeah. Still a lot of “AI=bad” regardless of self-hosted or not.