Lemmy account of [email protected]

  • 27 Posts
  • 560 Comments
Joined 2 年前
cake
Cake day: 2024年10月7日

help-circle


  • Phew, to run such a model - even just 27B quantized - at a reasonable speed requires some serious GPU Power.

    Best thing I have is a 7800 XT 16gb (so ROCm it would be), don’t think that’s realistic and I’d rather invest the necessary amount of money for new GPUs into sth. more useful like a small electric vehicle than a slop cannon 🥴. Happy to hear actual useful things can be retained after the bubble finally crashes though. Oh please, let it crash tomorrow… together with the housing market…


  • Interesting. I tested ChatGPT and Mistral and oh my god, ChatGPT was abysmal. Hallucinated way harder. Mistral is okay if being used on highest settings.

    Did you create an account with Mistral? Without it they only expose a low-end model to the web, which isn’t properly declared last time I checked. Can be the free plan, I guess they just want to avoid their infrastructure being hammered.

    Personally all those Silicon Valley pricks can offer whatever, I don’t even have a Google account anymore and couldn’t be happier with that. Not saying Mistral is optimal, but at least they’re not part of the current US swamp. And I at least somewhat believe they actually read the damn GDPR. I’m totally fine with it not being the “cutting-edge”, especially given the cutting-edge cuts straight through culture and people’s lifes on purpose and with maximum brutality, and I seriously liked to see their image generator being way worse as well as Mistral refusing to open sites that banned it in the past (if they changed that behaviour please let me know). Not to mention their site isn’t even remotely as infected with trackers and other junk as the others, at least that’s what I’ve read (forgot to bookmark that hackers’ analysis I’ve read a year ago unfortunately).


  • Quick mention about Chatbots: In general they can be useful if you already have a grasp on something, so you can detect potential nonsense better. Additionally they can act like a drug especially on lonely people, and any company tries to sell them to you as awesome code generators. Yet Mistral AI already generated an answer to me telling me to dd my encrypted root hard drive for a speed test, even doubling down on it being safe.

    Not saying they can’t be useful for OP. Just that they’re like a handheld circular saw*, a powertool better only used by people who already know sufficient basics about wood.

    *where the salesman got rid of the safety handle and tells you to “just let it go on its own”.



  • I’m simply not seeing the benefit over a well maintained degoogled Android ROM such as Graphene or /e/OS. The amount of work I have to out in to relearn stuff is next to none, support is higher and you know hardware support lasts long (thinking of e.g. the Murena Fairphone 6). Sailfish looks like just another corporation with partially closed Source and bumpy track record, and with hardware such as Fairphone (and many other phones) you at least got some digital mobility to move to something else if your distribution of choice goes down the drain.

    I get that having a third option is always better even if all three are questionable, but I don’t see that in Sailfish either.







  • The code quality apparently was abysmal and full of dirty hacks due to a mix of “beginner energy” and “go fast & break things” Silicom Valley mindset. The issues with bun (leading to the big Anthropic hack) were subtly blamed on the Zig language, even though Zig is completely fine; Bun’s code (which already was full of bad generated slop at that point, as well as code by programmers who were treated badly -> more bad code) was just crap.

    After Zig was blamed the Zig creator wrote a blogpost detailing all of it. Worth a read, certainly more human than the corposlop Anthropic announces.


  • It’s even more funny if you know the backstory of bun. It was basically the perfect example of how to not to do things before they burned a whole forrest to have Claude slop it into another language, based on a codebase that was measurably bad. Now nobody actually knows the whole codebase anymore.

    Given the phenomenal garbage that are the other big vibecoded projects (like the “compiler that can compile Linux” - it can’t) using bun now is just like lottery.




  • That’s the resolver’s job, Wireguard absolutely reconnects asap if the connection’s heartbeat goes out. You in your case got Cloudflare to make sure it can connect somewhere.

    The only way to truely serverless’ly find each other when both parties got dynamic IPs would be IPv6 multicast (such as via Librecast). Not just is that still not supported by the network itself a lot of times (sadly) but I doubt any LLM on this planet would implement it correctly, way too niche. Any other way leads through some DNS resolver or third-party service (like Cloudflare) or a network such as Magic Wormhole.

    It’s fine if the Slopware works for you, but your arguments make no sense whatsoever. The only thing you’re currently doing is making enemies in the selfhosting community, not connections.