• 0 Posts
  • 3.74K Comments
Joined 2 years ago
cake
Cake day: August 27th, 2023

help-circle



  • Due to some disagreements—some recent; some tolerated for close to 2 decades—with how collaboration should work, we’ve decided that the best course of action was to fork the project

    Okay, that was always allowed!

    Programming is the weirdest place for kneejerk opposition to anything labeled AI, because we’ve been trying to automate our jobs for most of a century. Artists will juke from ‘the quality is bad!’ to ‘the quality doesn’t matter!’ the moment their field becomes legitimately vulnerable. Most programmers would love if the robot did the thing we wanted. That’s like 90% of what we’re looking for in the first place. If writing ‘is Linux in dark mode?’ counted as code, we’d gladly use that, instead of doing some arcane low-level bullshit. I say this as someone who has recently read through IBM’s CGA documentation to puzzle out low-level bullshit.

    You have to check if it works. But if it works… what is anyone bitching about?














  • Right, should say deep neural networks. Perceptrons hit a brick wall because there’s some problems they cannot handle. Multi-layer networks stalled because nobody went ‘what if we just pretend there’s a gradient?’ until twenty-goddamn-twelve.

    Broad applications will emerge and succeed. LLMs kinda-sorta-almost work for nearly anything. What current grifters have proven is that billions of dollars won’t overcome fundamental problems in network design. “What’s the next word?” is simply the wrong question, for a combination chatbot / editor / search engine / code generator / puzzle solver / chess engine / air fryer. But it’s obviously possible for one program to do all those things. (Assuming you place your frozen shrimp directly atop the video card.) Developing that program will closely resemble efforts to uplift LLMs. We’re just never gonna get there from LLMs specifically.


  • Fuck software patents.

    Copyright made sense when it was a decade or two. Industrial patents seem basically functional. Trademark’s mostly truth-in-advertising for consumer choice.

    But software patents aren’t about how you do something - they’re claiming the entire concept, in the broadest possible terms, and killing it. Straight-up murdering that potential. It is denied the necessary iterative competition that turns dogshit first implementations into must-have features. Nobody’s gonna care in twenty years.

    Entire hardware form-factors have come and gone in a single decade. Can you imagine if swipe keyboards were still single-vendor, and still worked like in 2009? Or maybe Apple bought them, and endlessly bragged about how Android can’t do [blank], because fifty thousand dollars changed hands in the 3G era.

    How many games would not exist, if Nintendo had decided they own sidescrollers? A whole genre, wiped out, because a piece of paper says those mechanics are theft.



  • Neural networks will inevitably be a big deal for a wide variety of industries.

    LLMs are the wrong approach to basically all of them.

    There’s five decades of what-ifs, waiting to be defictionalized, now that we can actually do neural networks. Training them became practical, and ‘just train more’ was proven effective. Immense scale is useful but not necessary.

    But all hype has been forced into spicy autocomplete and a denoiser, and only the denoiser is doing the witchcraft people want.