Developer and refugee from Reddit

  • 4 Posts
  • 369 Comments
Joined 2 years ago
cake
Cake day: July 2nd, 2023

help-circle
  • After working on a team that uses LLMs in agentic mode for almost a year, I’d say this is probably accurate.

    Most of the work at this point for a big chunk of the team is trying to figure out prompts that will make it do what they want, without producing any user-facing results at all. The rest of us will use it to generate small bits of code, such as one-off scripts to accomplish a specific task - the only area where it’s actually useful.

    The shine wears off quickly after the fourth or fifth time it “finishes” a feature by mocking data because so many publicly facing repos it trained on have mock data in them so it thinks that’s useful.







  • I’ve read Lord of the Rings a few times. And The Hobbit. And his lesser-known works (e.g., Leaf by Niggle, which is just great). And The Silmarillion. And The Adventures of Tom Bombadil (which, honestly, isn’t his best). And I know what an Istari is (and why Gandalf, being a lesser Ainur, is actually so much more than a mere “wizard”). And I know that while they changed the line from “you cannot pass” to “you shall not pass” for dramatic purposes in the movie, the original line subtly says a whole hell of a lot more about who and what Gandalf is and why the Balrog should have actually been shitting itself.

    So you might say I’m passingly familiar with it.


  • Oh, you need Fate Accelerated. Six stats, five descriptive phrases that define your character (one of which is your character’s “trouble,” giving the GM automatic story hooks) and a smattering of stunts your character can perform, and off you go!

    Regarding Traveller, I’ve never had the stomach for it. Me and a group once sat down to create characters, and discovered it was so rules-heavy that by the end of two sessions dedicated to character creation, we still didn’t know for sure that we’d done any of the characters correctly.



  • Ha! My glob, she was so amazing. I had the opportunity to attend a reading she did from The Lathe of Heaven years ago, and I was struck anew not only by her creativity, but by the philosophical ideas underpinning it. A lot of people think The Ones Who Walk Away from Omelas is her most philosophical work, but I actually found what Lathe had to say about control, obedience, and power incredibly compelling.


  • Oh, goddamn it, this is gonna take a while.

    • Code. Like, I actually get real pleasure from seeing elegant and well-structured code. I have no idea why, but I’ll almost start salivating at particularly beautiful code.
    • Anime. Yeah, I’m a walking stereotype, a software developer who likes anime. But have you seen Frieren? It’s so goddamn good.
    • Philosophy. No, not bullshit continental philosophy. I’m talking real philosophy. Analytic philosophy. Distilled and legitimately useful logic. Which of course leads me to…
    • Science. My YouTube feed is full of fascinating deep-dives into esoteric mathematical and scientific topics. Fuck yeah.
    • Tabletop RPGs. Surprisingly, not a huge D&D fan, though it can certainly be fun. These days, I’m much more into story-focused systems, like Fate or Blades in the Dark. Most people I mention that to have never heard of either.
    • Science fiction and fantasy. I mean, are you surprised at this point?
    • Writing science fiction and fantasy. I mean, are you surprised at this point?
    • Politics. Less so nowadays, since our political system is falling apart and we’re being overrun by fascism, but I still do enjoy a meaty policy discussion.

    That’s a good list for starters.










  • So there are a few very specific tasks that LLMs are good at from the perspective of a software developer:

    1. Certain kinds of analysis tasks can be done very quickly and efficiently with Copilot in agent mode. For instance, having it assess your existing code for adherence to stylistic standards where a violation isn’t going to trigger a linting error.
    2. Quick script writing is something it excels at. There are all kinds of circumstances where you might need an independent script, such as a database seed file. It’s not part of the application itself, but it’s a useful utility to have, and Copilot is good at writing them.
    3. Scaffolding a new application. If you’re creating something brand new and know which tools you want to use for it, but don’t want to go through the hassle of setting everything up yourself, having Copilot do it can be a real time saver.

    And that’s… pretty much it. I’ve experimented with building applications with “prompt engineering,” and to be blunt, I think the concept is fundamentally flawed. The problem is that once the application exceeds the LLM’s context window size, which is necessarily small, you’re going to see it make a lot more mistakes than it already does, because - just as an example - by the time you’re having it write the frontend for a new API endpoint, it’s already forgotten how that endpoint works.

    As the application approaches production size in features and functions, the number of lines of code becomes an insurmountable bottleneck for Copilot. It simply can’t maintain a comprehensive understanding of what’s already there.