• 0 Posts
  • 175 Comments
Joined 3 years ago
cake
Cake day: June 20th, 2023

help-circle

  • So I can actually think of a few reasons: Preprocessing vast amounts of super high resolution satellite imagery to save bandwidth, and jurisdictional black site processing data some countries would want to steal or arrest you for having or processing, particularly if you were hiding it from internal audit. You would be paying an extreme premium over ground based for ever FLOP, so, the customer base of practical customers is limited to a handful of very well funded intelligence agencies or scientific projects in very niche use cases.






  • Partly, the Chinese are distilling closed source models, and OpenAI and Anthropic’s attempts to stop this have only succeeded in making their outputs less transparent. Partly, the actual frontier of AI is currently mostly vibes and marketing, as everyone’s cheated the tests so badly that the only way to stay in the running is to cheat. Partly, that weve passed the point where even an honest evaluator could say which general purpose model is better than another, since their performance fluxuates wildly from task to task.










  • I was part of a project that tried. If you just want to get rid of dialog trees local processing might be an option, but for an actual reactive world your looking at possibly hundreds of dollars a month in rented compute. The deeper problem is the current generation of LLMs are just too unstable over time, and frankly, too dumb to maintain its persona and keep up with a dynamic fictional world. Each hallucination amplifies the disconnect from the fictional reality, and trying to reset it changes the presentation of the persona. And if the humans are actively trying to mess with the AIs or if the AIs are supposed to consider something without blurring it out, its all going to crash and burn.

    Of course, its a little concerning that these agents are too unreliable to be a character is a fictional video game, but apparently reliable enough to be given access and authority in the real world.