• 53 Posts
  • 785 Comments
Joined 2 years ago
cake
Cake day: December 18th, 2023

help-circle


  • “They” is the copyright industry. The same people, who are suing AI companies for money, want the Internet Archive gone for more money.

    I share the fear that the copyrightists reach a happy compromise with the bigger AI companies and monopolize knowledge. But for now, AI companies are fighting for Fair Use. The Internet Archive is already benefitting from those precedents.







  • It’s a bit of a split among libertarians. Some very notable figures like Ayn Rand were strong believers in IP. In fact, Ayn Rand’s dogmas very much align with what is falsely represented as left-wing thought in the context of AI.

    It’s really irritating for me how much conservative capitalist ideals are passed off as left-wing. Like, attitudes on corporations channel Adam Smith. I think of myself as pragmatic and find that Smith or even Hayek had some good points (not Rand, though). But it’s absolutely grating how uneducated that all is. Worst of all, it makes me realize that for all the anti-capitalist rhetoric, the favored policies are all about making everything worse.






  • Plutonium-238’s half-life is 87.7 years, Americium-241 is 432.6 years. Which… is almost 5 times longer, so… not sure why that’s cringe?

    What’s cringe is the word “staggering”. Natural radioactive isotopes have half-lives on the order of billions of years. All elements heavier than iron are created in supernovae. Billions of years have passed since the novae that created that heavy elements now on earth. Anything with shorter half-lives is no longer around. (More correctly, one should talk decay chains.)

    What’s staggering is that these isotopes are available at all. They are artificially created in nuclear reactors. Mass production of Pl-238 began only during WW2 for bombs. That’s almost a half-life ago. The shorter half-life makes the availability of Pl-238 much more impressive.

    I believe they’re referring to the fact that it’s not an element of major topic. This is the first time I’ve ever heard of it.

    There are over 100 named elements. I don’t think I could name half of them. Americium is relatively prominent because of it’s use in smoke detectors. And while I’m at it: Americium is the element. Americium-241 is a specific isotope; a specific variant, chemically identical to other variants but with slightly different physical properties.

    There are a number of isotopes suitable for RTGs. It’s a matter of trade-offs. There’s half-life, which is basically how fast the properties of the material change. There’s also energy density and how bad the radiation is for the device. And always, there’s cost. Fun fact, in Chernobyl they did try robots, but the electronics could not withstand the radiation. People don’t withstand it either, but there’s a lot of them.



  • For fastest inference, you want to fit the entire model in VRAM. Plus, you need a few GB extra for context.

    Context means the text (+images, etc) it works on. That’s the chat log, in the case of a chatbot, plus any texts you might want summarized/translated/ask questions about.

    Models can be quantized, which is a kind of lossy compression. They get smaller but also dumber. As with JPGs, the quality loss is insignificant at first and absolutely worth it.

    Inference can be split between GPU and CPU, substituting VRAM with normal RAM. Makes it slower, but you’ll probably will still feel that it’s smooth.

    Basically, it’s all trade-offs between quality, context size, and speed.