• 1 Post
  • 2K Comments
Joined 3 years ago
cake
Cake day: June 15th, 2023

help-circle
  • LLMs are not capable of creating anything, including code. They are enormous word-matching search engines that try to find and piece together the closest existing examples of what is being requested. If what you’re looking for is reasonably common, that may be useful.

    Just for common understanding, you’re making blanket statements about LLMs as though those statements apply to all LLMs. You’re not wrong if you’re generally speaking of the LLM models deployed for retail consumption like, as an example, ChatGPT. None of what I’m saying here is a defense about how these giant companies are using LLMs today. I’m just posting from a Data Science point of view on the technology itself.

    However, if you’re talking about the LLM technology, as in a Data Science view, your statements may not apply. The common hyperparameters for LLMs are to choose the most likely matches for the next token (like the ChatGPT example), but there’s nothing about the technology that requires that. In fact, you can set a model to specifically exclude the top result, or even choose the least likely result. What comes out when you set these hyperparameters is truly strange and looks like absolute garbage, but it is unique. The result is something that likely hasn’t existed before. I’m not saying this is a useful exercise. Its the most extreme version to illustrate the point. There’s also the “temperature” hyperparamter which introduces straight up randomness. If you crank this up, the model will start making selections with very wide weights resulting in pretty wild (and potentially useless) results.

    What many Data Scientists trying to make LLMs generate something truly new and unique is to balance these settings so that new useful combinations come out without it being absolute useless garbage.





  • Forgive the machine translation to English, but reading that shows the a very similar exception to privacy protection we have here in the USA

    Here’s one example:

    "There are exceptions to events (demonstrations, general meetings, cultural events, etc.). Here, participants must expect to be photographed. This is about what is happening and not about the person itself. "

    Most of the wiki article is talking specifically about copyright, which isn’t the scope of what we’re talking about. Publication of taken images is a different topic.








  • Growing up, our household had a giant roll of butcher paper. It was 2 ft (60cm) wide and about 1000 feet (300m) long roll. I have no idea why we had it, but as kids we were allowed to use as much as we wanted for whatever we wanted. It turned into a childhood of projects, games, costumes, banners, signs, crafts, wrappings, pranks, etc. Close to the beginning as kids, we’d asked for art supplies like markers, paint, pens, pencils, charcoal, etc to transform that boring cheap paper into different universes. We became creative because it was available.

    Something about having an unlimited supply of something and infinite permissions was an unexpected freedom.


  • Nuclear was was always an apocalypse that might happen.

    I’m not sure if you know the history of how close we came to nuclear war in October 1962. It was the first time in history the USA ever went to Defcon 2. We had 25 nuclear bombers in the air with the rest of them on 15 minute standby.

    Hitler was bad, but he didn’t have anything like the arsenal and intelligence networks available to Trump. We have the consentration camps, and the death camps too, although those are outsourced in other countries.

    As bad as trump is, has he murdered 13 million innocent people yet? That’s Hitler’s number of murdered innocent people.

    We have been at worse points in history than we are right now.



  • Venus isn’t at all comparable to Earth… That’s a literal crazy comparison.

    Some people are only able to identify the differences using hyperbole. I specifcally called out Venus as an extreme example to highlight the difference in atmospheric conditions. I did not suggest the Earth would become Venus.

    but just because the atmosphere holds more water doesn’t mean it won’t also be releasing more water.

    I addressed this directly.

    More extreme water patterns doesn’t mean less drinking water.

    Except it does. Yes, the water will be released, but not in the same geographic places and the other conditions created by climate change will mean when it rains far less of that fresh water will be usable or capturable.


  • Its not an equally slow CPU. These boards support Xeon CPUs that first launched 11 years after DDR3.

    The implication is that there are users needing large RAM footprints that aren’t CPU bound. The hit in performance on the RAM isn’t significant enough to justify spending orders of magnitude more for modern DDR5 which is in short supply.

    In computing history there’s precedent for this. Amiga computers had a small amount of “Fast RAM” which was extremely expensive, but the CPU could address a second bank of “Chip RAM” which was significantly slower but much much cheaper.

    We could see this idea return in modern computers.