• forrgott@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    4
    ·
    edit-2
    21 hours ago

    I wonder if they connect all the way back to Micro$oft’s neo Nazi chat bot from decades ago?

    • jacksilver@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      ·
      21 hours ago

      Not sure if you really want to know, but a Google paper is where transformers (backbone of LLMs) were first mentioned (2016 I believe). Google initially used transformers for translations and eventually search, but OpenAI experimented with them for text generation (gpt 1+) eventually leading to chatgpt.