Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • Jax@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    9
    ·
    edit-2
    3 hours ago

    Dirtying the car on the way there?

    The car you’re planning on cleaning at the car wash?

    Like, an AI not understanding the difference between walking and driving almost makes sense. This, though, seems like such a weird logical break that I feel like it shouldn’t be possible.

    • _g_be@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      3 hours ago

      You’re assuming AI “think” “logically”.

      Well, maybe you aren’t, but the AI companies sure hope we do

      • Jax@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        2 hours ago

        Absolutely not, I’m still just scratching my head at how something like this is allowed to happen.

        Has any human ever said that they’re worried about their car getting dirtied on the way to the carwash? Maybe I could see someone arguing against getting a carwash, citing it getting dirty on the way home — but on the way there?

        Like you would think it wouldn’t have the basis to even put those words together that way — should I see this as a hallucination?

        Granted, I would never ask an AI a question like this — it seems very far outside of potential use cases for it (for me).

        Edit: oh, I guess it could have been said by a person in a sarcastic sense