Opper
opper.ai
The developer platform for reliable agents

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • CileTheSane@lemmy.caEnglish
    2·
    2 hours ago

    You said this puzzle “wasn’t tricky in the slightest” and yet that “it requires understanding what is being asked.”

    Correct. Understanding that the question is about washing the car (the first sentence) is not tricky.

    So only 71.5% of humans can accomplish this “not tricky in the slightest” problem

    30% of people are fucking idiots. This keeps being proven. My argument is in no way changed by this fact.

    Is “understanding” things not “tricky”?

    No. Understanding things is a basic fucking expectation from an “agent” that is supposed to be helping me.