• webadict@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    1
    ·
    edit-2
    1 day ago

    Just as a brain is not a giant statistics problem, LLMs are not intelligent. LLMs are basically large math problems that take what you put into them and calculate the remainder. That isn’t an emergent behavior. That isn’t intelligence at all.

    If I type into a calculator 20*10 and it gives me 200, is that a sign of intelligence that the calculator can do math? I never programmed it to know what 10 or 20 or 200 were, though I did make it know what multiplication is and what digits and numbers are, but those particular things it totally created on its own after that!!!

    When you type a sentence into an LLM and it returns with an approximation of what a response sounds like, you should treat it the same way. People programmed these things to do the things that they are doing, so what behavior is fucking emergent?

    • deltaspawn0040@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      3 hours ago

      I’m sorry but what evidence do you have that the human brain cannot possibly be modeled mathematically like literally almost anything else?

      • webadict@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 hours ago

        That is not as smart of a question as you want it to be. Unfortunately for you, not everything can be modeled mathematically, or if you wish to be extremely minute, not everything can be currently mathematically modeled efficiently and precisely because it would require knowledge or resources far eclipsing what we have available. If you just want to push up your glasses and ACKSHUALLY me, then it’s also possible to do anything, hurr hurr.

        To even fucking PRETEND that we can model a brain right now is hilarious to me, but to equate that to LLMs is downright moronic. Human brains are not created, trained, or used in any way similar to LLMs, no matter what anyone says, but you are insinuating that they are somehow similar??? They are a simulation of a learning algorithm, trained through brute force tactics, and used for pattern completion. That’s just not how that works!

        And yet, in spite of the petabytes of data they fucking jam into these pieces of shit, they still can’t even draw hands correctly. They still can’t figure out the seahorse emoji. They still don’t know why strawberry has two Rs! They continuously repeat only the things they hear, and need to have these errors fixed manually. They don’t know anything. And that’s why they aren’t intelligent. They are fed data points. They create estimations. But they do not understand what the connections between those points are. And no amount of pointing at humans will fix that.

      • partofthevoice@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 hours ago

        Information Integration Theory would suggest that phi (Φ) can be used to measure the degree to which a system generates irreducible, integrated cause–effect structure. The irreducible nature of something is exactly as you postulate: it cannot possibly be modeled mathematically. If it could, that would make it reducible to smaller parts.

        You can describe the function of the human brain mathematically, of course… For example, some low hanging fruit might be:

        • Define the system’s transition probabilities.
        • Define its cause–effect repertoires.
        • Define Φ mathematically.

        But that’s not going to model human experience. The experience isn’t reducible. That, instead, models something closer to the quality of experience. Human rationality is derived downstream of human experience. So it’s just not a fair argument to say that a tool mimicking only the downstream patterns of human experience will somehow also possess the upstream experience capacity, or even a relatable sense of rationality at all.

        I don’t think we’re going to get a deterministic explanation for human behavior, ever. Most likely just statistical truths. Unless you can somehow mathematically model the entire universe as well. Good luck, because now the endeavor sounds god-like.

        • deltaspawn0040@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 hours ago

          What you’re saying sounds extremely interesting. Do you have any recommendations on resources that could help me delve deeper into this topic?

          • partofthevoice@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 hours ago

            Im no academic, so apologies for the lack of substance. I mostly just get stuck in rabbit holes reading about philosophy and consciousness while I should be working.

            Check out these theories for some interesting ideas:

            • Information Integration Theory
            • Global Workspace Theory
            • Recurrent Processing Theory
            • Higher Order Thought Theory

            My summarized take is that modeling consciousness is akin to modeling the three-body problem or the double-pendulum. Even if the system is deterministic and capable of being modeled, you’ll forever be bottlenecked by finite precision in your model. The system itself is one where errors grow exponentially. For example, tiny differences in the double pendulum’s initial angle (like 0.000001°) rapidly amplify over time to produce wildly different trajectories. It is computationally intractable without unlimited precision — hence, this is why I said you’d need to model the entire universe. This is deterministic chaos, and we have no reason to think human-brains aren’t heavily dependent on its utility.