That is absolutely correct, and the deeper problem is it typically “writes” in a tone that fools people into feeling like it can do so.
just outputs what it can find on the internet
That is what this one, the Google search overview, is set up to do. Other LLMs don’t, or may only do so when prompted to.
What they all do is analyze the patterns of all the words that have already been input, such as the initial system prompt, the user’s prompt, any sources it’s referencing and any replies it’s already generated, and then it uses that to predict what words ought to come next. It uses an enormous web of patterns pulled from all of its initial training data to make that guess. Patterns like a question is usually followed by an answer on the same topic, a sentence’s subject is usually followed by a predicate, writing tone usually doesn’t change, etc. All the rules of grammar it follows and all the facts it “knows” are just patterns of meaningless symbols to it. Essentially, no analysis, logic, or comprehension of any kind is part of its process.
That is absolutely correct, and the deeper problem is it typically “writes” in a tone that fools people into feeling like it can do so.
That is what this one, the Google search overview, is set up to do. Other LLMs don’t, or may only do so when prompted to.
What they all do is analyze the patterns of all the words that have already been input, such as the initial system prompt, the user’s prompt, any sources it’s referencing and any replies it’s already generated, and then it uses that to predict what words ought to come next. It uses an enormous web of patterns pulled from all of its initial training data to make that guess. Patterns like a question is usually followed by an answer on the same topic, a sentence’s subject is usually followed by a predicate, writing tone usually doesn’t change, etc. All the rules of grammar it follows and all the facts it “knows” are just patterns of meaningless symbols to it. Essentially, no analysis, logic, or comprehension of any kind is part of its process.