Even worse than that: It’s just tokens. They don’t even know what language they’re using or even that they’re putting words together. It’s just, “this arbitrary thing is mathematically based on a limited model most likely to proceed that arbitrary thing”.