Tried to figure out yesterday why a user couldn’t ssh into a server, tried LLMs to figure it out, completely useless. Had to go into some log file somewhere to find out the one who set up the server made a specific group for ssh and if a user wasn’t in that group they couldn’t connect. The LLMs (ChatGPT and Gemini) gave me bullshit about changing flags in the sshd config…
Cool story. LLMs can’t see error messages in logs if you don’t give them access to it. Had you given the AI agent access to those files? Or were you just using a standalone LLM with no access to the system?
Tried to figure out yesterday why a user couldn’t ssh into a server, tried LLMs to figure it out, completely useless. Had to go into some log file somewhere to find out the one who set up the server made a specific group for ssh and if a user wasn’t in that group they couldn’t connect. The LLMs (ChatGPT and Gemini) gave me bullshit about changing flags in the sshd config…
Easy fix: give an LLM root access to all production critical servers and allow everyone in the company to chat with it.
First reaction: fear.
Second: I chuckled. Because I thought of some VP-level enforcing this joke as SOP.
And then a little more fear, as a treat.
Haha if that happens it is time to get out fast
Cool story. LLMs can’t see error messages in logs if you don’t give them access to it. Had you given the AI agent access to those files? Or were you just using a standalone LLM with no access to the system?