• 0 Posts
  • 306 Comments
Joined 1 year ago
cake
Cake day: November 20th, 2024

help-circle




  • Our company rolled out a new and innovative internal LLM. It’s intended to help with coding tasks and find internal documentation.

    (Which really is just a wrapper over copilot).

    When looking for documentation, it fails harder than pasting the same text into the sesrch bar.

    I don’t find LLMs helpful for coding since they’re wrong so often. But after encouragement I decided to try my hand at using it to help me debug a small 12 line bash script.

    Whenever I posted examples it would fail silently. I assumed it wasnt sanitizing inputs so I tried a few other methods of wrapping the text. It would still faik silently.

    Eventually, a half hour later I decided to just Google it. After I resolved my own problem it messaged me, 45+ minutes later to say “an error occurred trying to handle your request”.

    These things suck so bad they can’t even error out effectively.