I've been seeing more and more open source maintainers throwing up their hands over AI generated pull requests. Going so far as to stop accepting PRs from external contributors.
This week we're going to begin automatically closing pull requests from external contributors. I hate this, sorry. pic.twitter.com/85GLG7i1fU
— tldraw (@tldraw) January 15,
Man, I understand that it’s trying to give tips, but this really comes off as condescending. “Just create these three pieces of complex, non-obvious documentation and ensure you have highly automated specification and code quality checks.”
I also have to say, if you expect maintainers to be experts in how to correctly prompt LLMs, and expect them to be hot for reviewing/rewriting generated code, then they might as well prompt the LLMs themselves.
Sure, there may be extra effort involved by outside contributors – may, because they do attract folks who have no interest in putting in any effort – but is that really worth the overhead of having to communicate with the LLM through a middleman?
Man, I understand that it’s trying to give tips, but this really comes off as condescending. “Just create these three pieces of complex, non-obvious documentation and ensure you have highly automated specification and code quality checks.”
I also have to say, if you expect maintainers to be experts in how to correctly prompt LLMs, and expect them to be hot for reviewing/rewriting generated code, then they might as well prompt the LLMs themselves.
Sure, there may be extra effort involved by outside contributors – may, because they do attract folks who have no interest in putting in any effort – but is that really worth the overhead of having to communicate with the LLM through a middleman?