Skip to content

detect llm PR not read by submitter - #7922

Open
jangorecki wants to merge 2 commits into
masterfrom
agents
Open

jangorecki wants to merge 2 commits into
masterfrom
agents

Conversation

@jangorecki

@jangorecki jangorecki commented Oct 15, 2026 •

Copy link
Copy Markdown
Member

Comment thread AGENTS.md Outdated
@MichaelChirico

Copy link
Copy Markdown
Member

Agree w the spirit of this but it seems like overkill. I don't think we've seen the same flood of "spammish" low-effort contributions as faced by projects like ghostty, zig, etc.

The AGENTS.md we already have seems pretty good to me, I would prefer we try and iterate on the spirit we've already laid out than to drop in such a blanket ban. That is:

  • LLMs are OK for research, explanation, understanding
  • LLMs must not be used to author data.table_x.y.z.tar.gz code
  • LLMs writing GHA code is fine

What's new in your PR that's not well-covered by the current AGENTS.md, IINM, is a stance on authoring bug reports with LLM. Do we want to take such a stance? I only see 11 "external" issues filed in the last 4 months, regardless of quality; is it worth also blocking good use of LLM to write issues?

screenshot of search https://github.com/Rdatatable/data.table/issues?q=is%3Aissue+-author%3AMichaelChirico+-author%3Ajangorecki+-author%3Atdhock+-author%3ATysonStanley+-author%3Aarunsrinivasan

Co-authored-by: Toby Dylan Hocking <tdhock5@gmail.com>
@jangorecki

Copy link
Copy Markdown
Member Author

I don't think we've seen the same flood of "spammish" low-effort contributions

agree

still the point is to ensure that a human reads what is about to be submitted.

@tdhock

tdhock commented Oct 16, 2026

Copy link
Copy Markdown
Member

Is there a way to ensure the PR sumitter looks at the Files changed tab before converting the draft PR to a real one and asking for review?

@ben-schwen

Copy link
Copy Markdown
Member

Is there a way to ensure the PR sumitter looks at the Files changed tab before converting the draft PR to a real one and asking for review?

Don't think so and after all, ppl would probably just click the check marks away anyway

@tdhock

tdhock commented Oct 19, 2026

Copy link
Copy Markdown
Member

too bad, that is my number one issue these days (seems like rookie PR submitters don’t look at their own diffs for obvious issues)

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants