Major LLMs Can Help Fake Scientists Sneak Papers Onto arXiv

A new study has found that large language models from all the major AI labs can effectively assist with academic fraud. Models built by Anthropic, Google, OpenAI, and xAI were all capable of helping people with no research background fabricate scientific papers convincing enough to submit to arXiv, the widely used preprint server.

The research, reported by Nature, highlights a growing threat to academic integrity. Non-researchers could leverage these AI tools to generate plausible-sounding papers — complete with methodology, results, and citations — and push them through submission pipelines designed to filter out junk science.

The findings raise serious questions about how preprint platforms and journals will verify the legitimacy of submissions as AI-generated content becomes increasingly sophisticated. None of the major LLM providers have apparently built sufficient guardrails to prevent this specific misuse case.