“A widely shared AI productivity paper was retracted, is possibly fraudulent” by titotal

EA Forum Podcast (All audio) - A podcast by EA Forum Team

Confidence notes: I am a physicist working on computational material science, so I have some familiarity with the field, but don't know much about R&D firms or economics. Some of the links in this article were gathered from a post at pivot-to-ai.com and the BS detector. The paper "Artificial Intelligence, Scientific Discovery, and Product Innovation" was published as an Arxiv preprint last December, roughly 5 months ago, and was submitted to a top economics journal. The paper claimed to show the effect of an experiment at a large R&D company. It claimed the productivity of a thousand material scientists was tracked before and after the introduction of an machine learning material generation tool. The headline results was that the AI caused a 44% increase in materials discovery at the firm, with a productivity increase of 81% for top-decile scientists. This research was breathlessly reported on in [...] The original text contained 1 footnote which was omitted from this narration. --- First published: May 19th, 2025 Source: https://forum.effectivealtruism.org/posts/YwaJxLEZkFtdzDCeD/a-widely-shared-ai-productivity-paper-was-retracted-is --- Narrated by TYPE III AUDIO.

Visit the podcast's native language site