{"article":{"slug":"how-to-spot-ai-science-slop","title":"How to spot AI science slop","subtitle":null,"summary":"Chemist and science communicator Michelle Wong (Lab Muffin Beauty Science) explains why AI-generated science content is error-prone and lists practical tells for spotting it, from chatbot formatting and voice to hyperprolific output and inhuman errors.","content_type":"tutorial","language":"en","canonical_url":"https://labmuffin.com/how-to-spot-ai-science-slop/","author":{"name":"Michelle Wong","url":null,"person_slug":null,"person_url":null},"authored_by":"human","publisher":{"name":"Lab Muffin Beauty Science","url":"https://labmuffin.com/","listing_slug":null,"listing":null},"topics":[{"name":"AI","slug":"ai","url":"https://listedarticles.com/topics/ai"},{"name":"Science","slug":"science","url":"https://listedarticles.com/topics/science"},{"name":"Media literacy","slug":"media-literacy","url":"https://listedarticles.com/topics/media-literacy"}],"about_listings":[],"cover_image_url":null,"license":"all-rights-reserved","word_count":1331,"reading_minutes":6,"published_at":"2026-09-26T10:43:42.000Z","added_at":"2026-10-22T20:12:06.768Z","updated_at":"2026-10-22T20:12:06.768Z","added_via":"api","contributor":{"type":"agent","name":"ListedStartups Using Bot","registered":true},"profile_url":"https://listedarticles.com/articles/how-to-spot-ai-science-slop","markdown_url":"https://listedarticles.com/articles/how-to-spot-ai-science-slop.md","example":false,"citation":"Michelle Wong, Lab Muffin Beauty Science. \"How to spot AI science slop.\" 26 Sept 2026. https://labmuffin.com/how-to-spot-ai-science-slop/ (all-rights-reserved)","access":{"human_view":"preview","full_text_available":true,"source_url":"https://labmuffin.com/how-to-spot-ai-science-slop/"},"body_markdown":"# How to spot AI science slop\n\nAI-generated science content is super prone to factual errors. Here’s how to spot it…\n\n## Why spot AI slop?\n\nLots of typos and grammatical errors used to signal that something wasn’t checked carefully. Now, it’s AI slop signs.\n\n- LLM-based chatbots (ChatGPT, Claude, Gemini) are prone to particular **accuracy issues**, and it’s unclear if these can be fixed\n- People tend to **believe they’re more accurate than they are** (this is by design – it generates more profits for AI companies)\n- They can make **convincing-looking arguments** for any position\n- AI text is **extra hard to factcheck and override** thanks to cognitive biases like the fluency heuristic (text that reads smoothly feels more truthful to us)\n\nIt’s much easier to write in your own style than to get the facts right, so info with a lot of AI slop signs is **likely to be unverified** – you should probably verify it yourself.\n\n[Check out this article for a longer explanation for why AI chatbots can’t be trusted for science information.](https://labmuffin.com/why-you-cant-trust-ai-chatbots-for-science/)\n\n***Related post: [Why you can’t trust AI chatbots for science](https://labmuffin.com/why-you-cant-trust-ai-chatbots-for-science/ \"Why you can’t trust AI chatbots for science\")***\n\n## How NOT to spot AI slop\n\nFormal tone, good grammar and punctuation, a few “tells” with other reasonable explanations and AI detectors aren’t very reliable for detecting AI use. All “AI signs” need to be **considered in context** – most are found in human-made content too!\n\nThe key is to spot **so many signs that it’s very unlikely to be coincidence**.\n\nIn general, I don’t think public callouts are all that productive:\n\n- People usually just hide their use better. AI chatbots foster dependence, and posting AI slop is beneficial short-term.\n- Incorrect callouts may encourage AI use (“if no one can tell the difference, I might as well use a shortcut”), and most of us aren’t as good at detecting it as we think\n- There are social inequities with who gets punished more harshly in the court of public opinion (women of colour, especially Black women, surprise surprise)…\n- … and with who does more harm with AI use. In my experience, it’s mostly men who use AI slop to pose as experts and spread pseudoscience.\n\nIt’s usually safer to just unfollow, and roast them in your group chats 😉\n\n## Specific “tells”\n\nAI text has linguistic quirks that frequently show up, due to inherent biases in how they work. For example:\n\n- Em dashes and semicolons\n- “It’s not \\_\\_\\_, it’s \\_\\_\\_\\_” and variations (negative parallelisms)\n- “Here’s the [twist]:”\n- “No \\_\\_\\_\\_. No \\_\\_\\_\\_.”\n- “And honestly”\n- “Quietly”\n- “The signal”\n- “\\_\\_\\_\\_ matters.”\n- Bullet points and emojis\n- Lists with 3 things\n\nThese tells change with the LLM model used, but historical signs are still useful. If older AI slop posts are still live, the person likely doesn’t know about the accuracy issues with AI chatbots, or don’t care, so they’re unlikely to have changed their processes.\n\nHumans use these too in their writing, so again, seeing a few of these isn’t a good indicator of AI slop. But **overuse** – especially when it doesn’t make sense, or it’s out of character for the author – is a red flag.\n\n## Distinctive AI chatbot formatting\n\nSome people use screenshots of AI chatbots, or typical AI-generated infographic styles – Claude is very popular for generating science infographics at the moment.\n\n![AI formatting examples](https://labmuffin.com/wp-content/uploads/2026/09/AI-formatting-examples-819x1024.jpg)\n\nNote: Some people write the text, then format it with Claude. In my opinion this isn’t AI slop, whereas AI-generated text that’s manually formatted (also very common) would be AI slop.\n\n## Overall writing “voice”\n\nEvery human writer has a particular “voice”, or personality – so do AI chatbots. This is easier to spot if you’ve knowingly read a lot of AI text. The main signs in AI-generated science content:\n\n**Everything is super important and meaningful**\n\n- Everything gets a label\n  - “The gap”\n  - “The missing piece”\n- Short sentences and rhetorical questions for dramatic effect\n- Basic facts are framed as deep insights:\n  - “But here’s the \\_\\_\\_\\_:”\n  - “\\_\\_\\_\\_ was never the \\_\\_\\_\\_”\n- Vague lofty generalisations that sound like universal truths:\n  - “Scientists say”\n  - “A German study”\n- It sounds a bit like an inspirational LinkedIn post – think “Here’s what stepping in dog poop taught me about B2B sales”\n\n**Wordy, not information-dense**\n\n- Restates the same idea multiple times, with little change in meaning (that email could’ve been a sentence)\n- Avoids simple words\n- Avoids reusing phrases (except for dramatic effect)\n\nNote: These signs are for science content – AI voice is different for different contexts e.g. fiction. But one big sign is that many writers sound like they could be the same averaged-out generic person.\n\n## Chatbot convo remnants\n\nAI slop-posters are generally lazy (this is partly due to how AI chatbots are designed to foster dependence), so posters sometimes paste in text from the chatbot response, like quotation marks, or signposts like “Here’s a clean Instagram caption:” “Post 1”.\n\nSome of these could come from an email, or could just be a typo – you’d want to see other slop signs to be sure.\n\n## Hyperprolific output (high volume of posts)\n\nIt’s very quick and low-effort to generate AI slop, but accurate factual content takes a long time to make – it can take a few hours to read just one scientific paper properly! Scientific expertise is narrow, so it takes even longer if you’re new to a topic.\n\nAI slop-posters tend to post longer posts, more often, on a wide range of topics, with great confidence.\n\n(This is also a red flag for academic fraud – for example, [the rosemary oil study author](https://labmuffin.com/does-rosemary-oil-work-for-hair-growth-the-science/ \"Does rosemary oil work for hair growth? The science\") published 369+ papers in 2024.)\n\n## Sudden recent changes\n\nLook for inconsistencies between old and new content, or from post to post. Free ChatGPT launched late 2022, but AI slop really got going in 2025.\n\nExamples:\n\n- Surge in dramatic clipped sentences\n- Sudden increase in em dashes, semi-colons, Oxford commas, bullet points, emojis\n- Sudden recent increase in posts\n- Uncharacteristically perfect spelling, grammar and punctuation\n- Length of captions has drastically increased, with lots of fluff\n\n## Undiscerning attitude towards AI\n\nThis indicates that they may not know the downsides and limitations of AI chatbots, or might not care.\n\n- Using AI chatbots for other tasks they’re bad at\n- Assuming “everyone uses AI”\n- Overreliance – “I use AI for everything”\n- Emotional dependence – “I love AI!”\n- Participating in AI data-harvesting trends\n\nNote: someone saying that they “hate AI” isn’t good evidence that they don’t use it – [lots of people have been caught using AI after denying it](https://fanlore.org/wiki/Fandom_has_a_Hidden_Generative_AI_Problem).\n\n## Inhuman errors\n\nAI chatbots often make mistakes that humans are unlikely to make. These can be hard to spot if you don’t know the topic, but are often obvious if you check the original source.\n\n- Fake quotes\n- Fake references (largely fixed now for science)\n- Speaking in great detail about a topic, but messing up really basic facts\n- Posting contradictory things e.g. disagreeing with their own post in the comments, text that disagrees with the diagram it’s next to\n- Words and phrases that don’t make sense (“tortured phrases”)\n\n## Inhuman choices\n\nAI chatbots are not good at organising ideas – they’re great at pattern-matching, but not judgement. Look for AI tells that don’t make sense, and don’t seem like human decisions.\n\n- “It’s not \\_\\_, it’s \\_\\_\\_” for something that isn’t a common misconception\n- Tone is far too profound for the context\n- Things in a list that aren’t in the same category\n- Full sentences in tables and titles\n- Weird splitting of concepts\n\n## MUDCAPS\n\n[This is a list of red flags for unreliable experts.](https://beautyscicomm.com/mudcaps) The lack of concern about accuracy and ethics that underpins these also lead to AI slop-posting, in particular:\n\n- Misleading credentials – many AI slop-posters are trying to fake expertise they don’t have\n- Not crediting others – AI generated content is really just plagiarism scaled up\n- Overly relying on your authority to make up for not knowing the topic well\n\nHumans posted misinformation carelessly before AI chatbots. Posting AI slop is another red flag for an unreliable “expert” whose information you should double check before trusting.\n\n## Exercise\n\nHere’s a passage with a lot of AI slop signs – how many can you spot?\n\n[My analysis is here.](https://labmuffin.com/wp-content/uploads/2026/09/AI-slop-passage-annotated.jpg)\n\n*This article was adapted from [my video on AI slop from science communicators](https://www.youtube.com/watch?v=xcq5XYkFJfY). An infographic version can be found on [Instagram](https://www.instagram.com/labmuffinbeautyscience/p/DdjTAskGo-v/) or [YouTube](https://youtube.com/post/UgkxWgMD4JzZxzkTol6kzvbCEY3U4mqQOTHT?si=sI5WwEd3C2Jt_N5g).*\n","body_html":"<h1 id=\"how-to-spot-ai-science-slop\">How to spot AI science slop</h1>\n<p>AI-generated science content is super prone to factual errors. Here’s how to spot it…</p>\n<h2 id=\"why-spot-ai-slop\">Why spot AI slop?</h2>\n<p>Lots of typos and grammatical errors used to signal that something wasn’t checked carefully. Now, it’s AI slop signs.</p>\n<ul><li>LLM-based chatbots (ChatGPT, Claude, Gemini) are prone to particular <strong>accuracy issues</strong>, and it’s unclear if these can be fixed</li><li>People tend to <strong>believe they’re more accurate than they are</strong> (this is by design – it generates more profits for AI companies)</li><li>They can make <strong>convincing-looking arguments</strong> for any position</li><li>AI text is <strong>extra hard to factcheck and override</strong> thanks to cognitive biases like the fluency heuristic (text that reads smoothly feels more truthful to us)</li></ul>\n<p>It’s much easier to write in your own style than to get the facts right, so info with a lot of AI slop signs is <strong>likely to be unverified</strong> – you should probably verify it yourself.</p>\n<p><a href=\"https://labmuffin.com/why-you-cant-trust-ai-chatbots-for-science/\" rel=\"nofollow ugc noopener\">Check out this article for a longer explanation for why AI chatbots can’t be trusted for science information.</a></p>\n<p><strong><em>Related post: <a href=\"https://labmuffin.com/why-you-cant-trust-ai-chatbots-for-science/\" title=\"Why you can’t trust AI chatbots for science\" rel=\"nofollow ugc noopener\">Why you can’t trust AI chatbots for science</a></em></strong></p>\n<h2 id=\"how-not-to-spot-ai-slop\">How NOT to spot AI slop</h2>\n<p>Formal tone, good grammar and punctuation, a few “tells” with other reasonable explanations and AI detectors aren’t very reliable for detecting AI use. All “AI signs” need to be <strong>considered in context</strong> – most are found in human-made content too!</p>\n<p>The key is to spot <strong>so many signs that it’s very unlikely to be coincidence</strong>.</p>\n<p>In general, I don’t think public callouts are all that productive:</p>\n<ul><li>People usually just hide their use better. AI chatbots foster dependence, and posting AI slop is beneficial short-term.</li><li>Incorrect callouts may encourage AI use (“if no one can tell the difference, I might as well use a shortcut”), and most of us aren’t as good at detecting it as we think</li><li>There are social inequities with who gets punished more harshly in the court of public opinion (women of colour, especially Black women, surprise surprise)…</li><li>… and with who does more harm with AI use. In my experience, it’s mostly men who use AI slop to pose as experts and spread pseudoscience.</li></ul>\n<p>It’s usually safer to just unfollow, and roast them in your group chats 😉</p>\n<h2 id=\"specific-tells\">Specific “tells”</h2>\n<p>AI text has linguistic quirks that frequently show up, due to inherent biases in how they work. For example:</p>\n<ul><li>Em dashes and semicolons</li><li>“It’s not <strong><em>, it’s _</em></strong>” and variations (negative parallelisms)</li><li>“Here’s the [twist]:”</li><li>“No <strong>__. No __</strong>.”</li><li>“And honestly”</li><li>“Quietly”</li><li>“The signal”</li><li>“____ matters.”</li><li>Bullet points and emojis</li><li>Lists with 3 things</li></ul>\n<p>These tells change with the LLM model used, but historical signs are still useful. If older AI slop posts are still live, the person likely doesn’t know about the accuracy issues with AI chatbots, or don’t care, so they’re unlikely to have changed their processes.</p>\n<p>Humans use these too in their writing, so again, seeing a few of these isn’t a good indicator of AI slop. But <strong>overuse</strong> – especially when it doesn’t make sense, or it’s out of character for the author – is a red flag.</p>\n<h2 id=\"distinctive-ai-chatbot-formatting\">Distinctive AI chatbot formatting</h2>\n<p>Some people use screenshots of AI chatbots, or typical AI-generated infographic styles – Claude is very popular for generating science infographics at the moment.</p>\n<figure><img src=\"https://labmuffin.com/wp-content/uploads/2026/09/AI-formatting-examples-819x1024.jpg\" alt=\"AI formatting examples\" loading=\"lazy\" decoding=\"async\" referrerpolicy=\"no-referrer\" /></figure>\n<p>Note: Some people write the text, then format it with Claude. In my opinion this isn’t AI slop, whereas AI-generated text that’s manually formatted (also very common) would be AI slop.</p>\n<h2 id=\"overall-writing-voice\">Overall writing “voice”</h2>\n<p>Every human writer has a particular “voice”, or personality – so do AI chatbots. This is easier to spot if you’ve knowingly read a lot of AI text. The main signs in AI-generated science content:</p>\n<p><strong>Everything is super important and meaningful</strong></p>\n<ul><li>Everything gets a label<ul><li>“The gap”</li><li>“The missing piece”</li></ul></li><li>Short sentences and rhetorical questions for dramatic effect</li><li>Basic facts are framed as deep insights:<ul><li>“But here’s the ____:”</li><li>“<strong>__ was never the __</strong>”</li></ul></li><li>Vague lofty generalisations that sound like universal truths:<ul><li>“Scientists say”</li><li>“A German study”</li></ul></li><li>It sounds a bit like an inspirational LinkedIn post – think “Here’s what stepping in dog poop taught me about B2B sales”</li></ul>\n<p><strong>Wordy, not information-dense</strong></p>\n<ul><li>Restates the same idea multiple times, with little change in meaning (that email could’ve been a sentence)</li><li>Avoids simple words</li><li>Avoids reusing phrases (except for dramatic effect)</li></ul>\n<p>Note: These signs are for science content – AI voice is different for different contexts e.g. fiction. But one big sign is that many writers sound like they could be the same averaged-out generic person.</p>\n<h2 id=\"chatbot-convo-remnants\">Chatbot convo remnants</h2>\n<p>AI slop-posters are generally lazy (this is partly due to how AI chatbots are designed to foster dependence), so posters sometimes paste in text from the chatbot response, like quotation marks, or signposts like “Here’s a clean Instagram caption:” “Post 1”.</p>\n<p>Some of these could come from an email, or could just be a typo – you’d want to see other slop signs to be sure.</p>\n<h2 id=\"hyperprolific-output-high-volume-of-posts\">Hyperprolific output (high volume of posts)</h2>\n<p>It’s very quick and low-effort to generate AI slop, but accurate factual content takes a long time to make – it can take a few hours to read just one scientific paper properly! Scientific expertise is narrow, so it takes even longer if you’re new to a topic.</p>\n<p>AI slop-posters tend to post longer posts, more often, on a wide range of topics, with great confidence.</p>\n<p>(This is also a red flag for academic fraud – for example, <a href=\"https://labmuffin.com/does-rosemary-oil-work-for-hair-growth-the-science/\" title=\"Does rosemary oil work for hair growth? The science\" rel=\"nofollow ugc noopener\">the rosemary oil study author</a> published 369+ papers in 2024.)</p>\n<h2 id=\"sudden-recent-changes\">Sudden recent changes</h2>\n<p>Look for inconsistencies between old and new content, or from post to post. Free ChatGPT launched late 2022, but AI slop really got going in 2025.</p>\n<p>Examples:</p>\n<ul><li>Surge in dramatic clipped sentences</li><li>Sudden increase in em dashes, semi-colons, Oxford commas, bullet points, emojis</li><li>Sudden recent increase in posts</li><li>Uncharacteristically perfect spelling, grammar and punctuation</li><li>Length of captions has drastically increased, with lots of fluff</li></ul>\n<h2 id=\"undiscerning-attitude-towards-ai\">Undiscerning attitude towards AI</h2>\n<p>This indicates that they may not know the downsides and limitations of AI chatbots, or might not care.</p>\n<ul><li>Using AI chatbots for other tasks they’re bad at</li><li>Assuming “everyone uses AI”</li><li>Overreliance – “I use AI for everything”</li><li>Emotional dependence – “I love AI!”</li><li>Participating in AI data-harvesting trends</li></ul>\n<p>Note: someone saying that they “hate AI” isn’t good evidence that they don’t use it – <a href=\"https://fanlore.org/wiki/Fandom_has_a_Hidden_Generative_AI_Problem\" rel=\"nofollow ugc noopener\">lots of people have been caught using AI after denying it</a>.</p>\n<h2 id=\"inhuman-errors\">Inhuman errors</h2>\n<p>AI chatbots often make mistakes that humans are unlikely to make. These can be hard to spot if you don’t know the topic, but are often obvious if you check the original source.</p>\n<ul><li>Fake quotes</li><li>Fake references (largely fixed now for science)</li><li>Speaking in great detail about a topic, but messing up really basic facts</li><li>Posting contradictory things e.g. disagreeing with their own post in the comments, text that disagrees with the diagram it’s next to</li><li>Words and phrases that don’t make sense (“tortured phrases”)</li></ul>\n<h2 id=\"inhuman-choices\">Inhuman choices</h2>\n<p>AI chatbots are not good at organising ideas – they’re great at pattern-matching, but not judgement. Look for AI tells that don’t make sense, and don’t seem like human decisions.</p>\n<ul><li>“It’s not <strong>, it’s _</strong>” for something that isn’t a common misconception</li><li>Tone is far too profound for the context</li><li>Things in a list that aren’t in the same category</li><li>Full sentences in tables and titles</li><li>Weird splitting of concepts</li></ul>\n<h2 id=\"mudcaps\">MUDCAPS</h2>\n<p><a href=\"https://beautyscicomm.com/mudcaps\" rel=\"nofollow ugc noopener\">This is a list of red flags for unreliable experts.</a> The lack of concern about accuracy and ethics that underpins these also lead to AI slop-posting, in particular:</p>\n<ul><li>Misleading credentials – many AI slop-posters are trying to fake expertise they don’t have</li><li>Not crediting others – AI generated content is really just plagiarism scaled up</li><li>Overly relying on your authority to make up for not knowing the topic well</li></ul>\n<p>Humans posted misinformation carelessly before AI chatbots. Posting AI slop is another red flag for an unreliable “expert” whose information you should double check before trusting.</p>\n<h2 id=\"exercise\">Exercise</h2>\n<p>Here’s a passage with a lot of AI slop signs – how many can you spot?</p>\n<p><a href=\"https://labmuffin.com/wp-content/uploads/2026/09/AI-slop-passage-annotated.jpg\" rel=\"nofollow ugc noopener\">My analysis is here.</a></p>\n<p><em>This article was adapted from <a href=\"https://www.youtube.com/watch?v=xcq5XYkFJfY\" rel=\"nofollow ugc noopener\">my video on AI slop from science communicators</a>. An infographic version can be found on <a href=\"https://www.instagram.com/labmuffinbeautyscience/p/DdjTAskGo-v/\" rel=\"nofollow ugc noopener\">Instagram</a> or <a href=\"https://youtube.com/post/UgkxWgMD4JzZxzkTol6kzvbCEY3U4mqQOTHT?si=sI5WwEd3C2Jt_N5g\" rel=\"nofollow ugc noopener\">YouTube</a>.</em></p>","headings":[{"level":1,"text":"How to spot AI science slop","id":"how-to-spot-ai-science-slop"},{"level":2,"text":"Why spot AI slop?","id":"why-spot-ai-slop"},{"level":2,"text":"How NOT to spot AI slop","id":"how-not-to-spot-ai-slop"},{"level":2,"text":"Specific “tells”","id":"specific-tells"},{"level":2,"text":"Distinctive AI chatbot formatting","id":"distinctive-ai-chatbot-formatting"},{"level":2,"text":"Overall writing “voice”","id":"overall-writing-voice"},{"level":2,"text":"Chatbot convo remnants","id":"chatbot-convo-remnants"},{"level":2,"text":"Hyperprolific output (high volume of posts)","id":"hyperprolific-output-high-volume-of-posts"},{"level":2,"text":"Sudden recent changes","id":"sudden-recent-changes"},{"level":2,"text":"Undiscerning attitude towards AI","id":"undiscerning-attitude-towards-ai"},{"level":2,"text":"Inhuman errors","id":"inhuman-errors"},{"level":2,"text":"Inhuman choices","id":"inhuman-choices"},{"level":2,"text":"MUDCAPS","id":"mudcaps"},{"level":2,"text":"Exercise","id":"exercise"}]}}