ChatGPT-written books with ChatGPT-written fake reviews are flooding Amazon

An AI-generated image of a robot writing in a book.
(Image credit: Bing Image Creator)

What you need to know:

  • AI generators such as ChatGPT and Midjourney are being used to produce books and fake reviews that are flooding Amazon’s storefront.
  • ChatGPT is listed as a co-author on hundreds of books, but many more books are ghost written by the software and undisclosed.
  • AI is trained on art and written datasets that may be taken without the original creator's consent, sparking concerns about plagiarism and copyright infringement. 

For many creatives becoming a published author can seem like a pipe dream. The internet has widely revolutionized how writers can get their works into the hands of eager readers, but even with advances in tech, the task of getting a novel published into a tangible book that people can purchase was no easy feat. That was until Amazon’s Kindle Direct Program gave authors a new path to self-publishing. Amazon’s KDP system allows anybody to publish a book with very little overhead. Anything from a coloring book to a lengthy fantasy tome can be published via Amazon KDP. This low barrier of entry has led to a unique problem for Amazon as AI-generated content has begun to effectively flood the market

Hundreds of books that list AI counterparts such as Bing Chat, ChatGPT, or MidJourney as co-authors or illustrators have found their way to Amazon’s marketplace. While listing AI as a co-creator is a possibility, there is currently no requirement in Amazon’s content policy that dictates AI must be listed when it has been used to generate a book. The content guidelines do state that Amazon will not accept content that is freely available on the web unless it is provided by the owner of the copyright, but there are no further details on how that may be enforced in a scenario where a book generated by AI content is listed.  

A blue robot summarizing a webpage using AI

(Image credit: Windows Central / Bing Image Creator)

AI generators such as ChatGPT and Midjourney rely very heavily on scraping existing datasets of art and written works to produce responses to prompts input by users. There has been no shortage of public discourse between creatives and AI users on whether or not the works generated are in fact plagiarized or otherwise violations of intellectual property and copyright laws. Despite their content guidelines strictly forbidding plagiarism, Amazon has seemingly taken the side in favor of AI-generated content by allowing sellers to hide whether or not their books are written by humans or AI.  

Individual sellers of AI-written and illustrated content are not the only ones to benefit from this lack of transparency, either, as a number of publishers have also embraced AI book sales on Amazon’s storefront.  Sales of these books are further bolstered by a flood of fake 5-star reviews that are similarly generated with the help of AI. 

Two robots facing each other one representing ChatGPT the other Bing Chat

(Image credit: Windows Central / Bing Image Creator)

Despite not having a transparent clause regarding AI-produced books in their content policy, Amazon has in the past removed AI-written content. Chris Cowell, a software developer who spoke to The Washington Post, detailed having written a how-to book on a niche technical topic only to discover a book on Amazon with the exact same title. That book had been generated entirely by AI and attributed to a seemingly fake author. The entire experience left Cowell hesitant to continue writing, not only out of fear of losing out on sales but because he was aware that any future writings could inevitably be used to further train AI to produce more low-quality content and competition. 

Amazon removed the copycat listing in Cowell’s situation, but an ever-growing minefield of AI-written books continues to clutter the service. There are concerns that, with time, the contents of these books will be filtered back through AI as training samples which will then be used to churn out more AI-written books with AI-written reviews that risk further skewing the algorithms. 

CATEGORIES
Cole Martin
Writer

Cole is the resident Call of Duty know-it-all and indie game enthusiast for Windows Central. She's a lifelong artist with two decades of experience in digital painting, and she will happily talk your ear off about budget pen displays. 

Read more
Andrej Karpathy, Director of AI Tesla, a keynote speaker at the Train AI conference in 2018
Ex-OpenAI founder claims 99.9% of web content will be AI-optimized — Was Bill Gates right about AI replacing humans?
The logos of OpenAI and DeepSeek artificial intelligence apps on mobile phones.
Is DeepSeek's AI a brand-new secondhand ChatGPT? A "unanimous jury" rules its AI-generated text matches OpenAI models by 74%
Text of LlaMA by Meta on a phone's display resting on a laptop's keyboard.
Meta allegedly used 'crude tactics' to close in on OpenAI’s 2-year lead building AI uncontested — Sam Altman admitted creating ChatGPT without copyrighted data is impossible
Activision has come under fire for the use of AI-generated images in Call of Duty: Black Ops 6.
AI-generated content in games is here to stay — what's worse is the outright deception employed by Call of Duty: Black Ops 6
In this photo illustration, Microsoft Copilot AI logo is seen on a smartphone screen.
Microsoft Copilot struggles to discern facts from opinions — posting distorted AI news summaries riddled with inaccuracies: "How long before an AI-distorted headline causes significant real-world harm?"
Artificial Intelligence AI Assistant Apps - ChatGPT, Anthropic Claude, Google Gemini, Microsoft Copilot, Perplexity, Poe.
Satya Nadella admits Microsoft missed an opportunity as ChatGPT and Copilot gain popularity — even OpenAI's Sam Altman "doesn't do Google searches anymore"
Latest in Software Apps
Photo of Microsoft's new sign-in page for Xbox.com using the Microsoft Edge browser.
Over one billion users will get a new Microsoft user experience, and it has a dark mode
Artificial intelligence mobile apps for DeepSeek, ChatGPT and Google Gemini arranged.
Google says its latest reasoning model is its "most intelligent" — but Microsoft's CEO claims Google already fumbled its AI opportunity
ChatGPT and Microsoft Logo
ChatGPT’s new image-generation tool is impressive; it can finally create a glass of wine filled to the brim — but it struggles with blank white images and appears to discriminate against 'sexy women'
Microsoft Edge Sidebar
My favorite Microsoft Edge feature just got an AI upgrade — is this the best way to use Copilot on Windows 11?
Professor Sir Roger Penrose, physicist, mathematician and cosmologist
Nobel laureate claims "AI will not be conscious" and shouldn't be considered intelligent — Until it develops its own ideas
In this photo illustration OpenAI ChatGPT icon is displayed on a mobile phone screen in Ankara, Turkiye on August 13, 2024.
OpenAI says an excessive dependency on ChatGPT can lead to loneliness and a "loss of confidence" in decision-making
Latest in News
Cloud servers
Microsoft has killed "several" data center projects in the U.S. and Europe, according to reports — Microsoft responds (Updated)
Photo of Microsoft's new sign-in page for Xbox.com using the Microsoft Edge browser.
Over one billion users will get a new Microsoft user experience, and it has a dark mode
The Thing: Remastered key art
The Thing comes to Xbox Cloud Gaming's "Stream Your Own Game" library alongside other new arrivals
Promotional screenshot of heroes fighting a giant in Pillars of Eternity
Obsidian's classic Baldur's Gate successor 'Pillars of Eternity' is getting a surprise turn-based mode later this year, alongside other updates
Atomfall
Atomfall reviews and Metacritic scores are in: Here's a roundup of what everyone's saying about this new Game Pass survival game
Screenshot of one of the new flat world presets in Minecraft.
Minecraft testing new flat world presets and a better way to locate your friends in-game