CNET proves the point: Current AI technology is dumber than you

Image of robot at a keyboard generated by DALL-E
(Image credit: Generated by DALL-E)

What you need to know

  • News outlet CNET published around 75 articles that were generated using an unspecified AI engine.
  • Futurism, a separate publication, reported on the use of AI by CNET last week.
  • A follow-up article by Futurism highlighted several mistakes that appeared in CNET articles that were generated by AI, despite the fact that those pieces were said to be reviewed by a human editorial staff.

A recent pair of articles by Futurism highlighted some of the weaknesses of artificial intelligence. News outlet CNET generated around 75 articles with an unspecified AI tool. That fact was highlighted by Futurism last week, sparking debate across the web. The fact that CNET did not disclose the program in advance was one of the chief criticisms, along with the fact that the disclosure of each bot-written article was originally hidden.

Following Futurism's coverage, CNET Editor-in-Chief Connie Guglielmo shared a piece about the use of AI to create articles. The outlet has since made changes, such as altering the previous byline of "CNET Money Staff" to simply "CNET Money."

Guglielmo claimed that all of the AI-generated articles were "reviewed, fact-checked and edited by an editor," specifically a human editor. Despite that disclaimer, issues managed to get through the system.

CNET's new AI had at least four identified gaffes related to factuality.

In a follow-up article, Futurism pointed out mistakes within multiple CNET pieces. Below is just one example (emphasis added by Futurism):

"To calculate compound interest, use the following formula:

Initial balance (1+ interest rate / number of compounding periods) ^ number of compoundings per period x number of periods 

For example, if you deposit $10,000 into a savings account that earns 3% interest compounding annually, you'll earn $10,300 at the end of the first year."

The financial figures shared within CNET's original piece are incorrect, as pointed out by Futurism. The example listed would result in a person earning $300 in the first year, not $10,300. That's a significant difference and one that would likely have been caught by a human writer or editor.

The article has since been updated, but an archived version shows the error.

The piece by Futurism illustrates many of the weaknesses of artificial intelligence. Most notably, AI often generates text in a way that sounds authoritative regardless of if the content is factually correct. It also indicates that AI-assisted writing can still have factual errors.

Windows Central take

I have no doubt that artificial intelligence will at some point be able to generate news articles. In fact, Futurism highlighted that the Associated Press has used AI to create articles since 2015. But in those instances AI was used to fill in templates, not create entirely new text.

As someone who has written thousands of news articles, I readily admit that some posts are formulaic. An article about an app update that includes a change log or a Windows 11 Patch Tuesday update could probably be generated with an AI tool. But content that does not fit within tight parameters requires a human touch, at least for now.

I also want to emphasize that no writer is perfect, human or otherwise. I've certainly made mistakes and had to update articles accordingly. But I feel like there's a sense of accountability when a human creates an error. I've had bosses message me when I shared a draft with an obvious mistake. I've also had several editors work with me over the years to improve my writing.

If AI is to be used in the creation of content, it needs to be monitored strictly to avoid the pitfalls of artificial intelligence. Unfortunately, in the case of some of CNET's articles, that was not what occurred.

CATEGORIES
Sean Endicott
News Writer and apps editor

Sean Endicott is a tech journalist at Windows Central, specializing in Windows, Microsoft software, AI, and PCs. He's covered major launches, from Windows 10 and 11 to the rise of AI tools like ChatGPT. Sean's journey began with the Lumia 740, leading to strong ties with app developers. Outside writing, he coaches American football, utilizing Microsoft services to manage his team. He studied broadcast journalism at Nottingham Trent University and is active on X @SeanEndicott_ and Threads @sean_endicott_. 

Read more
In this photo illustration, Microsoft Copilot AI logo is seen on a smartphone screen.
Microsoft Copilot struggles to discern facts from opinions — posting distorted AI news summaries riddled with inaccuracies: "How long before an AI-distorted headline causes significant real-world harm?"
Andrej Karpathy, Director of AI Tesla, a keynote speaker at the Train AI conference in 2018
Ex-OpenAI founder claims 99.9% of web content will be AI-optimized — Was Bill Gates right about AI replacing humans?
ChatGPT and Microsoft Logo
Will an overreliance on Copilot and ChatGPT make you dumb? A new Microsoft study says AI 'atrophies' critical thinking: "I already feel like I have lost some brain cells."
Artificial Intelligence AI Assistant Apps - ChatGPT, Anthropic Claude, Google Gemini, Microsoft Copilot, Perplexity, Poe.
AI gone wild: Gemini and ChatGPT flub spouse questions of public figures, says WSJ
Closeup computer code on screen, Man programmer, software developer coding and programming on laptop.
I thought coding was dead after Anthropic's CEO claimed that AI may take over within 12 months — I was wrong, and AI thinks so, too
Microsoft Copilot
Microsoft says ChatGPT is not better than Copilot; we just aren't using it as intended — So why does it refuse to provide basic election details? "I'm probably not the best resource for something so important."
Latest in Software Apps
Excel spreadsheet with checkboxes
Microsoft 365 sales are few and far between these days — grab this one before it goes away!
Office 365 on Razer laptop
Microsoft 365's best apps are about to get a speed boost — here's when the rollout begins
Photo of Microsoft's new sign-in page for Xbox.com using the Microsoft Edge browser.
Over one billion users will get a new Microsoft user experience, and it has a dark mode
Windows 11 answer file
How to easily create an unattended answer file for Windows 11
ChatGPT logo is seen displayed on a smartphone screen next to a laptop keyboard.
I love ChatGPT-4o's unhinged image-generation capabilities — but I'm afraid imminent censorship by OpenAI lurks on the horizon
Bill Gates, co-chairman of the Bill and Melinda Gates Foundation, delivers a keynote speech on the closing day of the Global Solutions Summit in Berlin, Germany, on Tuesday, May 7, 2024.
Bill Gates says "AI will replace humans for most things" — Rendering doctors and tutors obsolete within a decade
Latest in News
Excel spreadsheet with checkboxes
Microsoft 365 sales are few and far between these days — grab this one before it goes away!
Spongebob meme with Xbox logo, Steam logo, and PlayStation logo
Would PlayStation block its PC Steam games from running on a future Windows-based PC-like Xbox? Let's discuss.
Screenshot of Assassin's Creed Shadows.
Assassin's Creed Shadows crosses 3 million players just a week after launch
The Backbone One Xbox Edition mobile controller which is translucent green
Backbone launches Xbox version of its popular mobile controller — it's green!
Office 365 on Razer laptop
Microsoft 365's best apps are about to get a speed boost — here's when the rollout begins
NVIDIA CES 2025
You should be worried about NVIDIA’s launch strategy for its most popular GPUs. Here's why.