A daring developer reincarnates Clippy from the Microsoft Graveyard to pop up like an AI genie with insightful details about cryptic screenshots on Windows PCs — like Google's Circle to Search tool
Clippy wiggles its way back to Windows to provide insightful information about obscure details captured in screenshots.
What you need to know
- An avid tech enthusiast and developer recently shared an interesting project featuring Microsoft's discontinued office assistant, Clippy.
- The project dubbed AI-Snip leverages Clippy's smarts, explaining obscure details captured in screenshots.
- The developer also claims the project can be used for translation or custom prompts.
It's barely been a week since Salesforce CEO Marc Benioff slammed Microsoft for reportedly disserving the AI industry while referring to Copilot as the new Microsoft Clippy. Now, the virtual assistant is seemingly back from the Microsoft Graveyard. In a surprising yet fun turn of events, an avid developer recently shared a project dubbed AI-Snip on Reddit.
According to Developer Yannik Keller:
"I found this to be super useful for everyday use. Anytime I do not understand anything, I just make a screenshot and get it explained. It can do other things as well such as translation or custom prompts."
Demo of GPT-4o as an Image to Text model that makes MS Clippy explain the screenshots you take. from r/OpenAI
The project has sparked interest on Reddit, with multiple users sharing nostalgic memories of the virtual office assistant. "My old heart jumps from joy... no, wait, that's too much jumping, stop it... stop..damn you again, Clippyyyyy," one user indicated. "It's a great idea," another user added. "I'm surprised Microsoft isn't promoting something fun like this."
The project is reminiscent of Google's Circle to Search feature on Android phones. The feature lets you search for anything on your Android phone without switching apps by simply circling, highlighting, scribbling, or tapping the area that sparked your interest. More details about the highlighted region will be presented in real time.
Perhaps more interestingly, Microsoft Edge also features a similar feature dubbed Circle to Copilot, which serves the same purpose as Google's Circle to Search (although the forthcoming Click-to-Do is even more powerful).
According to the developer, the easiest way to run AI-snip on your Windows device is to download the binary from the releases page. Tech-savvy users with vast Python knowledge could alternatively clone the repository and follow the step-by-step instructions highlighted in AI-Snip's repository in GitHub.
Get the Windows Central Newsletter
All the latest news, reviews, and guides for Windows and Xbox diehards.
It's also possible to run AI-Snip on Linux. However, the developer indicates, "You will only be able to do one snip each time you run this program" because the operating system doesn't feature a uniform system tray like Windows.
Here are available hotkeys when leveraging AI-Snip on your PC:
- D: Toggles clippy (always starts on)
- C: Toggles if AI response is copied to clipboard (always starts off). This will also disable streaming, resulting in slower response times.
- E: Go into translation into english mode. Will also set clipboard on.
- L: Go into Latex mode. Toggles clippy off and clipboard on.
- T: Free prompt mode. Write your own prompt for the AI to answer.
- Q or Esc: Cancel your ongoing snip or close clippy (you may have to re-select the clippy window if you de-selected it).
Keller says AI-Snip is in explanation mode by default. As such, Clippy will pop up with an explanation, providing more insight and context regarding the section you snipped.
🎃The best early Black Friday deals🦃
- 🎮Lenovo Legion Go (512GB) | $499.99 at Best Buy (Save $200!)
- 📺LG Curved OLED 32 (QHD, 240Hz) | $909.99 at Amazon (Save $590!)
- 💻ASUS ROG Zephyrus G14 (RTX 4060) | $1,249.99 at Best Buy (Save $300!)
- 📺HP Omen 27qs (QHD, 240Hz) | $349.99 at Best Buy (Save $80!)
- 🔊2.1ch Soundbar for TVs & Monitors | $44.99 at Walmart (Save $55!)
- 🎧Sennheiser Momentum 4 ANC | $274.95 at Amazon (Save $125!)
- 📺LG C4 OLED 4K TV (42-inches) | $999.99 at Best Buy (Save $400!)
Kevin Okemwa is a seasoned tech journalist based in Nairobi, Kenya with lots of experience covering the latest trends and developments in the industry at Windows Central. With a passion for innovation and a keen eye for detail, he has written for leading publications such as OnMSFT, MakeUseOf, and Windows Report, providing insightful analysis and breaking news on everything revolving around the Microsoft ecosystem. You'll also catch him occasionally contributing at iMore about Apple and AI. While AFK and not busy following the ever-emerging trends in tech, you can find him exploring the world or listening to music.