GPT-V and OCR for Screen Control

In plain words

GPT-V and OCR for Screen Control is an AI tool that combines vision and optical character recognition capabilities to interpret and interact with screen content. It processes visual information from displays to enable automated control and navigation. The tool is designed for developers and technical users working with automation, accessibility, or screen-based workflows. Available on GitHub, it leverages AI to understand on-screen elements without relying on traditional UI APIs.

written from the facts on this page · September 2026

• 
  DeepSeek-OCR2025 · huggingface.co · ▲350

  Advanced visual-text compression technology

• 
  Bring OCR to GPT2024 · github.com · ▲13

  Odin Runes, a java-based GPT client, facilitates interaction with your preferred GPT model right through your favorite text editor. There is more: It also facilitates prompt-engineering by extracting context from diverse sources using technologies such as OCR, enhancing overall productivity and savi

• 
  GPT Driver2023 · mobileboost.io · ▲264

  Let AI do your mobile app QA

• 
  OCR Arena – A playground for OCR modelsNov 2025 · ocrarena.ai · ▲216

  I built OCR Arena as a free playground for the community to compare leading foundation VLMs and open-source OCR models side-by-side. Upload any doc, measure accuracy, and (optionally) vote for the models on a public leaderboard. It currently has Gemini 3, dots.ocr, DeepSeek, GPT5, olmOCR 2, Qwen, and a few others. If there's any others you'd like included, let me know!

• 
  Zerox – Document OCR with GPT-mini2024 · github.com · ▲246

  This started out as a weekend hack with gpt-4-mini, using the very basic strategy of "just ask the ai to ocr the document". But this turned out to be better performing than our current implementation of Unstructured/Textract. At pretty much the same cost. I've tested almost every variant of document OCR over the past year, especially trying things like table / chart extraction. I've found the rules based extraction has always been lacking. Documents are meant to be a visual representation after all. With weird layouts, tables, charts, etc. Using a vision model just make sense! In…

• IT
  I taught GPT-OSS-120B to see using Google Lens and OpenCVFeb 2026 · ▲43

  I built an MCP server that gives any local LLM real Google search and now vision capabilities - no API keys needed. The latest feature: google_lens_detect uses OpenCV to find objects in an image, crops each one, and sends them to Google Lens for identification. GPT-OSS-120B, a text-only model with zero vision support, correctly identified an NVIDIA DGX Spark and a SanDisk USB drive from a desk photo. Also includes Google Search, News, Shopping, Scholar, Maps, Finance, Weather, Flights, Hotels, Translate, Images, Trends, and more. 17 tools total. Two commands: pip install…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 17d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 17d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 20d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 29d ago · world.pixverse.video

• 
  Hemory▲381

  Keep listening. Searchable memory for your AI agents.

  AI · 30d ago · hemory.com

• 
  Beeper Mini – iMessage client for Android▲1,521

  Hi HN! I’m proud to share that we have built a real 3rd party iMessage client for Android. We did it by reverse engineering the iMessage protocol and encryption system. It's available to download today (no waitlist): https://play.google.com/store/apps/details?id=com.beeper.ima and there's a technical writeup here: https://blog.beeper.com/p/how-beeper-mini-works. Unlike every other attempt to build an iMessage app for Android (including our first gen app), Beeper Mini does not use a Mac server relay in the cloud. The app connects directly to Apple…

  Work · 2023 · beeper.com

• 
  Heynote – A dedicated scratchpad for developers▲1,063

  Hey! I made Heynote entirely for my own use case. For many years, I always had an Emacs instance running with the scratch buffer open, even long after I had abandoned Emacs as my programming editor in favor of more recent IDE:s. The simplicity of having just one big scratch buffer appeals to me, but I still want to separate the different things I jot down somehow (without using tabs or similar). Previously, my solution was to insert a bunch of blank lines between the notes, but hitting C-A would still select the entire buffer. That's why I came up with the concept of "blocks", which turned…

  Work · 2023 · heynote.com

• 
  LogoFast▲988

  Make beautiful logos with AI, fast & free

  AI · 2023 · logofa.st

• 
  FuseBase▲939

  Client collaboration platform for professional services

  Dev tools · 2023 · thefusebase.com

• 
  Beep! 2.0▲871

  Fastest tool to assign and share visual tasks with your team

  Work · 2023 · justbeepit.com

• 
  Inbox Zero▲821

  Clean Up Your Inbox In Minutes Newsletter management, AI automation, and email analytics. Inbox Zero is the open-source email app that puts you back in control of your inbox.

  AI · 2023 · getinboxzero.com