I built an AI agent that turns ROS 2's turtlesim into a digital artist
I'm a grad student studying robotics, with a particular interest in the intersection of LLMs and mobile robots. Recently, I discovered how easily LangChain enables the creation of AI agents, and I wanted to explore how such agents could interact with simulated environments. So, I built TurtleSim Agent, an AI agent that turns the classic ROS 2 turtlesim turtle into a creative artist. With this agent, you can give plain English commands like “draw a triangle” or “make a red star,” and it will reason through the instructions and control the simulated turtle accordingly. I’ve included demo…
In plain words
TurtleSim Agent is an AI system that interprets plain English commands to control a simulated turtle in ROS 2's turtlesim environment, turning it into a digital artist. Users can request drawings like triangles or colored stars, and the agent reasons through instructions using a large language model, then executes commands through modular tools for motion and pen control. Built by a robotics graduate student, it demonstrates how language models can interact with robotic simulation environments and is designed for those interested in the intersection of LLMs, robotics, and ROS development.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
I'm a grad student studying robotics, with a particular interest in the intersection of LLMs and mobile robots. Recently, I discovered how easily LangChain enables the creation of AI agents, and I wanted to explore how such agents could interact with simulated environments. So, I built TurtleSim Agent, an AI agent that turns the classic ROS 2 turtlesim turtle into a creative artist. With this agent, you can give plain English commands like “draw a triangle” or “make a red star,” and it will reason through the instructions and control the simulated turtle accordingly. I’ve included demo videos on GitHub. Behind the scenes, it uses an LLM to interpret the text, decide what actions are needed, and then call a set of modular tools (motion, pen control, math, etc.) to complete the task. If you're interested in LLM+robotics, ROS, or just want to see a turtle become a digital artist, I'd love for you to check it out: GitHub: https://github.com/Yutarop/turtlesim_agent Looking ahead, I’m also exploring frameworks like LangGraph and MCP (Modular Chain of Thought Planning) to see whether they might be better suited for more complex planning and decision-making tasks in robotics. If anyone here is familiar with these frameworks or working in this space, I’d love to connect or hear your thoughts.
Does the same job
all alternatives →
- WSWe started building an AI dev tool but it turned into a Sims-style game2025 · youtube.com · ▲156
Hi HN! We’re Max and Peyton from The Interface (https://www.theinterface.com/). We started out building an AI agent dev tool, but somewhere along the way it turned into Sims for AI agents. Demo video: https://www.youtube.com/watch?v=sRPnX_f2V_c. The original idea was simple: make it easy to create AI agents. We started with Jupyter Notebooks, where each cell could be callable by MCP—so agents could turn them into tools for themselves. It worked well enough that the system became self-improving, churning out content, and acting like a co-pilot that helped you…
- BTBe the ChatBOTJul 2026 · bethechatbot.com · ▲55
I made this experimental art project/game that's an LLM chat assistant, but where you're the AI. I wanted people to get a visceral sense of what it's like to answer the kinds of things that people prompt their chatbots day in and day out. If you're interested, I wrote up some more info on how I made it, including how the "user" prompts are generated with an eye for realism: https://bethechatbot.com/about Hope you enjoy it! I'd love to hear people's takeaways.
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, May 2025
the whole month →
- C9
Life & fun · 2025 · felixrieseberg.github.io
