Autospec – open-source agent that generates E2E tests for your web app
Hi HN, I'm excited to share some early tinkering on a project, autospec, an open-source QA agent for web applications. Right now it's not fully packaged for use, but I wanted to get the idea out early and am looking for design feedback, suggestions, and open source collaborators to join in. I wrote it over memorial weekend :) autospec uses vision and text language models to explore and generate commonsense e2e tests for web applications. The goal is human-like evaluation: assessing the entire UI as a user would, making decisions based on the actual state of the application at each step, with…
What it does
In the maker’s words, at launch
Hi HN, I'm excited to share some early tinkering on a project, autospec, an open-source QA agent for web applications. Right now it's not fully packaged for use, but I wanted to get the idea out early and am looking for design feedback, suggestions, and open source collaborators to join in. I wrote it over memorial weekend :) autospec uses vision and text language models to explore and generate commonsense e2e tests for web applications. The goal is human-like evaluation: assessing the entire UI as a user would, making decisions based on the actual state of the application at each step, with zero initial configuration, and the ability to immediately adapt to new features. Why I Built It: I've experienced the difficulty in building the right amount of automated tests and at the right layer of abstraction to both provide good coverage, avoid flakiness, and avoid constant rewrites when implementation changes. This is the first AI-driven application I've built. I was inspired by a couple of things: * SWE-agent's [1] focus on agentic performance * backend-GPT's README rant [2]: "The proper format for business logic is human intelligence." * zerostep [3], autogpt [4], and other browser-controlled AI projects Potential Next Steps: * Save passing specs as playwright code and only fallback on spec failure to the AI agent, to see if the test can be self-healed according to the original spec. * Create a curated benchmark of both common open source web apps that should pass, and versions with introduced bugs * NPM package to run like `npx autospec --url https://example.com` * Github action and Vercel checks API integration to run on preview deployments * Handling app auth securely+easily * Continue exploring the balance between vision UI interpretation and DOM analysis [1]: https://github.com/princeton-nlp/SWE-agent [2]: https://github.com/RootbeerComputer/backend-GPT [3]: https://github.com/zerostep-ai/zerostep [4]: https://github.com/Significant-Gravitas/AutoGPT Thanks! Zach
Does the same job
all alternatives →
- NONous – Open-Source Agent Framework with Autonomous, SWE Agents, WebUI2024 · github.com · ▲155
Hello HN! The day has finally come to stop adding features and start sharing what I've been building the last 5-6 months. It's a bit of CrewAI, OpenDevon, LangFuse/Cloud all in one, providing devs who prefer TypeScript an integrated framework thats provides a lot out of the box to start experimenting and building agents with. It started after peeking at the LangChain docs a few times and never liking the example code. I began experimenting with automating a simple Jira request from the engineering team to add an index to one of our Google Spanner databases (for context I'm the…
- ETE2E testing is a chore. We taught an AI to do it instead2025 · playmatic.ai · ▲6
Hey Hacker News, For the last 2 months, I've been working on a testing agent to free developers from the endless maintenance of end-to-end tests. You just push up a PR, and our agent analyzes the code changes and automatically visits the preview to test things out like a real human! We also support describing tests in English (or even in the PR description), and we'll go through your site whenever you want via a GitHub action to test and make sure various core flows continue to work as expected. We are looking for early testers and are giving out a generous free tier! Just sign up on the…
- ATAutomated Testing for AI AgentsMar 2026 · agents.zalor.ai · ▲8
Hi Hacker News! We're launching Zalor, an agent testing platform. Agents often break when you tweak system prompts, swap models, or add tools. Zalor automatically generates test scenarios and evaluates your agent so you know it's reliable before deploying to production. We currently support the OpenAI Agents SDK and are onboarding other frameworks. A GitHub integration is coming so you can get feedback on every update. Looking forward to hearing feedback from people building agents.
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
