AI · alternatives · 2026
24 alternatives to Open-source LLM-powered test automation library for mobile and web
Hey HN! I'm Alex, a tech lead of the Selenium project and a QA engineer. For the last 10 months, I've been working on Alumnium - a test automation library that should make my life easier and let me write less code when automating the tests. The goal is to use LLM for _automating_ so I could focus more on _testing_. Unlike other similar projects, Alumnium can be used in existing tests without changes to test runners, reporting tools, or any other test infrastructure. This allows me to gradually migrate my test suites (mostly Selenium) and revert whenever something goes wrong (this happens a…
Alumnium is an open-source test automation library that uses large language models to reduce code needed for writing mobile and web tests. Built for QA engineers and developers, it integrates with existing test suites… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
I spent a few hours last weekend testing whether AI can replace code by executing directly. Built a contact manager where every HTTP request goes to an LLM with three tools: database (SQLite), webResponse (HTML/JSON/JS), and updateMemory (feedback). No routes, no controllers, no business logic. The AI designs schemas on first request, generates UIs from paths alone, and evolves based on natural language feedback. It works—forms submit, data persists, APIs return JSON—but it's catastrophically slow (30-60s per request), absurdly expensive ($0.05/request), and has zero UI…
Nov 2025 · github.com · its alternatives →
- 2
Hey HN, I made Browser-Use, an open-source tool that lets (all Langchain supported) LLMs execute tasks directly in the browser just with function calling. It allows you to build agents that interact with web elements using natural language prompts. We created a layer that simplifies website interaction for LLMs by extracting xPaths and interactive elements like buttons and input fields (and other fancy things). This enables you to design custom web automation and scraping functions without manual inspection through DevTools. Hasn't this been done a lot of times? Good question, as a general…
2024 · github.com · its alternatives →
- 3
- 4CG
Hey HN! I’m Gal, co-founder at Checksum (https://checksum.ai). Checksum is a tool for automatically generating and maintaining end-to-end tests using AI. I cut my teeth in applied ML in 2016 at a maritime tech company called TSG, based in Israel. When I was there, I worked on a cool product that used machine learning to detect suspicious vehicles. Radar data is pretty tough for humans to parse, but a great fit for AI – and it worked very well for detecting smugglers, terrorist activity, and that sort of thing. In 2021, after a few years working in big tech (Lyft, Google), I joined…
2023 · its alternatives →
- 5
Automate cross browser testing with an online selenium grid
2019 · testmuai.com · its alternatives →
- 6
I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...
2024 · embedding.io · its alternatives →
- 7
- 8
Autotab is a Chrome extension that writes Selenium code to mirror your actions as you navigate the browser. See it in action: https://youtu.be/UypAcozIaoo Autotab lets you create browser automations that actually work. We designed it around two principles: 1. Show, don’t tell: In a domain like web automation, it's often easier to *show* the model what you want rather than to explain it in sentences. 2. Code is the best output: Code is easy to inspect and enables manual tweaking of the model’s suggested actions. On top of that, code output avoids lock in and is straightforward…
2023 · autotab.com · its alternatives →
- 9
i started the selenium project 21 years ago. vibium is what i'd build if i started over today with ai agents in mind. go binary under the hood (handles browser, bidi, mcp) but devs never see it. just npm install vibium. python/java coming. for claude code: claude mcp add vibium -- npx -y vibium v1 ships today. ama.
Dec 2025 · github.com · its alternatives →
- 10IB
We show the potential of modern, embedded graph databases in the browser by demonstrating a fully in-browser chatbot that can perform Graph RAG using Kuzu (the graph database we're building) and WebLLM, a popular in-browser inference engine for LLMs. The post retrieves from the graph via a Text-to-Cypher pipeline that translates a user question into a Cypher query, and the LLM uses the retrieved results to synthesize a response. As LLMs get better, and WebGPU and Wasm64 become more widely adopted, we expect to be able to do more and more in the browser in combination with LLMs, so a lot of…
2025 · blog.kuzudb.com · its alternatives →
- 11
- 12
Hey HN, just wanted to share a fun, vibe-coded Friday night experiment: a little playground for writing cellular automata in a subset of Rust, which is then compiled into WGSL. Since it lets you dynamically change parameters while the simulation is running via a TUI, it's easy to discover weird behaviors without remembering how you got there. If you press "s", it will save the complete history to a JSON file (a timeline of the parameters that were changed at given ticks), so you can replay it and regenerate the discovery. You can pan/zoom, and while the main simulation window is in…
Feb 2026 · github.com · its alternatives →
- 13
Hi everyone, we’re a small team, supported by Mozilla, who are working on re-imagining a UI for training, tuning and testing local LLMs. Everything is open source. If you’ve been training your own LLMs or have always wanted to, we’d love for you to play with the tool and give feedback on what the future development experience for LLM engineering could look like.
2025 · github.com · its alternatives →
- 14
- 15
TestLeft▲82Automate UI tests for web and desktop apps from any IDE
2018 · smartbear.com · its alternatives →
- 16
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 17
Open source, complete and easy to use QA Automation platform
2018 · github.com · its alternatives →
- 18
Tracium.ai▲70Hi everyone, thanks for checking out tracium. At work I needed some clarity on how much each agent costs us and how they perform on production so I started looking at existing solutions for this such as LangSmith and LangFuse. Honestly, they felt like they are overcomplicated to integrate and that there should be a simpler solution so I decided to build Tracium. Tracium keeps track of every single AI API call that you make to an LLM provider, with this you can see traces, spans, I/O, tokens in/out, latency. You can compare during A/B testing, see usage from each customer and…
Mar 2026 · tracium.ai · its alternatives →
- 19AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 20
Hi everyone, I'm working for a startup called BugFree Software and would love to hear your feedback on a new product we are launching today. Helium is a library that wraps around Selenium to simplify web automation. It does away with many of the technicalities involved with web scripting. For example: Here is a Selenium script. Can you guess what it does? >>> ff = Firefox() ... >>> text_area = ff.find_element_by_id("u_0_1q") >>> text_area.send_keys("Hello World!") >>> button = ff.find_element_by_class_name("_42g-") >>> button.click() Here is the same script rewritten using Helium: >>>…
2013 · heliumhq.com · its alternatives →
- 21
Scandium▲51Automate web, mobile & API testing without coding.
2024 · getscandium.com · its alternatives →
- 22
Introducing gamium, a game test automation SDK for game developers and qa engineers. There are tools such as Selenium and Appium for web and mobile, and they are used universally, but in games, there are many areas where tests are not automated, so it was developed to solve this problem. gamium currently supports unity engine, and supports python and typescript as client languages. We plan to support various engines such as unreal and godot in the future. We look forward to your interest and comments. Thank you.
2023 · github.com · its alternatives →
- 23SL
2019 · fleetapp.cc · its alternatives →
- 24
Hi HN! Run it: OPENROUTER_API_KEY="sk" npx bff-eval --demo We built a tool to help people take LLM outputs and easily grade them / eval them to know how good an assistant response is. We've built a number of LLM apps, and while we could ship decent tech demos, we were disappointed with how they'd perform over time. We worked with a few companies who had the same problem, and found out scientifically building prompts and evals is far from a solved problem... writing these things feels more like directing a play than coding. Inspired by Anthropic's constitutional ai concepts, and amazing…
2025 · github.com · its alternatives →
Also compare
- Why write code if the LLM can just do the thing? (web app experiment) alternatives
- I wrote an open-source browser alternative for Computer Use for any LLM alternatives
- Checksum AI alternatives
- Checksum – generate and maintain end-to-end tests using AI alternatives
- LambdaTest Automation alternatives
- Turn any website into a knowledge base for LLMs alternatives
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →