Dev tools · September 25, 2024
Generate E2E tests for your applications from its URL
Hi Hackernews, I’m Marvin from playrun.dev (https://playrun.dev), a platform for generating end-to-end tests for your application using just the URL. I recently worked on a project rewrite with a small team on a tight deadline. We needed to keep shipping while also writing tests for the application. We believed unit tests were a waste of time and decided e2e tests were the way to go, but doing so manually was still time-consuming and made shipping slower. Testing is one of those things we do as engineers that don’t have immediate ROI, and it was almost impossible to make the…
What it does
In the maker’s words, at launch
Hi Hackernews, I’m Marvin from playrun.dev (https://playrun.dev), a platform for generating end-to-end tests for your application using just the URL. I recently worked on a project rewrite with a small team on a tight deadline. We needed to keep shipping while also writing tests for the application. We believed unit tests were a waste of time and decided e2e tests were the way to go, but doing so manually was still time-consuming and made shipping slower. Testing is one of those things we do as engineers that don’t have immediate ROI, and it was almost impossible to make the business team understand why we needed to do it and why we were spending so much time on it. Augmenting testing with AI helps reduce the dev hours we invest in testing so we can focus on shipping, which is very important to the business and users. Basically, playrun.dev crawls through your application and discovers possible user flows. Once a flow is found, it is mapped step by step, and each step is run and evaluated to ensure it’s correct before the next step is mapped until it can be determined that the flow has ended. Under the hood, we use multi-agent LLM to discover flows and generate tests. All that is needed is to provide the public URL to a testing version of your application (please don’t use production URLs, lots of dummy data will be generated). We will navigate the whole application and generate Playwright tests. We also provide a CLI tool to export generated tests directly to your Playwright project. Although this isn’t perfect (we still had to review and manually fix a few tests), it was able to generate almost perfect tests for about 70% - 80% of flows in our applications (>90% on some runs, we hope to reproduce that consistently). We still have some limitations and gotchas around Captchas and 3rd party authentication (Google and some other providers block testing browsers as bots and the only way we are able to get around Captchas for now is by disabling it on our testing server). Additionally we are working on ability to generate, manage and run you e2e tests on a schedule in one place. So regressions can be detected faster on autopilot and if application flows changes, they can be easily be remapped without writing a line of code. You can try it today at https://playrun.dev. I’m really happy to show this to you all, thanks for reading about it, please let me know your thoughts and questions in the comment.
Does the same job
all alternatives →
- ETE2E testing is a chore. We taught an AI to do it instead2025 · playmatic.ai · ▲6
Hey Hacker News, For the last 2 months, I've been working on a testing agent to free developers from the endless maintenance of end-to-end tests. You just push up a PR, and our agent analyzes the code changes and automatically visits the preview to test things out like a real human! We also support describing tests in English (or even in the PR description), and we'll go through your site whenever you want via a GitHub action to test and make sure various core flows continue to work as expected. We are looking for early testers and are giving out a generous free tier! Just sign up on the…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, September 2024
the whole month →
BeforeSunset AI 2.0▲1,267Personalized AI daily planning that suits your life
AI · 2024 · beforesunset.ai
