nowfound

Dev tools · June 30, 2024

DI

Drop-in SQS replacement based on SQLite

Hi! I wanted to share an open source API-compatible replacement for SQS. It's written in Go, distributes as a single binary, and uses SQLite for underlying storage. I wrote this because I wanted a queue with all the bells and whistles - searching, scheduling into the future, observability, and rate limiting - all the things that many modern task queue systems have. But I didn't want to rewrite my app, which was already using SQS. And I was frustrated that many of the best solutions out there (BullMQ, Oban, Sidekiq) were language-specific. So I made an SQS-compatible replacement. All you have…

In plain words

Drop-in SQS replacement is an open-source queue system written in Go that uses SQLite for storage and distributes as a single binary. It provides an API-compatible alternative to AWS SQS, allowing developers to switch endpoints without rewriting applications. The tool adds features like message searching, future scheduling, observability, and rate limiting. It works language-agnostically with existing SQS clients, including Celery, and includes a console for viewing message status.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hi! I wanted to share an open source API-compatible replacement for SQS. It's written in Go, distributes as a single binary, and uses SQLite for underlying storage. I wrote this because I wanted a queue with all the bells and whistles - searching, scheduling into the future, observability, and rate limiting - all the things that many modern task queue systems have. But I didn't want to rewrite my app, which was already using SQS. And I was frustrated that many of the best solutions out there (BullMQ, Oban, Sidekiq) were language-specific. So I made an SQS-compatible replacement. All you have to do is replace the endpoint using AWS' native library in your language of choice. For example, the queue works with Celery - you just change the connection string. From there, you can see all of your messages and their status, which is hard today in the SQS console (and flower doesn't support SQS.) It is written to be pluggable. The queue implementation uses SQLite, but I've been experimenting with RocksDB as a backend and you could even write one that uses Postgres. Similarly, you could implement multiple protocols (AMQP, PubSub, etc) on top of the underlying queue. I started with SQS because it is simple and I use it a lot. It is written to be as easy to deploy as possible - a single go binary. I'm working on adding distributed and autoscale functionality as the next layer. Today I have search, observability (via prometheus), unlimited message sizes, and the ability to schedule messages arbitrarily in the future. In terms of monetization, the goal is to just have a hosted queue system. I believe this can be cheaper than SQS without sacrificing performance. Just as Backblaze and Minio have had success competing in the S3 space, I wanted to take a crack at queues. I'd love your feedback!

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 25d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 20d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 11d ago · x1.new

  • Open-source GTM skills for technical founders

    Dev tools · 29d ago · gtmcofounder.com

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 1d ago · opentrailpaper.com

  • Nuphos380

    The AI-Native DevOps Workspace.

    Dev tools · 24d ago · nuphos.ai

Launched alongside, June 2024

the whole month →
  • Pygma1,409

    AI copilot for Instagram

    AI · 2024 · pygma.me

  • Cello1,347

    Easiest way to add a referral program to your SaaS

    Growth · 2024 · cello.so

  • Create personalized, multi-channel conversations at scale

    AI · 2024 · lagrowthmachine.com

  • FlowMapp 3.01,147

    Visual website planning in the most powerful way

    Work · 2024 · flowmapp.com

  • Revolutionary AI email, reimagined for teams

    AI · 2024 · superhuman.com

  • PyjamaHR1,132

    Hiring on autopilot. The AI applicant tracking system (ATS).

    Work · 2024 · pyjamahr.com