StarQueue - Postgres database backed message queue server for Python
Hi folks, https://github.com/starqueue/starqueue/ This is a project I wrote and since I am doing nothing with it any more I thought I would publish the source code in case anyone finds it interesting. I wrote this at a time that I was finding message queues interesting. StarQueue is a message queue server written in Python. It is designed to be a more simple copy of Amazon Simple Queue Server. Clients access it via HTTP. The API is documented at https://github.com/starqueue/starqueue/tree/main/starqueueserver/website The…
What it does
In the maker’s words, at launch
Hi folks, https://github.com/starqueue/starqueue/ This is a project I wrote and since I am doing nothing with it any more I thought I would publish the source code in case anyone finds it interesting. I wrote this at a time that I was finding message queues interesting. StarQueue is a message queue server written in Python. It is designed to be a more simple copy of Amazon Simple Queue Server. Clients access it via HTTP. The API is documented at https://github.com/starqueue/starqueue/tree/main/starqueueserver/website The database is Postgres. When I developed it initially, I included seamless support for Postgres, MySQL and Microsoft SQL server. At some point in the development I gave up on all databases except Postgres, though I have left the MySQL and SQL server code in place. I deployed StarQueue as an online service at one point (no longer online). This github repo is a copy of the source code for that service. This project is not live and is archived, but I have posted it here in case anyone finds the source code interesting. After I finished StarQueue I found it frustrating that StarQueue's Python based/db backed message queue is not fast, so I wrote a prototype HTTP message queue in Rust, which saved its messages as plain files on the file system, using the fact that Linux's move is atomic to ensure message could not be double handled - that was so fast it easily maxed out the hard disk write speed and left many other message queue systems behind with 30,000 messages a second. Frustrated by the speed limit of the hard disk I updated the prototype to operate as RAM only and that was able to handle about 8 million messages a second. More important things came up for me to do, and I never got that Rust project to completion.
Does the same job
all alternatives →- SAStarQueue – a free hosted HTTP message queue with a Postgres back end2021 · starqueue.org · ▲43
- SGStellar – Git for PostreSQL and MySQL2014 · github.com · ▲325
- GFGraphQL for Postgres2015 · github.com · ▲195
- JFJson2graphql – From a JSON file to Postgres-backed realtime GraphQL2019 · github.com · ▲120
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
