Alternatives
Products that do what Pq – Simple, durable background tasks in Python using Postgres does
At work we were using python-rq for background tasks. It does the job for simple things, but we kept bumping into limitations. We needed to schedule tasks hours / days out and trust they'd survive a restart. We wanted periodic tasks with proper overlap control. So we built a scheduling / enqueuing system around Postgres to bring these durability capabilities to python-rq. This worked fine for a while but was trickier to reason about due to its more complicated architecture (we'd run two separate services just for getting jobs from Postgres into the rq Redis queue, plus N actual…
- 11R
2016 · magic.io
- 2SS
SPyQL (https://github.com/dcmoura/spyql) is SQL with Python in the middle, an open-source project fully written in Python for making command-line data processing more intuitive, readable and powerful. Try mixing in the same pot: a SQL SELECT for providing the structure, Python expressions for defining transformations and conditions, the essence of awk as a data-processing language, and the JSON handling capabilities of jq. How does a SPyQL query looks like? $ spyql “ IMPORT pendulum AS p SELECT (p.now() - p.from_timestamp(purchase_ts)).in_days() AS days_ago, sum_agg(price…
2022 · github.com
- 3KS
2016 · github.com
- 4
- 5DP
Hi HN – this is Peter from DBOS here with Qian (qianli_cs) and Jeremy (jedberg). We’re building an open-source, lightweight durable workflows library on top of Postgres. Ever since we first launched on HN last year, we’ve been blown away by the support, feedback, and response we’ve received from the community. We've realized durable workflows are critical for everything from business processes to AI automation to data pipelines, but most existing durable orchestration tools are either too heavy or too complicated for most applications. Instead, we're building something lightweight, simple,…
2025 · github.com
- 6GF
2015 · github.com
- 7QA
Hi everyone - I wrote a job queue called Que, which uses Postgres' advisory locks to manage jobs very efficiently. My goal is to make it easy to cover jobs with the same ACID guarantees as the rest of your data. It won't be as fast as a dedicated or Redis-backed queue, but I expect it will be fast enough for many use-cases. https://github.com/chanks/que The 20x figure comes from a benchmark I ran on an AWS c3.8xlarge instance - this number will change depending on your hardware. The code for the benchmark (and some more detailed results) is here:…
2013
- 8ST
https://github.com/denvaar/pgdiff I cobbled together various programs into a bash script to compare how data changes between two points in time. My idea was basically to have a `git diff` but for data inside postgres. I wanted a util like this to help get to know a new code base: Interact with an app and watch how the data changes. You run the script with a given key (anything) before interacting with an app, then run it again with the same key to see the data diff. I'm not much of a bash scripter, as you can probably see from the script, but it was a fun and useful tool…
2021
- 9LD
Hi HN! This is Qian here with Peter (KraftyOne) and Jeremy (jedberg). We’re building DBOS, an open-source, lightweight durable workflows library that you can add to Python apps in just a few lines of code. It’s comparable to popular open-source workflow and queue libraries like Airflow and Celery, but more lightweight with a greater focus on reliability and automatically recovering from failures. Our goal in building DBOS is to make workflows lightweight and flexible so you can add them to your existing apps with minimal work. Everything you need to run durable workflows and queues is…
2025 · github.com
- 10
- 11RP
2020 · github.com
- 12YO
2017 · github.com
- 13PP
Hi, the main motivation of this small personal project is the ability to build Postgres-backed python apps that remain fully pip-installable despite the dependency, while saving your users any need to setup Postgres if they don't have it. It also helps me, as a developer, to not have to remember how to set up postgres, which I find is one main barrier to using it for small stuff. It's a little project of mine that may be helpful to more people. I'm curious to hear your feedback (ps. I know about SQLite, but sometimes you want/need to build against postgres)
2024 · github.com
- 14BP
2017 · github.com
- 15DL
2014 · databaselabs.io
- 16PB
Hi HN - I’m Peter, here with Max (hmaxdml), and we’re building DBOS Go, an open-source Go library for durable workflows, backed by Postgres. https://github.com/dbos-inc/dbos-transact-golang DBOS workflows make your programs durable by automatically checkpointing their state to Postgres. If your program crashes or fails, all workflows seamlessly resume from their last completed step when your program restarts. This durability makes workflows useful for solving many different problems, including: - Operating an AI agent, or anything that connects to an unreliable or…
Sep 2025 · github.com
- 17PP
2015 · github.com
- 18PS
2020 · gist.github.com
- 19AI
2019 · supergraph.dev
- 20OS
Hey HN, half a year ago we were building a feature where our users could trigger long-running jobs with the following requirements: (i) the job is provisioned by the user action (e.g., clicking a button in the UI), (ii) the job can be canceled by the user, (iii) the progress of the job can be inspected while the job is running, (iv) hardware for the job is provisioned only when needed (the job may require expensive hardware and isn't called that frequently). Because we couldn't find any existing ways of achieving this we decided to implement one for Python. Currently, it uses an AWS ECS…
2023 · github.com
- 21SP
Hi folks, https://github.com/starqueue/starqueue/ This is a project I wrote and since I am doing nothing with it any more I thought I would publish the source code in case anyone finds it interesting. I wrote this at a time that I was finding message queues interesting. StarQueue is a message queue server written in Python. It is designed to be a more simple copy of Amazon Simple Queue Server. Clients access it via HTTP. The API is documented at https://github.com/starqueue/starqueue/tree/main/starqueueserver/website The…
2023
- 22UP
Utilizing Postgres' RLS feature to isolate user data instead of easy-to-forget where-clauses, is such an underrated use case, I really wonder why not more people use it. If you prefer code over the blog post, I've put the full application example on GitHub. Would love to hear your thoughts. https://github.com/simplyblock/example-rls-invoicing
Sep 2025 · simplyblock.io
- 23PC
Sep 2025 · github.com
- 24SH
Skip straight to the bottom if you only want to know how to save hours of work in your job searching process just by using two simple python scripts + GPT As a former startup founder, lately I've been facing the complex challenge of transitioning back into the traditional job market. With no experience in the job searching game for the last 10+ years, I had no idea what I was getting myself into I still have a lot to go, but one of the most annoying and time-consuming parts of the process of applying to jobs so far, has been just even trying to find the right jobs to apply to Every jobs site…
2024
Ranked by how close each launch is in meaning, then by votes. Refine with a description →