nowfound

Dev tools · April 18, 2023

DF

Database for analyzing US companies, visualize using Apache SuperSet

My main motivation was that I wanted to be able to drill down and filter across all the available stocks, look at the data for myself, and narrow down on the stocks I am interested based on my own sets of criteria, and make data-driven analysis for my personal investment strategies. I used PostgreSQL as the backend database for ELT data pipelines, and used Citus Data cstore_fdw for columnar compression for the final dataset. All financial data is coming from SEC Edgar, https://www.sec.gov/developer. I used Python for downloading most of the data. I also run the data load…

In plain words

This tool provides a database of US company financial data sourced from SEC Edgar filings, allowing investors to filter and analyze stocks based on custom criteria. Built on PostgreSQL with columnar compression for performance, it uses Python for data processing and Apache Superset for visualization and exploration. The system is designed for individual investors who want to conduct self-directed, data-driven analysis to inform their investment decisions.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

My main motivation was that I wanted to be able to drill down and filter across all the available stocks, look at the data for myself, and narrow down on the stocks I am interested based on my own sets of criteria, and make data-driven analysis for my personal investment strategies. I used PostgreSQL as the backend database for ELT data pipelines, and used Citus Data cstore_fdw for columnar compression for the final dataset. All financial data is coming from SEC Edgar, https://www.sec.gov/developer. I used Python for downloading most of the data. I also run the data load development locally on my home Ubuntu server that I built 5 years ago. I bought 4TB of M2 disks for best database performance, with PRIME B360M-A motherboard and Intel Chip Coffee Lake S. I built the website simply using WordPress, and I run Apache Superset using gunicorn via Apache Webserver reverse proxy. The registration form I had to build myself with PHP and some JavaScript, because it needed to automatically create a SuperSet user upon registration. Otherwise, I would need to input everyone manually. I used Python again for the data integration. Please don't use the database directly as an investment tool, as its in Beta, and the data still needs to undergo heavy data quality checks, please confirm all the numbers yourself, as I provide a link for every company to the SEC filings.

More dev tools this month

the category →
  • Dograh592

    The open source VAPI alternative

    Dev tools · 25d ago · dograh.com

  • Meridian530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 20d ago · meridiona.com

  • x1516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 11d ago · x1.new

  • Open-source GTM skills for technical founders

    Dev tools · 29d ago · gtmcofounder.com

  • OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 1d ago · opentrailpaper.com

  • Nuphos380

    The AI-Native DevOps Workspace.

    Dev tools · 24d ago · nuphos.ai

Launched alongside, April 2023

the whole month →
  • Guidde AI1,478

    Create video documentation instantly with the magic of AI

    AI · 2023 · guidde.com

  • G4

    Hi HN, Today we’re launching GPT-4 answers on Phind.com, a developer-focused search engine that uses generative AI to browse the web and answer technical questions, complete with code examples and detailed explanations. Unlike vanilla GPT-4, Phind feeds in relevant websites and technical documentation, reducing the model’s hallucination and keeping it up-to-date. To use it, simply enable the “Expert” toggle before doing a search. GPT-4 is making a night-and-day difference in terms of answer quality. For a question like “How can I RLHF a LLaMa model”, Phind in Expert mode delivers a…

    AI · 2023 · phind.com

  • Lago1,013

    Open-source alternative to Stripe Billing and Chargebee

    Dev tools · 2023 · getlago.com

  • Fabric696

    Your new home on the internet

    AI · 2023 · fabric.so

  • Chatscout692

    Shopping assistant powered by ChatGPT for e-commerce brands

    AI · 2023

  • Rask AI688

    Say it in any language, AI based, sounds as good as a human

    AI · 2023 · rask.ai