Alternatives
Products that do what Automatically extract data from APIs with dlt and OpenAPI does
Hi Show HN, we are Dave, Marcin, Alena, and Adrian, authors of data load tool (dlt), a Python library that automatically creates datasets from any kind of messy, unstructured data. We launched dlt on HN 7 months ago with a mission to make getting datasets fast and easy. Now dlt helps its users to code around a thousand new data sources each month and to maintain many thousands of live datasets in production. Today we are releasing *dlt-init-openapi,* a Python CLI tool that generates a dlt data pipeline from any OpenAPI spec. It brings the time to create a dataset down to a few minutes.…
- 1DA
Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…
2020
- 2
- 3
- 4
- 5FB
2019 · fastapi.tiangolo.com
- 6
- 7
- 8
- 9SP
Hi HN, Over the past 6 months I've been working on a technical book focused on helping aspiring data scientists to get hands-on experience with cloud computing environments using the Python ecosystem. The book is targeted at readers already familiar with libraries such as Pandas and scikit-learn that are looking to build out a portfolio of applied projects. To author the book, I used the Leanpub platform to provide drafts of the text as I completed each chapter. To typeset the book, I used the R bookdown package by Yihui Xie to translate my markdown into a PDF format. I also used Google docs…
2020
- 10
- 11
- 12
- 13AF
2020 · github.com
- 14
- 15
- 16OD
Hello Hacker News! We are Rick & Yannick from Orchest (https://www.orchest.io - https://github.com/orchest/orchest). We're building a visual pipeline tool for data scientists. The tool can be considered to be high-code because you write your own Python/R notebooks and scripts, but we manage the underlying infrastructure to make it 'just work™'. You can think of it as a simplified version of Kubeflow. We created Orchest to free data scientists from the tedious engineering related tasks of their job. Similar to how companies like Netflix, Uber and Booking.com…
2020
- 17
- 18AC
Hey HN, I have been working in the last weeks on the task of automatically extracting a table of contents from a raw (audio or video) transcript, aka a 'chaptering' task. That turned out to be more difficult than I inially thought, especially because I needed to keep the timestamp data, and because I had to deal with long transcripts, and LLMs tend to 'forget' part of input data when it is too long. I was also surprised that I could not find any open-source solution for that, in standard libraries like Langchain or LLamaIndex, despite the wide range of possible use cases (text summarization,…
2024 · huggingface.co
- 19IA
Hey HN, I wanted to make my life easier by using GPT products that could convert my words to raw MongoDb queries. - Uploading large datasets (50-70GB) in CSV format wasn't feasible for me. - MongoDB does have a "Generate query" feature, but it requires an Atlas subscription. My database is self-hosted. - Plus, I wanted the flexibility to use my own OpenAI API keys instead of paying extra for any GPT-based services available. So, we developed a product that tackles these challenges. It's still a work in progress, but I'd greatly appreciate any feedback.…
2024 · vairflow.ai
- 20DC
Hey HN, A few friends and I have spent the past 6 years or so developing a way to write data transformation code in a way that can easily adapt to changes in logic or data elements both upstream and downstream without the need major refactoring, regression testing, or re-orchestration. We decided to open source the project about two months ago and published a CLI tool after we realized how big of a task it was to take on incumbents like stored procedures, dbt, and psyspark. It is early days for our community and we are looking to grow and engage with others to poke holes and contribute…
2024 · github.com
- 21DO
Hi HN! I am an undergrad student trying to build interesting things with AI. Recently, I was looking for a dataset I could use for a new project. I realized that it is really frustrating to go through all the government websites (with terrible UX) just to find some usable dataset. I set out to build a GitHub for datasets, named DataHub. Right now, we have more than 1000 datasets from Montréal and New York City, with more cities coming soon (and possible government agencies). All of this is wrapped into a powerful search. It's a breeze to find a dataset to work on. I'd be interested to know…
2017
- 22GF
Just open-sourced a small terminal tool I’ve been working on. The idea came from wondering how useful it’d be if you could just describe the kind of dataset you need, and it would go out, do the deep research, and return something structured and usable. You give it a description, and it pulls relevant info from across the web, suggests a schema based on what it finds, and generates a clean dataset. The schema is editable, and it also adds a short explanation of what the dataset covers. In some cases, it even asks follow-up questions to make the structure more useful. Started off as a quick…
2025 · github.com
- 23TF
Hi All! We've spent a few months on getting an MVP together, and would love to get some feedback on whether this tool meets you needs. Here is a link to a demo video: https://www.youtube.com/watch?v=FBLi3vdKB-4&feature=emb_rel_pause Here's a link to our website: https://www.structure.rest And here's a blog article, I published today in the space: https://www.structure.rest/blog/using-a-data-analytics-stack-to-gain-business-insights
2020
- 24IB
TLDR; I built a tool that turns any API into a CLI designed for ai agents --- Got tired of dealing with bloated context windows from MCP servers and skills that stuff entire API docs into the agent's context CLIs fix this, agents run a single command to self-discover everything an API has to offer So, built a tool to generate them for any api. All CLIs are written in Go, fast and lightweight, no dependencies Help text (via the --help flag) is the killer feature: all context for each command/endpoint/parameter is extracted directly from the user-facing API docs and enhanced with…
Mar 2026 · instantcli.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →