Open-source ETL framework to sync data from SaaS tools to vector stores

In plain words

This open-source ETL framework automates the extraction and transformation of data from SaaS tools like GitHub, Zendesk, and Salesforce into vector store-compatible chunks. It is designed for developers building retrieval-augmented generation applications with large language models. The framework simplifies data pipeline management by handling the repetitive work of extracting, chunking, and preparing content for vector databases and language model context windows.

written from the facts on this page · September 2026

From the sources

In the maker’s words, at launch

Hey hacker news, we launched a few weeks ago as a GPT-powered chatbot for developer docs, and quickly realized that the value of what we’re doing isn’t the chatbot itself. Rather, it’s the time we save developers by automating the extraction of data from their SaaS tools (Github, Zendesk, Salesforce, etc) and helping…

• 
  Open source alternative to ChatGPT and ChatPDF-like AI tools2023 · github.com · ▲234

  Hey everyone, We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools. It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models. Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features. Here are some quick demos: * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s * Chat with documents…

• 
  NLP inside your database2023 · mindshub.ai · ▲343

  Query OpenAI’s GPT-3 from directly inside your database

• 
  No-Code ETL Framework for Vector Databases2024 · github.com · ▲11

  We've open-sourced our no-code ETL framework for Vector Data processing. The VectorETL framework allows Data & AI engineers seamlessly process data from multiple data sources (S3, MySQL, Postgres, Salesforce) to ALL MAJOR vector databases (Pinecone, Weaviate, Qdrant, Milvus etc.) using just a config file. We'd love to get your feedback!

• WM
  We made glhf.chat – run almost any open-source LLM, including 405B2024 · glhf.chat · ▲161

  Try it out! https://glhf.chat/ Hey HN! We’ve been working for the past few months on a website to let you easily run (almost) any open-source LLM on autoscaling GPU clusters. It’s free for now while we figure out how to price it, but we expect to be cheaper than most GPU offerings since we can run the models multi-tenant. Unlike Together AI, Fireworks, etc, we’ll run any model that the open-source vLLM project supports: we don’t have a hardcoded list. If you want a specific model or finetune, you don’t have to ask us for it: you can just paste the Hugging Face link in and…

• 
  DB-GPT, an LLM tool for database2023 · github.com · ▲156

  open-source agentic AI data assistant for the next generation of AI + Data products. - eosphoros-ai/DB-GPT

• GE
  gpt-engineer – platform for devs to tinker with AI programming tools2023 · ▲178

  Hello Hacker News community, Wanted to share a project I started working on during my spare time and was then discovered by many in the open source community last week. GPT Engineer’s mission: Be the open platform for devs to tinker with and build their personal code-generation toolbox. I believe it's key for us devs to engage in how building software can and will change. You can find more info about the flexible technical "philosophy" to make it work well, and the community we want it to become on github: https://github.com/AntonOsika/gpt-engineer The project is still in…

• 
  Spira Maxima▲578

  Video model that turns script into viral social media videos

  AI · 18d ago · spira.ai

• 
  Rill Browser▲540

  The browser where Claude Code and Codex work beside you

  AI · 18d ago · rill.love

• 
  Germany's new sovereign AI model Kolibri▲424

  Kolibri is Aleph Alpha

  AI · 19d ago · tej.as

• 
  Giving Opus 5.5 a simulated paint canvas▲392

  Paintings by AI models: programs run through a simulation of oil paint.

  AI · 21d ago · stillwet.art

• 
  PixVerse R2▲381

  A real-time world model you can explore and change

  AI · 30d ago · world.pixverse.video

• 
  Beam.win▲378

  Run AI agents on one Mac and use its windows on another

  AI · 4d ago · beam.win

• 
  GPT-4▲1,160

  More accurate, less cringe, smoother & useful daily chats!

  AI · 2023 · openai.com

• 
  Collato▲972

  One AI search to find anything instantly, across all apps

  AI · 2023

• 
  Typing Mind▲826

  Chat with AI using your API keys. Pay only for what you use. ChatGPT, Gemini, Claude, and other LLMs supported. The best chat LLM frontend UI for all AI models.

  AI · 2023 · typingmind.com

• 
  Arc for iOS▲825

  Meet the internet again

  Work · 2023 · apps.apple.com

• 
  Sequoia▲726

  Personalized men's sexual health with on-demand experts

  Life & fun · 2023 · sequoia.health

• BI
  BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT▲688

  I'm a big fan of the BBC podcast In Our Time -- and (like most people) I've been playing with the OpenAI APIs. In Our Time has almost 1,000 episodes on everything from Cleopatra to the evolution of teeth to plasma physics, all still available, so it's my starting point to learn about most topics. But it's not well organised. So here are the episodes sorted by library code. It's fun to explore. Web scraping is usually pretty tedious, but I found that I could send the minimised HTML to GPT-3 and get (almost) perfect JSON back: the prompt includes the Typescript definition. At the same time I…

  AI · 2023 · genmon.github.io