Live Demo of GraphRAG with GPT-4o mini
Hi HN, Microsoft recently open-sourced the GraphRAG framework, which enables more contextual responses than traditional vector-based RAG, especially for summarization-focused queries on textual data. However, a common critique is the LLM costs for constructing the knowledge graph. With the newly released GPT-4o mini, working with GraphRAG would now be ~30x cheaper. We built a demo with quarterly earning call transcripts from a few S&P 100 companies comparing GraphRAG with GPT-4o, GraphRAG with GPT-4o mini, and Baseline RAG. Try out the demo here: https://graphrag-demo.deepset.ai…
What it does
In the maker’s words, at launch
Hi HN, Microsoft recently open-sourced the GraphRAG framework, which enables more contextual responses than traditional vector-based RAG, especially for summarization-focused queries on textual data. However, a common critique is the LLM costs for constructing the knowledge graph. With the newly released GPT-4o mini, working with GraphRAG would now be ~30x cheaper. We built a demo with quarterly earning call transcripts from a few S&P 100 companies comparing GraphRAG with GPT-4o, GraphRAG with GPT-4o mini, and Baseline RAG. Try out the demo here: https://graphrag-demo.deepset.ai Looking forward to your feedback!
Does the same job
all alternatives →
- AOAuto-optimizing deterministic LLM outputs using knowledge graphs2024 · github.com · ▲7
Hi, We are building an open-source framework for loading and structuring LLM context to create accurate and explainable LLM answers using knowledge graphs and vector stores. We built the tool with four main concepts in mind: 1. Loader -> uses dlt in the backend to load and structure the data 2. Cognify step -> creates a graph with summaries, labels and factoids that are interconnected across the documents and stored as a representation in the vector store 3. Optimizer -> Uses DSPy to optimize LLM queries, and we plan to extend it to most of the knobs we can turn, like chunking etc. 4. Search…
- MIMockingbird is an LLM that outperforms GPT4 on RAG2024 · vectara.com · ▲9
Hi HN! I lead product at Vectara and we've just released a new LLM in our platform that outperforms GPT4 and Gemini 1.5 Pro on RAG tasks. Vectara is a Retrieval Augmented Generation (RAG) platform primarily deployed as a SaaS service which includes a generous free tier so you can try it for free. The way we've been able to offer a "better but cheaper" is that we focus a lot of our attention on taking smaller models (which can be hosted in a cost efficient way) and fine tuning them to specific tasks: in this case RAG. This ends up with a model that is less capable of arbitrary tasks like…
- LSLazyGraphRAG: Setting a new standard for quality and cost2024 · microsoft.com · ▲6
This is a big update from the GraphRAG team! Significantly reduces the cost and speeds up indexing for GraphRAG all without much degradation in performance. Check it out!
- ALAn LLM purpose built for data annotation, outperforms GPT-3.52023 · ▲9
Try it out here: https://labs.refuel.ai/playground Refuel LLM (84.2%) outperforms trained human annotators (80.4%), GPT-3-5-turbo (81.3%), PaLM-2 (82.3%) and Claude (79.3%) across a benchmark of 15 text labeling datasets. It is a Llama-v2-13b base model, trained on over 2500 unique datasets (5.24B tokens) spanning categories such as classification, entity resolution, matching, reading comprehension and information extraction.
- MLMinimal LLM Post-Training Experiments on an 8GB GPU (SFT, DPO, GRPO)Aug 2026 · github.com · ▲21
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
Launched alongside, July 2024
the whole month →
- IC
Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.
AI · 2024 · pikimov.com
