nowfound

AI · September 11, 2024

PaperQA2, Agentic RAG for Science

We're excited to release PaperQA2, an open source RAG library specialized to work with the scientific literature. We've seen some really compelling results with it (https://paper.wikicrow.ai), like superhuman performance at question answering and summarization when compared with expert scientists. PaperQA2 is a major overhaul of our prior PaperQA system, it includes automatically obtained rich metadata for each paper, a CLI to work with local papers directly, a local full-text search engine for keywords searches over PDF files, a state-of-the-art algorithm for LLM-based re-ranking…

PaperQA2, Agentic RAG for Science launched on September 11, 2024 with 8 votes, #1,619 of 5,281 launches that month and more than 75% of that year's launches. The site was still online in September 2026, 2 years on.

What it does

High accuracy RAG for answering questions from scientific documents with citations - Future-House/paper-qa

In the maker’s words, at launch

We're excited to release PaperQA2, an open source RAG library specialized to work with the scientific literature. We've seen some really compelling results with it (https://paper.wikicrow.ai), like superhuman performance at question answering and summarization when compared with expert scientists. PaperQA2…

Does a similar job

all alternatives →
  • Paperguide2024 · paperguide.ai · ▲645

    Discover, read, write and manage research with ease using AI

  • FastGraphRAG – Better RAG using good old PageRank2024 · github.com · ▲457

    Hey there HN! We’re Antonio, Luca, and Yuhang, and we’re excited to introduce Fast GraphRAG, an open-source RAG approach that leverages knowledge graphs and the 25 years old PageRank for better information retrieval and reasoning. Building a good RAG pipeline these days takes a lot of manual optimizations. Most engineers intuitively start from naive RAG: throw everything in a vector database and hope that semantic search is powerful enough. This can work for use cases where accuracy isn’t too important and hallucinations are tolerable, but it doesn’t work for more difficult queries that…

  • Turn any website into a knowledge base for LLMs2024 · embedding.io · ▲305

    I built this tool because I wanted a way to just take a bunch of URLs or domains, and query their content in RAG applications. It takes away the pain of crawling, extracting content, chunking, vectorizing, and updating periodically. I'm curious to see if it can be useful to others. I meant to launch this six months ago but life got in the way...

  • Talk to any ArXiv paper just by changing the URL2023 · github.com · ▲194

    Hello HN, Talk2Arxiv is a small open-source RAG application I've been building for a few weeks. To use it just prepend any arxiv.org link with 'talk2' to load the paper into a responsive RAG chat application (e.g. www.arxiv.org/abs/1706.03762 -> www.talk2arxiv.org/abs/1706.03762). All implementation details are in the GitHub. Currently, because I've opted to extract text from the PDF of the paper rather than reading the LaTeX source code (since I wanted to build a more generic PDF RAG in the process), it struggles with symbolic text / mathematics, and sometimes fails…

  • Demystifying Advanced RAG Pipelines2023 · github.com · ▲131

    I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…

  • Deep search of all ML papers2024 · app.undermind.ai · ▲109

    Built an automated system to run a deep search of ArXiv and carefully find all the precise papers that exist on a complex topic. It's different from simple RAG because it searches, classifies, and adapts based on relevant papers it uncovers, and then continues until it finds every paper on a topic (trying to mimic the human research process). Benchmarked 10x higher accuracy and total retrieval compared to Google Scholar for a median search (whitepaper on website). Also knows when it is complete, and misses virtually nothing (< 3% or so, once it's converged). Website has a free trial and a…

More ai this month

the category →
  • Video model that turns script into viral social media videos

    AI · 18d ago · spira.ai

  • The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Paintings by AI models: programs run through a simulation of oil paint.

    AI · 21d ago · stillwet.art

  • A real-time world model you can explore and change

    AI · 30d ago · world.pixverse.video

  • Beam.win▲378

    Run AI agents on one Mac and use its windows on another

    AI · 4d ago · beam.win

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, September 2024

the whole month →
  • Wispr Flow▲2,732

    Speak naturally, write perfectly & 3x faster in every app

    AI · 2024 · wisprflow.ai

  • Pathway▲1,335

    Get user insights 10x faster

    Work · 2024 · wynde.io

  • Personalized AI daily planning that suits your life

    AI · 2024 · beforesunset.ai

  • Osmos▲1,194

    Match with like-minded professionals for 1:1 conversations

    Growth · 2024

  • Carrot Care▲1,168

    Understand & optimise your bloodwork

    Life & fun · 2024 · carrotcare.health

  • Polar▲1,167

    An open source monetization platform for developers

    Dev tools · 2024 · polar.sh