nowfound

AI · January 22, 2024

RF

Rag Framework

A scalable centralized embeddings platform for efficient embedding and retrieval to build RAG applications faster

Visit github.com ↗Alternatives

Does the same job

all alternatives →
  • WC
    We cut RAG latency ~2× by switching embedding modelNov 2025 · myclone.is · ▲27
  • WA
    Wikipedia2Vec – A tool for learning embeddings of words and entities2018 · wikipedia2vec.github.io · ▲105
  • AU
    A Unified Embed API2014 · embedkit.com · ▲11
  • ET
    [Embedditor] - the Open-source Microsoft Word for Vector Embeddings2023 · github.com · ▲7
  • DA
    Demystifying Advanced RAG Pipelines2023 · github.com · ▲131

    I've built an advanced RAG (Retrieval-Augmented Generation) pipeline from scratch to demystify the complex mechanics of modern LLM-powered Question Answering systems. This repository features: -- An implementation of a sub-question query engine from scratch to answer complex user questions. -- Illustrative explanations that unveil the inner workings of the system. -- An analysis of the challenges I faced while working with the system, like prompt engineering and cost estimation. -- Qualitative comparison with similar frameworks like LlamaIndex, offering a broader perspective. Key Takeaway:…

  • ML
    Model2vec – Lightning-fast Static Embeddings for RAG/Semantic Search2024 · github.com · ▲28

    We’ve recently open-sourced Model2vec, a method to distill sentence transformers into static embeddings that outperform all previous approaches by a large margin on MTEB. Our new models set a new state-of-the-art for static embeddings. Main features: - Our best model (potion-base-8M) has only 8M parameters, which is ~30mb on disk - Inference is ~500x faster than the distilled base model (bge-base), on a CPU - New models can be distilled in 30 seconds on a CPU without requiring a dataset - just a vocabulary - Numpy-only inference: The packaged can be install the package with minimal…

More ai this month

the category →
  • I trained a 125M model to autocomplete piano on-device▲598

    I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute▲585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot▲547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Needle2: 14MB agentic LLM for phones, wearables, smart home and robots▲537

    Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 27d ago · cactuscompute.com

  • Monid▲474

    OpenRouter for agent tools

    AI · 6d ago · monid.ai

  • Clara AI SDR▲460

    Turn website visitors into qualified pipeline

    AI · 19d ago · clarasdr.ai

Launched alongside, January 2024

the whole month →