secinsights.ai – An open-source full-stack app using LlamaIndex
Hi HN, A few weeks ago, we stealth launched SEC Insights on Product Hunt and were thrilled to reach the top 5! What is SEC Insights? It harnesses the Retrieval Augmented Generation (RAG) capabilities of LlamaIndex to provide answers about SEC 10-K & 10-Q documents. The enthusiastic reception we received on Product Hunt prompted us to open-source our project. Now, developers can use our project either as a reference or they can fork it entirely for their LLM-powered applications. We at LlamaIndex built this to help developers move their LLM app ideas from prototype to production. We're very…
What it does
In the maker’s words, at launch
Hi HN, A few weeks ago, we stealth launched SEC Insights on Product Hunt and were thrilled to reach the top 5! What is SEC Insights? It harnesses the Retrieval Augmented Generation (RAG) capabilities of LlamaIndex to provide answers about SEC 10-K & 10-Q documents. The enthusiastic reception we received on Product Hunt prompted us to open-source our project. Now, developers can use our project either as a reference or they can fork it entirely for their LLM-powered applications. We at LlamaIndex built this to help developers move their LLM app ideas from prototype to production. We're very open to feedback, Github issues, and PRs! Also, keep an eye on our YouTube page for a walkthrough and setup tutorial we have in the works! https://www.youtube.com/@LlamaIndex
Does the same job
all alternatives →- TOTraceAIO – open-source LLM visibility trackerJun 2026 · traceaio.org · ▲6
I built TraceAIO, an open-source tool that prompts LLMs on your behalf and tells you whether ChatGPT, Perplexity, and Gemini mention your brand — and which competitors and sources show up instead. Yeah, this category smells a bit like a grift, same as early SEO. And I think over time it will become just SEO again, and become about good content. The tool just helps you monitor over time. It queries the browser products through real browser sessions, not APIs, runs on Docker, with an MCP server so you can query your own data through an LLM. No business model, Apache 2.0, self hosted. If you…
- LRLlm.report – Open-source logging and analytics for OpenAI2023 · github.com · ▲6
Hi hacker news, My name is Dillion and I'm the creator of llm.report. A few months ago, I was frustrated by the lack of observability into the OpenAI API. All of us are left in the dark about API performance, latency, cost calculation, cost breakdown, and more. I just wanted to know more about how my AI app is performing in production and make data-driven decisions to improve the product. So I ended up just building it myself. There are three parts to the platform: 1. OpenAI API Dashboard (no-code) - Enter your OpenAI key and get access to detailed insights straight from the OpenAI API…
- NLN0x – LLM inference, agents, RAG, Python exec in browser, no back endMar 2026 · n0xth.vercel.app · ▲9
Built this because I was tired of every AI tool shipping my data to someone else server n0x runs the full stack LLM inference via WebGPU, autonomous ReAct agents, RAG over your own docs, sandboxed Python execution via Pyodide all inside a single browser tab. No account No keys No backend Models download once, cache in IndexedDB permanently. Biggest challenge was context window budgeting for the agent loop and making the WASM vector search non-blocking. Happy to talk architecture. GitHub: https://github.com/ixchio/n0x | Live demo: https://n0x-three.vercel.app
- ACA collection of AI Apps built with open-source tools2023 · github.com · ▲8
Hi HN, we're Ashpreet, Eli and Yash and we're excited to share Phidata: a collection of AI Apps built with open-source tools. While helping teams build AI products, we built templates for spinning up LLM Apps quickly. Today we're open-sourcing our templates for building: - RAG LLM Apps - Autonomous LLM Apps - Multimodal LLM Apps - Data Engineering LLM Apps Templates are built with FastApi for serving, Streamlit for prototyping, PgVector for vectors and PosgreSQL for storage. Run them locally using docker and in production on AWS - with 1 command. - Github:…
- IBI built a tool to find the best and cheapest LLM models for my projects2024 · viewpointhq.com · ▲5
Hey HN, I've been working on something cool that I wanted to share with you all. It's called Viewpoint, an analytics tool for LLMs like OpenAI, Anthropic models, and Gemini. The idea came from the constant flood of new LLM models and the need to figure out which ones work best for my projects without breaking the bank. With viewpoint, I can track token usage, costs, latency(WIP), and traffic over time, making it easier to compare different models and see which ones perform best and save money. The tool works asynchronously, so it doesn't add any latency to your LLM requests, and you have…
- MYMonitoring your OpenAI usage without a third party2023 · github.com · ▲9
LLM observability is an absolute must-have for anyone running something in prod (or prod-like). While all the observability startups are great, you're essentially sending all your OpenAI usage history - prompts, generations, chats - to a random third party. So this script deploys a basic proxy in your Azure account, catches all incoming OpenAI requests, stores logs in your own resource group, and comes with visualizations premade (charts, timelines, chat history, cost estimation, etc). Thanks for any thoughts and feedback!
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 27d ago · cactuscompute.com
