nowfound

AI · October 24, 2025

UL

Understanding LLM fundamentals without frameworks

I was using LLM frameworks everywhere but had no idea what was happening inside them. One day I needed to optimize something and realized I couldn't. Hard truth: I didn't understand the fundamentals, just which framework function to call. So I stripped everything away. No abstractions. Just Python, HTTP requests, and the OpenAI/Anthropic APIs. What I found was anticlimactic in the best way: there's almost nothing there. - "AI agents" are just functions the model tells you to call - "Memory" is literally just a list you append to and send back - "RAG" is search, concatenate to prompt,…

What it does

In the maker’s words, at launch

I was using LLM frameworks everywhere but had no idea what was happening inside them. One day I needed to optimize something and realized I couldn't. Hard truth: I didn't understand the fundamentals, just which framework function to call. So I stripped everything away. No abstractions. Just Python, HTTP requests, and the OpenAI/Anthropic APIs. What I found was anticlimactic in the best way: there's almost nothing there. - "AI agents" are just functions the model tells you to call - "Memory" is literally just a list you append to and send back - "RAG" is search, concatenate to prompt, send it off - "Multi-agent systems" are just API calls in sequence It all clicked after that. Not because the patterns are hard. They're not. In fact, they're trivial. They're just buried under layers of abstraction that make them seem hard. I created 7 modules showing the basics: API calls, conversation state, tool calling, RAG, streaming, prompt chaining. Each one is heavily commented, nothing fancy. Side-by-side examples for Claude and GPT so you can see they're fundamentally the same thing. Now when I use frameworks, I actually know if I need them or if I'm just adding bloat. Repo: https://github.com/jmedia65/learn-ai-right

Does the same job

all alternatives →
  • WW
    Why write code if the LLM can just do the thing? (web app experiment)Nov 2025 · github.com · ▲436

    I spent a few hours last weekend testing whether AI can replace code by executing directly. Built a contact manager where every HTTP request goes to an LLM with three tools: database (SQLite), webResponse (HTML/JSON/JS), and updateMemory (feedback). No routes, no controllers, no business logic. The AI designs schemas on first request, generates UIs from paths alone, and evolves based on natural language feedback. It works—forms submit, data persists, APIs return JSON—but it's catastrophically slow (30-60s per request), absurdly expensive ($0.05/request), and has zero UI…

  • AskCodiNov 2025 · ▲230

    Custom LLMs, without training. Use via openai compatible api

  • MU
    Magentic – Use LLMs as simple Python functions2023 · github.com · ▲283

    This is a Python package that allows you to write function signatures to define LLM queries. This makes it easy to mix regular code with calls to LLMs, which enables you to use the LLM for its creativity and reasoning while also enforcing structure/logic as necessary. LLM output is parsed for you according to the return type annotation of the function, including complex return types such as streaming an array of structured objects. I built this to show that we can think about using LLMs more fluidly than just chains and chats, i.e. more interchangeably with regular code, and to make it…

  • TO
  • LS
    LLMWare – Small Specialized Function Calling 1B LLMs for Multi-Step RAG2024 · github.com · ▲51

    Hi, I was a corporate lawyer for many years working with a lot of financial services and insurance companies. In practicing law, I noticed there was a lot of repetition in the tasks I was working on even as a highly paid attorney that could be automated. I wanted to solve the problem of dealing with a lot information and data in a practical way, using AI. This motivated me to start AI Bloks/LLMWare with my husband, who had a deep background in software and is a very early adopter of AI. We have been on this journey with our open source project LLMWare for the past 4 months, producing a…

  • TL

More ai this month

the category →
  • I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.

    AI · 17d ago · simedw.com

  • Astute585

    Automate your B2B brand going viral, with new media creators

    AI · 18d ago · company-app.joinastute.com

  • Grok Bot547

    AI teammates that you can give real work to

    AI · 25d ago · x.ai

  • Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…

    AI · 27d ago · cactuscompute.com

  • Monid474

    OpenRouter for agent tools

    AI · 6d ago · monid.ai

  • Turn website visitors into qualified pipeline

    AI · 19d ago · clarasdr.ai

Launched alongside, October 2025

the whole month →
  • Our first coding model and new interface for agents

    AI · Oct 2025 · cursor.com

  • Flask806

    Notion + Loom, for video collaboration.

    AI · Oct 2025 · flask.do

  • SA

    I went down the rabbit hole on a side project and ended up building this: Strange Attractors(https://blog.shashanktomar.com/posts/strange-attractors). It’s built with three.js. Working on it reminded me of the little "maths for fun" exercises I used to do while learning programming in early days. Just trying things out, getting fascinated and geeky, and being surprised by the results. I spent way too much time on this, but it was extreme fun. My favorite part: someone pointed me to the Simone Attractor on Threads. It is a 2D attractor and I asked GPT to extrapolate it to…

    AI · Oct 2025 · blog.shashanktomar.com

  • Orchestra794

    A chat-centric workspace for builders and modern teams

    Work · Oct 2025 · orch.so

  • AS

    Hey all, I built this. It’s not trying to capture every autistic experience (that’d be impossible). It’s based on my own lived experience as well as that of friends on the spectrum. I'm trying to give people a feel for what masking, decision fatigue, and burnout can look like day-to-day. That’s hard to explain in words, but easier to show through choices and stats. I'm not trying to "define autism". I’ve gotten good feedback here about resilience, meds, and difficulty tuning. I’ll keep tweaking it. If even a few people walk away thinking, "ah, maybe that’s why my coworker struggles in those…

    Life & fun · Oct 2025 · autism-simulator.vercel.app

  • Director768

    Lovable for web automation

    AI · Oct 2025 · director.ai