Autodistill – Use big slow foundation models to train small fast models

In plain words

Autodistill is an open-source tool that transfers knowledge from large, computationally expensive foundation models to smaller, faster models through a process called distillation. Developers and machine learning engineers use it to create efficient custom models for specific tasks without building from scratch. The software automates the training pipeline, making it practical to deploy specialized models that run quickly on resource-limited devices while maintaining performance comparable to larger models.

written from the facts on this page · September 2026

• 
  Plexe2025 · plexe.ai · ▲273

  Build and deploy ML models in English

• 
  Sweep, Open-weights 1.5B model for next-edit autocompleteJan 2026 · huggingface.co · ▲534

  Hey HN, we trained and open-sourced a 1.5B model that predicts your next edits, similar to Cursor. You can download the weights here (https://huggingface.co/sweepai/sweep-next-edit-1.5b) or try it in our JetBrains plugin (https://plugins.jetbrains.com/plugin/26860-sweep-ai-autocomp...). Next-edit autocomplete differs from standard autocomplete by using your recent edits as context when predicting completions. The model is small enough to run locally while outperforming models 4x its size on both speed and accuracy. We tested against Mercury…

• 
  Autolabel, a Python library to label and enrich text data with LLMs2023 · github.com · ▲153

  Hi HN! I'm excited to share Autolabel, an open-source Python library to label and enrich text datasets with any Large Language Model (LLM) of your choice. We built Autolabel because access to clean, labeled data is a huge bottleneck for most ML&#x2F;data science teams. The most capable LLMs are able to label data with high accuracy, and at a fraction of the cost and time compared to manual labeling. With Autolabel, you can leverage LLMs to label any text dataset with <5 lines of code. We’re eager for your feedback!

• CP
  Curated, Pre-trained ML Models for Transfer Learning2018 · modeldepot.io · ▲324
• 
  TabPFN v2 – A SOTA foundation model for small tabular data2025 · nature.com · ▲153

  I am excited to announce the release of TabPFN v2, a tabular foundation model that delivers state-of-the-art predictions on small datasets in just 2.8 seconds for classification and 4.8 seconds for regression compared to strong baselines tuned for 4 hours. Published in Nature, this model outperforms traditional methods on datasets with up to 10,000 samples and 500 features. The model is available under an open license: a derivative of the Apache 2 license with a single modification, adding an enhanced attribution requirement inspired by the Llama 3 license:…

• 
  Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try itJul 2026 · ctgt.ai · ▲170

  We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.61% on FinanceReasoning, above Kimi K3 (81.93%) and Inkling (65.13%). We released the 20B open weights. With V4 as the teacher though, we realized it would be timely to measure if the censorship characteristic of it transferred to the distilled version of the base model. tl;dr it didn't, the teacher answered politically sensitive questions 7 SDs differently than expected, but the distilled model's…

• 
  SimCity, but with Permits▲934

  A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.

  Life & fun · 3d ago · permit.petercai.com

• IV
  I've been paying for a rural Tanzanian's education for 10 years▲778

  Life & fun · 15d ago · tanzaniaeducationproject.org

• 
  Bigwords.page – Turn any screen into a sign. The URL is the app▲728

  Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.

  Life & fun · 16d ago · bigwords.page

• 
  Guitoro, a virtual guitar you strum with your keyboard▲573

  Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.

  Life & fun · 10d ago · guitoro.com

• 
  See *almost* any carriers phone settings▲432

  Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.

  Life & fun · 14d ago · carrierexplode.com

• 
  The whole Solar System and every tracked satellite, live in the browser▲407

  Life & fun · 24d ago · space.bl2.net

• 
  Non.io, a Reddit-like platform Ive been working on for the last 4 years▲1,943

  Heya HN, I've been working on a reddit-like platform as my primary side project for the last few years. Doing a (very) soft launch today, mainly because I want to use it to encourage discussion of alternatives. How non.io works: 1. Free to browse, paid to interact. 2. Minimum subscription is $2 (though you can choose more). I take $1 to run the servers, everything left gets split evenly between everything you upvote that month. It's a simple model, but I hope it's a better one than the freemium model we've been relying on for the last few years. Fundamentally I feel like any ad-supported…

  Commerce · 2023 · non.io

• 
  Sivi AI▲938

  Generative AI to magically turn text to visual designs

  AI · 2023 · sivi.ai

• 
  Typefully 2.0▲931

  Effortlessly publish on Twitter and LinkedIn, now with AI

  Growth · 2023 · typefully.com

• 
  Olvy 2.0▲826

  Analyze user feedback 10x faster with AI

  AI · 2023 · olvy.co

• 
  SlashPage▲755

  Create websites in seconds to build your first 1K community

  Growth · 2023 · slashpage.com

• 
  Unicorn Platform AI▲751

  Easy to use AI-powered, drag-and-drop website, SAAS landing, directory, and blog builder for startups, mobile apps, and SaaS. 100% no code, no design skills needed.

  AI · 2023 · unicornplatform.com