Generate Fine-tunning dataset using deep research in terminal
Just open-sourced a small terminal tool I’ve been working on. The idea came from wondering how useful it’d be if you could just describe the kind of dataset you need, and it would go out, do the deep research, and return something structured and usable. You give it a description, and it pulls relevant info from across the web, suggests a schema based on what it finds, and generates a clean dataset. The schema is editable, and it also adds a short explanation of what the dataset covers. In some cases, it even asks follow-up questions to make the structure more useful. Started off as a quick…
Generate Fine-tunning dataset using deep research in terminal launched on August 7, 2025 with 6 votes and more than 75% of that year's launches. The site was still online in September 2026, 1 year on.
What it does
Using deep research workflow to generate datasets for finetuning LLMs. - Oqura-ai/deepresearch-datagen-cli
Oqura's deepresearch-datagen-cli is a terminal tool for generating structured datasets from real-world data using deep research. You describe the kind of dataset you need, and it automatically searches across the web, builds context through multi-step research, suggests a schema, and outputs clean, usable data. It’s built for quick experimentation, training tasks, or anytime you need structured data without manually gathering or formatting it. This diagram shows how the tool takes a user prompt, performs recursive web research, and turns the results into a structured dataset. uv is required to manage the virtual environment and dependencies. You can download it from the official uv GitHub…from github.com
In the maker’s words, at launch
Just open-sourced a small terminal tool I’ve been working on. The idea came from wondering how useful it’d be if you could just describe the kind of dataset you need, and it would go out, do the deep research, and return something structured and usable. You give it a description, and it pulls relevant info from…
Does a similar job
all alternatives →
I built a deep research tool for local file system2025 · github.com · ▲13I was experimenting with building a local dataset generator with deep research workflow a while back and that got me thinking. what if the same workflow could run on my own files instead of the internet. being able to query pdfs, docs or notes and get back a structured report sounded useful. so I made a small terminal tool that does exactly that. I point it to local files like pdf, docx, txt or jpg. it extracts the text, splits it into chunks, runs semantic search, builds a structure from my query, and then writes out a markdown report section by section. it feels like having a lightweight…
Mole – Deep research agent for your terminalAug 2026 · github.com · ▲100Doing research with agents is fun until they blow way past budget, jumble the sources, and don't even give you the best possible answer, just sound confident. And if you want to run some research task on local data - you have no idea where your data ends up after the prompt consumes it. So I built this tool: a deep-research agent with an enforced budget, verified quotes, and a privacy boundary for local data. 1. Never spend more than you budgeted (measured overshoot is 0%). 2. Every claim carries a source 3. Data stays local (give a CSV, it'll analyze it without the data ever leaving your…
Distilling DeepSeek into GPT-OSS doesn't transfer censorship. Try itJul 2026 · ctgt.ai · ▲170We recently used DeepSeek V4 Flash as a teacher for finance tasks with GPT-OSS-120B. Distillation works well on this problem. At a constrained 8k token budget, our self-distilled 120B scores 83.61% on FinanceReasoning, above Kimi K3 (81.93%) and Inkling (65.13%). We released the 20B open weights. With V4 as the teacher though, we realized it would be timely to measure if the censorship characteristic of it transferred to the distilled version of the base model. tl;dr it didn't, the teacher answered politically sensitive questions 7 SDs differently than expected, but the distilled model's…
Data Bonsai: a Python package to clean your data with LLMs2024 · github.com · ▲47I've been doing some data cleaning for my fine tuning projects using LLMs, and decided to just build a package for it as a side project. Check it out here: https://github.com/databonsai/databonsai Some features: - categorization (labelling), transformation and decomposition (text into structured format) - validates llm outputs - batch mode batches up the inputs/outputs so you don't send the prompt (schema, fewshot examples) for every row of data, saving a significant amount of tokens There are some similarities to the Instructor repo, but this is simpler and made for…
Open-source AI data generator (now hosted)2025 · metabase.com · ▲39Hey HN! A few months ago we shared our AI dataset generator as an open source repo, and the response was incredible (https://news.ycombinator.com/item?id=44388093). We got requests from folks who wanted to use it without the hosting overhead, so we created both options: a hosted version (https://www.metabase.com/ai-data-generator for instant use and the source code fully open (https://github.com/metabase/dataset-generator) for anyone who wants to self-host or contribute. Looking forward to seeing how you use it and what you build on top of…
More dev tools this month
the category →
open-source IDE for thoughtful software design. Contribute to devdotfast/whiteboard development by creating an account on GitHub.
Dev tools · 28d ago · github.com
Contribute to reladraw/reladraw development by creating an account on GitHub.
Dev tools · 26d ago · github.com
OpenBot▲362Grok Bot alternative: free, local, open-source, multiplayer
Dev tools · 23d ago · openbot.run
Talanoa▲346Hi HN, I’m a fullstack developer, and honestly, I’ve lost count of how many side projects I’ve worked on over the years. But one idea kept coming back to me: a different kind of email client. It first came to me in 2014: “What if we could handle emails more like conversations?” Every year, I’d revisit this concept in my “Build Notes.” Ten years later, no one had built exactly what I had in mind — so I finally decided to do it myself. That’s how Talanoa was born. I wanted something focused on people, not timelines. I was tired of marking messages as unread just to remember to reply later, or…
Dev tools · 21d ago · talanoa.email
CoreSpeed▲332One MCP for everything your agents need: apps, memory, tools
Dev tools · 28d ago · corespeed.io
Source: Show HN post ↗ · launch text quoted in part
Launched alongside, August 2025
the whole month →
I built the world's most impractical 1000-pixel display and anyone in the world can draw on it. It draws a single pixel at a time and takes 30-60 minutes to complete a single image. Anyone can participate in the project by voting for the next image to be drawn, and submitting images. https://kilopx.com/
Work · 2025 · benholmen.com
Kitten TTS is an open-source series of tiny and expressive text-to-speech models for on-device applications. We are excited to launch a preview of our smallest model, which is less than 25 MB. This model has 15M parameters. This release supports English text-to-speech applications in eight voices: four male and four female. The model is quantized to int8 + fp16, and it uses onnx for runtime. The model is designed to run literally anywhere eg. raspberry pi, low-end smartphones, wearables, browsers etc. No GPU required! We're releasing this to give early users a sense of the latency and voices…
AI · 2025 · github.com
I was wondering how I can arrange objects along a spherical helix path, and read some articles on it. I ended up learning about parametric equations again, and make this visualization to document what I learned: https://visualrambling.space/moving-objects-in-3d/ feel free to visit and let me know what you think!
Life & fun · 2025 · visualrambling.space
For HTML Day 2025 [1], I made a web service that displays the current sky at your approximate location as a CSS gradient. Colours are simulated on-demand using atmospheric absorption and scattering coefficients. Updates every minute, without the use of client-side JavaScript. Source code and additional information is available on GitHub: https://github.com/dnlzro/horizon [1] https://html.energy/html-day/2025/index.html
Dev tools · 2025 · sky.dlazaro.ca