Alternatives
Products that do what Like grep but for natural questions. Mixtral 8x7B – 28 tok/s on 8GB GPU does
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B. Example: fltr --file emails.txt --prompt "Is the following email spam? Email:" --batch-size 32 It will output all lines in the file where the answer is yes. Text file input tokens per second: - Nvidia RTX 3070 with 8GB memory: Mistral 7B: ~52 tok/s, Mixtral 8x7B: ~28 tok/s - Intel I5-6500 with 8GB memory: Mistral 7B: ~5 tok/s, Mixtral 8x7B: ~2 tok/s Supports: Linux (x86_64) & macOS (x86_64 & arm64)
- 1MA
2020 · mimestream.com
- 2
- 3
- 4
- 5
- 6
- 7
- 8OO
Hello everyone. This is Yujong from the Hyprnote team (https://github.com/fastrepl/hyprnote). We built OWhisper for 2 reasons: (Also outlined in https://docs.hyprnote.com/owhisper/what-is-this) (1). While working with on-device, realtime speech-to-text, we found there isn't tooling that exists to download / run the model in a practical way. (2). Also, we got frequent requests to provide a way to plug in custom STT endpoints to the Hyprnote desktop app, just like doing it with OpenAI-compatible LLM endpoints. The (2) part is still kind of WIP, but…
2025 · docs.hyprnote.com
- 9FI
I found that I am using ChatGPT more and more to get the FFmpeg command I need, but the process can be a bit tedious: copy-pasting commands, dealing with input file names and locations, making sure the prompt contains enough info about the input files. This site attempts to solve that. You just describe what you want to do, pick the input files and an LLM (currently DeepSeek) generates the FFmpeg command. You can then run it directly in your browser or use the command elsewhere.
2025 · vidmix.app
- 10CA
I've always wanted to just upload a whole book to ChatGPT and ask questions. Obviously with the char limit that's impossible... So some buddies and I built Ghost. We have it limited to 5 pages for uploads for now, but plan on expanding the limit soon. Let me know what you guys think!
2023 · ghostextension.com
- 11
- 12
- 13
- 14
- 15SW
[I'm the author] Spall is a web-accessible profiler that I made to help my web-dev friends load gigabyte+ JSON traces without lunch-break-long load times. Recently, Spall got experimental support for auto-tracing with binary traces (along with an in-progress native-port, to give it more memory headroom), which was used to help track down and fix some hard-to-spot lock contention issues in the Odin-language compiler. I demoed it at the Handmade Seattle conference in October, https://guide.handmade-seattle.com/c/2022/spall/, with a head-to-head against Perfetto,…
2023 · gravitymoth.com
- 16
- 17WD
2022 · github.com
- 18
- 19
- 20FE
2021 · forlater.email
- 21TF
I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model. The app has come a long way since then. About a month ago, I added support for 4-bit OmniQuant quantized Mixtral 8x7B Instruct model, and it seems to outperform Q4 models at inference speed and Q8 models at text generation quality, while consuming only about 24GB of RAM[3] at 8k context length. The trick is: a) to use a better quantization algorithm and b) to use unquantized embeddings and the MoE gates (the overhead is quite small). Other notable features include many more…
2024
- 22BA
Bash4LLM is a single-file Bash wrapper for interacting with LLMs from the terminal. I created it because I wanted something simple that worked without installing Python, Node, or any other runtime. It uses only Bash, curl, and jq. You can send prompts, start a small chat, process files line by line, stream output, and save session metadata in JSON format. I tried to make it safe and predictable: no use of the system /tmp, no use of eval. Groq is supported by default, and other providers can be added with dedicated Bash scripts in the extras/providers/ folder. Example: echo…
Jun 2026 · github.com
- 23
- 24WN
2025 · github.com
Ranked by how close each launch is in meaning, then by votes. Refine with a description →