AI · alternatives · 2026
24 alternatives to Ollama server discovery tool (finds public LLM instances)
I built a network discovery tool in Rust that helps identify public Ollama LLM servers. It scans IP ranges to find Ollama instances and catalogs their available models. Important note: This is intended for educational purposes and authorized security testing only.
Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes.
- 1
Ollama v0.19▲410Massive local model speedup on Apple Silicon with MLX
Apr 2026 · ollama.com · its alternatives →
- 2
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
2023 · github.com · its alternatives →
- 3
- 4OS
Complete AI Platform: RAG Systems & Intelligent Agents for Local AI
2025 · rlama.dev · its alternatives →
- 5
SeekStorm: vector & lexical search - in-process library & multi-tenancy server, in Rust. - SeekStorm/SeekStorm
2024 · github.com · its alternatives →
- 6
- 7
tunnelto.dev▲186Expose localhost to the internet with a public URL
2020 · tunnelto.dev · its alternatives →
- 8
If you've built any web-based app in the last 15 years, you probably used something like Datadog, New Relic, Sentry, etc. to monitor and trace your app, right? Why should it be different when the app you're building happens to be using LLMs? So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js A few months ago we launched…
2024 · github.com · its alternatives →
- 9
I'm a software engineer who keeps getting pulled into DevOps no matter how hard I try to escape it. I recently moved into a Lead DevOps Engineer role writing tooling to automate a lot of the pain away. On my own time outside of work, I built Artifact Keeper — a self-hosted artifact registry that supports 45+ package formats. Security scanning, SSO, replication, WASM plugins — it's all in the MIT-licensed release. No enterprise tier. No feature gates. No surprise invoices. Your package managers — pip, npm, docker, cargo, helm, go, all of them — talk directly to it using their native…
Feb 2026 · github.com · its alternatives →
- 10
Open source APM: OpenTelemetry traces, metrics, and logs - uptrace/uptrace
2021 · github.com · its alternatives →
- 11
hey guys, wanted to show one of my side projects i just made public. the idea is basically another osint tool for pentesters and bug bounty hunters. it watches certificate transparency logs and checks newly-seen domains for exposed stuff like .env files, open .git dirs, config files, db dumps and so on, and puts whatever it finds into a searchable db. you just search a domain (or part of one) and see what's exposed. it's read-only and free. one thing i've been thinking about adding is a way to register for certain keywords and get notified when something new shows up for that search. would…
Jul 2026 · search.cerast-intelligence.com · its alternatives →
- 12
allocscope - a memory tracking tool. Contribute to matt-kimball/allocscope development by creating an account on GitHub.
2023 · github.com · its alternatives →
- 13
Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS - matanolabs/matano
2022 · github.com · its alternatives →
- 14
G'day, HN! I'm one of the maintainers of `llm`. I've been working alongside a trusty group of contributors to bring this project to life, and we're now at a point where we're ready to share it with the world. Large language models (LLMs) are taking the computing world by storm due to their emergent abilities that allow them to perform a wide variety of tasks, including translation, summarization, code generation, and even some degree of reasoning. However, the ecosystem around LLMs is still in its infancy, and it can be difficult to get started with these models. `llm` is a one-stop shop for…
2023 · github.com · its alternatives →
- 15
Hi HN! I built RustNet, a Terminal UI based network monitor written in Rust that shows real-time connections with process identification and protocol detection. What may make it interesting: • Deep packet inspection for HTTP, HTTPS/TLS (with SNI), DNS, and QUIC protocol detection • Process identification using eBPF on Linux (experimental) and PKTAP on macOS which does also catch short-lived processes that polling procfs or lsof would miss • Multi-threaded packet processing with lock-free data structures for the UI • Cross-platform (Linux, macOS, Windows but process identification so far…
2025 · github.com · its alternatives →
- 16
Ollama Cloud is a Highly Scalable Cloud-native Stack for Ollama - ollama-cloud/get-started
2024 · github.com · its alternatives →
- 17
kubectl port-forward manager and reverse tunnel (ngrok-like) for exposing local services publicly, with TLS termination, HTTP traffic inspection, UDP forwarding, multi-hop proxy routing through k8s clusters, stateful config via filesystem or git - GUI and TUI available - hcavarsan/kftray
2024 · github.com · its alternatives →
- 18
Current AI-assisted CLI tools are often part of larger systems and work better on Linux. I built llm-term to address these. It's a Rust-based tool that compiles into a single binary file. You only need to download the binary, add it to your PATH, and configure your OpenAI key to get started. While llm-term offers an option for gpt-4o, it works great with gpt-4o-mini. So it's not costly. I appreciate any feedback or suggestions.
2024 · github.com · its alternatives →
- 19
Lately, I've been tinkering with llama.cpp and the ollama server. The speed of these tools caught my attention, even on my modest 4060 setup. I was quite impressed with the generation quality of models like Mistral. But I was a bit unhappy at the same time because whenever I explore a topic, there is a lot of typing involved when using the chat interface. So I needed a tool to not only give a response but also generate a set of "suggestions" which can be explored further just by clicking. My experience in front-end development is limited. Nonetheless, I tinkered together a small web app to…
2023 · github.com · its alternatives →
- 20AT
I recently built a small open-source tool to benchmark different LLM API endpoints — including OpenAI, Claude, and self-hosted models (like llama.cpp). It runs a configurable number of test requests and reports two key metrics: • First-token latency (ms): How long it takes for the first token to appear • Output speed (tokens/sec): Overall output fluency Demo: https://llmapitest.com/ Code: https://github.com/qjr87/llm-api-test The goal is to provide a simple, visual, and reproducible way to evaluate performance across different LLM providers, including…
2025 · llmapitest.com · its alternatives →
- 21
Find the right local AI model for your hardware instantly
Feb 2026 · ollama-explorer.vercel.app · its alternatives →
- 22
Employ your built-in wetware pattern recognition and signal processing facilities to understand your network traffic - vvilhonen/nethoscope
2021 · github.com · its alternatives →
- 23
Alternative to magic.h and infer. Zero dependencies. Fully extensible. Works in no_std, async, and embedded contexts.
2025 · crates.io · its alternatives →
- 24
📶 Troubleshoot problems with your Internet connection - jesusprubio/up
2019 · github.com · its alternatives →
Also compare
Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →