spark cli
One bash script to set up and serve LLMs on DGX Spark
What it does
A single Bash script that automates the full DGX Spark lifecycle from your laptop. One command to set up everything (Docker, NGC, Tailscale, SSH, vLLM). One command to serve any model with auto-detected optimal flags (e.g. reasoning), tool-calling, context, multimodal, MoE, GPU memory. Zero dependencies: just bash and curl.
Does the same job
all alternatives →- BABash4LLM+ – A lightweight, dependency-free Bash wrapper for LLM APIsJun 2026 · github.com · ▲60
Bash4LLM is a single-file Bash wrapper for interacting with LLMs from the terminal. I created it because I wanted something simple that worked without installing Python, Node, or any other runtime. It uses only Bash, curl, and jq. You can send prompts, start a small chat, process files line by line, stream output, and save session metadata in JSON format. I tried to make it safe and predictable: no use of the system /tmp, no use of eval. Groq is supported by default, and other providers can be added with dedicated Bash scripts in the extras/providers/ folder. Example: echo…
- MLMy LLM CLI tool can run tools now, from Python code or plugins2025 · simonwillison.net · ▲529
- PLPrompting LLMs in Bash scripts2025 · elijahpotter.dev · ▲79
https://github.com/elijah-potter/ofc
- BMBash-My-AWS – CLI Commands for AWS2019 · bash-my-aws.org · ▲155
- OROllama – Run LLMs on your Mac2023 · github.com · ▲284
Hi HN A few folks and I have been working on this project for a couple weeks now. After previously working on the Docker project for a number of years (both on the container runtime and image registry side), the recent rise in open source language models made us think something similar needed to exist for large language models too. While not exactly the same as running linux containers, running LLMs shares quite a few of the same challenges. There are "base layers" (e.g. models like Llama 2), specific configuration to run correctly (parameters, temperature, context window sizes etc). There's…
- NDNixOS-DGX-Spark – Nix and NixOS on the DGX SparkAug 2026 · github.com · ▲132
Try DGX Spark playbooks using Nix on DGX OS, or install NixOS on your DGX Spark for the full Nix experience. The repository provides USB images and a NixOS module with settings for DGX Spark systems. This works on the NVIDIA DGX Spark itself and also on the Asus Ascent GX10. See my 5 minute lightning talk from Planet Nix for an intro: https://youtu.be/AvK_gi_snJE?si=MPKv3iiuS9B5elIE
More dev tools this month
the category →
The first open-source price index for GPU compute
Dev tools · 10d ago · getcomputable.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 2d ago · opentrailpaper.com
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
Launched alongside, May 2026
the whole month →
Parallel agents, diff reviewer, and multi-model comparisons
Dev tools · May 2026 · kilo.ai
- NW
Hey HN, Henry here from Cactus. We open-sourced Needle, a 26M parameter function-calling (tool use) model. It runs at 6000 tok/s prefill and 1200 tok/s decode on consumer devices. We were always frustrated by the little effort made towards building agentic models that run on budget phones, so we conducted investigations that led to an observation: agentic experiences are built upon tool calling, and massive models are overkill for it. Tool calling is fundamentally retrieval-and-assembly (match query to tool name, extract argument values, emit JSON), not reasoning. Cross-attention…
Life & fun · May 2026 · github.com
- FM
Dev tools · May 2026 · github.com