Dstack – a command-line utility to provision infra for ML workflows
Hi. :) I’m Andrey, the creator of dstack. I started this project while I was working at JetBrains where I helped the PyCharm team to improve support for Jupyter notebooks. As I was in close contact with many ML devs (who used PyCharm) I was able to see their struggle with running ML workflows. Unlike traditional dev workflows, ML workflows are difficult to run on a local machine (due to the lack of memory, more CPUs/GPUs, etc). This is why people often have to use remote machines (e.g. via SSH), or adopt one of the end-to-end MLOps platforms. Using remote machines is not difficult but…
What it does
In the maker’s words, at launch
Hi. :) I’m Andrey, the creator of dstack. I started this project while I was working at JetBrains where I helped the PyCharm team to improve support for Jupyter notebooks. As I was in close contact with many ML devs (who used PyCharm) I was able to see their struggle with running ML workflows. Unlike traditional dev workflows, ML workflows are difficult to run on a local machine (due to the lack of memory, more CPUs/GPUs, etc). This is why people often have to use remote machines (e.g. via SSH), or adopt one of the end-to-end MLOps platforms. Using remote machines is not difficult but it is tedious and requires a lot of manual actions. Using MLOps platforms on the other hand automates the manual work but requires the use of an opinionated interface, which often kills developer productivity. Imagine, if you could run your ML workflows the very same way as you do it locally, but they would actually run in the cloud. And you wouldn’t need to worry about provisioning infrastructure, setting up the environment, etc. I’m excited to show you dstack, an open-source tool that does exactly that. It’s a command-line utility that allows you to run any workflows while it provisions infrastructure, setup the environment, and copies code/data for you. No need to install or configure anything in your environment or cloud. Simply install the CLI and run it. The launch blog post: https://mlopsfluff.dstack.ai/p/simplifying-the-mlops-stack We’d love to hear your thoughts and ideas. I’ll be here to answer any questions you might have.
Does the same job
all alternatives →- DAdstack – an open-source tool to build data applications easily2020 · ▲134
Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…
- PIParabola.io – Automate your work with visual programming2018 · parabola.io · ▲291
Hi HN! I’m Alex from Parabola (https://parabola.io). Parabola is a visual programming tool for creating functional data flows that everyone can use. It’s entirely drag-and-drop, handles data sizes much larger than a traditional spreadsheet, calculates everything live, and can run your flows on a schedule of your choosing. I used to work in strategy consulting, doing data analytics for SMBs and Fortune 500 companies. The amount of time wasted on menial tasks was astounding. Things like cleaning data, generating custom reports, creating human workflows to solve shortcomings in third…
- IMI'm building a simple way to package, collaborate, and deploy ML models2024 · kitops.ml · ▲9
Heya HN, after spending +1 year building an ML-driven analytics product (that didn't pan out unfortunately), I've pivoted to solving a problem my team and I found while building the previous product … why the hell is it so hard to move a model from a Jupyter notebook, to a development server, then to a production pipeline!? To solve this my team and I started the open source KitOps project under the Apache 2 license. KitOps includes the Kit CLI that uses a Kitfile manifest to create ModelKits: 1. The kit CLI packages your model, datasets, code, and configuration into an OCI compliant…
More work this month
the category →
The app store for voice native apps that lives in your notch
Work · 28d ago · voiceos.com
The New Calendly▲211Handle all of the work before, during, and after meetings
Work · 17d ago · calendly.com
Launched alongside, October 2022
the whole month →- I3
Hey HN, I 3d scanned the interior of the Great Pyramid / Khufu's pyramid for the Giza Project this summer and just finished the guided version to share. Would love feedback and/or problems you encounter. I used both a Leica BLK 360 and Matterport Pro 2 to do the scanning and the Matterport SDK for the web viewer. Matterport's web display with Three.js has been the most accessible to a wide audience in the past (previous iterations are in Unity and Unreal, but difficult to download over slower connections). I've been interviewing social studies teachers around the 6th grade level to…
Dev tools · 2022 · giza.mused.org
- RO
Last time I posted this it didn't garner much interest. There have been lots of improvements and fixes since the last release. Quick list of features: - Workspaces - Tabs - Nested Folders - Lots of context menus - Response history - Plugins - Runs fully in the browser and runs offline if necessary - Chrome and Firefox extension to bypass CORS restrictions - Desktop builds for all platforms - GraphQL support - Import collections exported from Postman and Insomnia - Simple user friendly interface I built this because I love Insomnia but wanted a portable version that I could run in the…
Dev tools · 2022 · restfox.dev
Micro SaaS HQ▲672Profitable Micro SaaS ideas, supportive community
Life & fun · 2022 · microsaashq.com
- AR
APIs are a little like the open road—always waiting, full of opportunity, but hardly utilized. So here’s America, composed of several APIs that paint a vivid, real-time picture of a good old-fashioned road trip. Get local classifieds and photos. Tune into local radio stations. Talk wit other drivers. And more. Exploring the country by car was an invaluable experience for me during my time in the states. I’ve since moved to Barcelona, and find myself missing the territory. This is my attempt at recreating the magic.
Life & fun · 2022 · 4m3ric4.com