Interactively explore unstructured datasets from your dataframe
Hey HN, We built a library to interactively explore unstructured datasets directly from a dataframe: https://github.com/Renumics/spotlight Some background: We have worked on different ML solutions over the years, mainly in the industrial AI space. A crucial step for us is always to inspect and explore the data interactively with the team and the customer. This is true throughout the dev process: During EDA, model debugging, model comparison and monitoring. We have tried many different options for visualizing unstructured datasets in the past: Notebooks, dash apps, custom…
What it does
In the maker’s words, at launch
Hey HN, We built a library to interactively explore unstructured datasets directly from a dataframe: https://github.com/Renumics/spotlight Some background: We have worked on different ML solutions over the years, mainly in the industrial AI space. A crucial step for us is always to inspect and explore the data interactively with the team and the customer. This is true throughout the dev process: During EDA, model debugging, model comparison and monitoring. We have tried many different options for visualizing unstructured datasets in the past: Notebooks, dash apps, custom react apps, HTML reports... However, these options were either very time-consuming to develop/maintain or not interactive enough or both. Our goal with Spotlight is to provide visualization for multimodal data with one line of code. Currently, Spotlight supports most unstructured data types including images, audio, text, videos, time-series and geometric data. We like the Huggingface tooling and have a first integration for HF datasets. An immediate step on our roadmap is to improve this integration. You can find more info and use case examples for ML and engineering workflows in the repo.
Does the same job
all alternatives →
- DAdstack – an open-source tool to build data applications easily2020 · ▲134
Dear HN, I am Riwaj, the cofounder of dstack.ai (https://github.com/dstackai). A few months ago, we built an online service that allows users to publish data visualizations from Python or R. The idea was to build a tool that did not require additional programming or front-end development for publishing data visualizations. Such a code can be invoked from either Jupyter notebook, RMarkdown, Python, or R scripts. Once the data is pushed, it can be accessed via a browser. Open-sourcing dstack: During our customer discovery phase, we realized that dstack.ai should integrate a lot…
- VOVaex - Out of Core Dataframes for Python and Fast Visualization2018 · medium.com · ▲126
- RSRenumics Spotlight – Multimodal exploration tool for your datasets2023 · renumics.com · ▲6
Hey HN! We just released the open-source version of Renumics Spotlight, a data exploration and analysis tool for multimodal datasets. Spotlight integrates seamlessly with pandas and supports rich data types like images, videos, and meshes. You can load anything that fits in a DataFrame and view it through a customizable GUI featuring multiple interactive widgets: a data table, similarity map, histograms, scatter plots, and more. In the past, we have used Spotlight for exploratory data analysis and tackling various model and data-related problems in our machine learning projects. What are…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
