Omnifact – Self-Hosted, Privacy-First AI Platform for Enterprise
Hi HN, we're Patrick and Florian, and we created Omnifact out of frustration with the underwhelming impact of AI on business productivity. After working with large companies struggling to adopt AI in a meaningful way due to data privacy concerns and vendor lock-in, we decided to build the platform we wished we had. Omnifact is designed for organizations that want to make use of generative AI and RAG without compromising data security or flexibility. Here's the tech breakdown: - Deployment Flexibility: Omnifact can be used as a SaaS in our Azure-based cloud, deployed within a company's…
What it does
In the maker’s words, at launch
Hi HN, we're Patrick and Florian, and we created Omnifact out of frustration with the underwhelming impact of AI on business productivity. After working with large companies struggling to adopt AI in a meaningful way due to data privacy concerns and vendor lock-in, we decided to build the platform we wished we had. Omnifact is designed for organizations that want to make use of generative AI and RAG without compromising data security or flexibility. Here's the tech breakdown: - Deployment Flexibility: Omnifact can be used as a SaaS in our Azure-based cloud, deployed within a company's private cloud infrastructure, or even in completely air-gapped environments in combination with a self-hosted LLM. - Your Data Stays Yours: Omnifact protects customer data from third parties. Documents are processed locally using Omnifact's data ingestion and embedding model. Additionally, sensitive information is masked before interacting with public LLMs via our privacy filter (custom AI model). - LLM Agnostic: We support OpenAI, Anthropic, Google, Mistral, or any locally hosted open-source LLM (e.g., Llama 3.1 70B). Switching between providers and models is easy and can be done as needed. What's different about Omnifact? Omnifact is built with a focus on ease-of-use, security, and adaptability: - Usability is Key: Our goal is to make the UI easy for both technical and non-technical users to create and manage AI assistants. - Privacy by Design: Omnifact offers granular control over data access and ensures compliance with even the strictest data privacy regulations. - Future-Proof Foundation: The LLM-agnostic architecture allows companies to leverage the latest AI advancements without vendor lock-in. Give it a spin at https://omnifact.ai Let us know what you think! Feel free to email us at [email protected] as well. Our Vision: We're not just building a platform for creating AI assistants, though. Our goal is to empower organizations to gradually move from simple AI augmentation to end-to-end automation. Starting with secure and private RAG, the vision is to build towards a future where AI can automate complex workflows, seamlessly integrating with existing systems and data. We believe that a robust, privacy-first platform, deployable locally within an organization's infrastructure, is an important building block for this future of AI automation. Previous HN discussions: - https://news.ycombinator.com/item?id=39952114 - Ask HN: Recommendations for Local LLMs in 2024: Private and Offline? - https://news.ycombinator.com/item?id=40948971 & https://news.ycombinator.com/item?id=40837081 - Goldman Sachs on the lack of ROI for AI (due to the lack of enterprise automation..)
Does the same job
all alternatives →
- WMWe made our CRM/ERP platform open-source thanks to AI2025 · github.com · ▲6
We've recently made our product, ozma.io, open-source. It's a CRM/ERP platform for building enterprise systems. We believe that AI will soon handle implementing most of the boilerplate and UIs in the specialized business software. Just look at what lovable.dev does today! Soon products which make creating business software easier for developers will become obsolete, or transform into "libraries" to be used by AIs. We are losing this race, so we go the second route — publish everything and go on building other products on top of it. GitHub repo URL:…
- WBWe built a powerful and free AI research assistant2024 · join.modularmind.app · ▲7
Hi everyone, We have been developing a platform to enable professionals to build AI assistants to help them through their work. After a few months, we realized people are trying to sell basic functionalities that can be built from scratch in a couple of hours. Due to this, individuals who are not familiar with the current SOTA are misinformed about the potential of generative models. So, we decided to open up some of our most popular templates as standalone tools for free to empower individuals and set a solid standard for what people should expect. We believe the barrier to accessing…
Maritime, a platform for running AI agents for $1 a month18d ago · maritime.sh · ▲8Hi HN, my name is Maria, and I’m a co-founder of Maritime. We started Maritime at MIT to build infrastructure for companies that need to run thousands of isolated AI agents for their customers. Imagine you set up an agent like OpenClaw, or a personal assistant agent with a custom framework, and want to give a separate version of it to every customer/friend. Each customer needs their own agent running in an isolated microVM, with persistent state, secrets, triggers, and sleep/wake behavior. Building such scalable and secure infra will take you months and will cost hundreds of…
- WBWe built a product to help companies reduce AWS/GCP/Azure spend by 50%2024 · ▲5
Hey HN: Kaveh here, founder of https://www.usage.ai/ We help companies drive down AWS, GCP, and Azure spend. Why? Because the way it's done now is a pain. DevOps and Software Engineers end up spending time managing costs rather than focusing on business problems. I have been building Usage AI for almost 4 years now (4 year anniversary in 1 month from now!) with an incredible group of founding people. We started as a product just to help lower AWS EC2 costs, and now we do all major AWS services (such as RDS, OpenSearch, ElastiCache, and Redshift with more on the way) and other…
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
Launched alongside, August 2024
the whole month →
- IY
Life & fun · 2024 · ytch.xyz
- IA
Hey there HN! We’re Joe and Stopa, and today we’re open sourcing InstantDB, a client-side database that makes it easy to build real-time and collaborative apps like Notion and Figma. Building modern apps these days involves a lot of schleps. For a basic CRUD app you need to spin up servers, wire up endpoints, integrate auth, add permissions, and then marshal data from the backend to the frontend and back again. If you want to deliver a buttery smooth user experience, you’ll need to add optimistic updates and rollbacks. We do these steps over and over for every feature we build, which can…
Dev tools · 2024 · github.com