AgentServe – A open-source framework for hosting scalable AI agents
Hey HN! I am super excited (and slightly nervous) to introduce AgentServe! AgentServe is a framework to make hosting scalable AI agents as easy as possible. With 4 lines of code AS wraps your agent (any framework) in a FastAPI and connects it to a Task Queue (celery or redis). Why Should You Care? Standardized Communication Pattern: AgentServe proposes that all agents should communicate with each other and the outside world with “Tasks” that can be submitted in a sync or async way. This simple API wil enable Framework Agnostic: No favorites. OpenAI, LangChain, LlamaIndex, CrewAI are all…
What it does
In the maker’s words, at launch
Hey HN! I am super excited (and slightly nervous) to introduce AgentServe! AgentServe is a framework to make hosting scalable AI agents as easy as possible. With 4 lines of code AS wraps your agent (any framework) in a FastAPI and connects it to a Task Queue (celery or redis). Why Should You Care? Standardized Communication Pattern: AgentServe proposes that all agents should communicate with each other and the outside world with “Tasks” that can be submitted in a sync or async way. This simple API wil enable Framework Agnostic: No favorites. OpenAI, LangChain, LlamaIndex, CrewAI are all welcome. AS provides an entry point for the outside world to engage with your agent. Task Queuing: For when your agents need a little help managing their to-do list. For scale or Asyncronous background agents, AgentServe connects with Redis or Celery Queues. Batteries Included: AgentServe aims to remove a lot of the boiler plate of writing an API, managing validation, errros ect. Next on the roadmap is introducing a miiddleware pattern to add auth, observability or anything else you can think of. Why Are We Here? I want your feedback, your ideas, and maybe even your code contributions. This is an open invitation to our Discord server and give honest burtal feedback. Join Us! [Discord](https://discord.gg/JkPrCnExSf) [GitHub](https://github.com/PropsAI/agentserve) Fork it, star it, or just stare at it. We won't judge. What's Next? We're working on streaming responses, detail hosting instructions for each cloud. And eventually created a one click hosting option and managed queue with an AgentServe Cloud (but lets not get ahead of outselves) Thank you for reading, please check it out and let me know if this is useful. Cheers, Peter Kirkham
Does the same job
all alternatives →
- NONous – Open-Source Agent Framework with Autonomous, SWE Agents, WebUI2024 · github.com · ▲155
Hello HN! The day has finally come to stop adding features and start sharing what I've been building the last 5-6 months. It's a bit of CrewAI, OpenDevon, LangFuse/Cloud all in one, providing devs who prefer TypeScript an integrated framework thats provides a lot out of the box to start experimenting and building agents with. It started after peeking at the LangChain docs a few times and never liking the example code. I began experimenting with automating a simple Jira request from the engineering team to add an index to one of our Google Spanner databases (for context I'm the…
Cloudways Managed AI Agents17d ago · cloudways.com · ▲84Skip the setup and run OpenClaw & Hermes, fully managed
More ai this month
the category →
I trained a 125M-parameter transformer to autocomplete piano performances in real time (~108 notes/sec on an iPhone 15). The idea is basically GitHub Copilot or Tabnine, except instead of prompting it with code, you prompt it by playing a few notes on a MIDI piano. The model then continues what you played, entirely on-device. The app is free if anyone wants to try it. Happy to answer questions about the model, training, Core ML, or the many things that didn't work.
AI · 17d ago · simedw.com
Astute▲585Automate your B2B brand going viral, with new media creators
AI · 18d ago · company-app.joinastute.com
Hey HN, Henry from Cactus here! We previously released Cactus Needle, a 14MB agentic LLM for tool call, device use, and structured extraction for phones, wearables, smart homes, small robots and microcontrollers. We got really great feedback here, and have now incorporated the suggestions to release Needle 2. The whole model is a single 14MB binary that runs a full session in 28MB of RAM; 45m parameters at 2bit compression. Needle hits 500 tokens/sec decode speed on a Raspberry Pi 5, sits between 400-1,500 tokens/sec on VR devices like Meta Quest 3S and Apple Vision Pro, and ranges…
AI · 26d ago · cactuscompute.com
Launched alongside, October 2024
the whole month →
Softr for Notion▲925Turn Notion databases into portals & apps with no code
Dev tools · 2024 · softr.io
One inbox for all your work discussions
Work · 2024 · generalcollaboration.com