GraphAr – An Open-Source File Format for Graph Data Archive/Exchange
Hi, Hacker News! We're excited to announce the release of GraphAr, an open-source file format for archiving and exchanging graph data. The landscape of graph processing systems is fragmented, with various types of systems, including graph databases, graph computation systems, and GNN systems. However, currently, there is no common file format for efficiently storing and exchanging graph data while maintaining its schema and graph semantics. GraphAr is designed to address this issue by providing a simple, lightweight format for storing and exchanging graph data. GraphAr is a flexible and…
What it does
In the maker’s words, at launch
Hi, Hacker News! We're excited to announce the release of GraphAr, an open-source file format for archiving and exchanging graph data. The landscape of graph processing systems is fragmented, with various types of systems, including graph databases, graph computation systems, and GNN systems. However, currently, there is no common file format for efficiently storing and exchanging graph data while maintaining its schema and graph semantics. GraphAr is designed to address this issue by providing a simple, lightweight format for storing and exchanging graph data. GraphAr is a flexible and adaptable format that can be used across a variety of applications by decoupling the storage of metadata, adjacency, and properties. It is also designed to be efficient by leveraging existing formats such as ORC, Parquet, and CSV as much as possible. This makes it easy to integrate with existing data processing systems and provides a level of familiarity for users. Furthermore, GraphAr preserves the semantics of graphs and can maintain the schema of property graphs. This means that users can maintain the same graph structure across different systems, ensuring that the graph's semantics are not lost. We have developed both a C++ library for accessing and creating GraphAr files, and a Spark library for transforming data into and from GraphAr files. With these libraries, it's easy to work with GraphAr files in your existing Spark connectors or C++ projects. As GraphAr matures, we aim to move the project to a vendor-neutral venue, such as Apache, LF AI & Data. This will ensure that the project continues to be developed in an open and transparent manner, with contributions from a broad community of developers. To get started with GraphAr, check out our GitHub repository, where you'll find detailed documentation and examples of how to use the libraries. We welcome any feedback or contributions to the project. Let's make graph data archiving and exchange more efficient with GraphAr!
Does the same job
all alternatives →- TATerminusDB – An open source in-memory graph database2020 · terminusdb.com · ▲231
- NANebula – a distributed graph database written in C++2020 · github.com · ▲178
- FOFalkorDB – Open-source graph database major update (C/Rust)2025 · ▲7
Hey HN, I’m Roi, one of the co-creators of FalkorDB. We’re a growing team working on a graph database designed for production workloads and GraphRAG systems. The new release (v4.10.0) is out, and I wanted to share some of the updates and ask for feedback from folks who care about performance, memory efficiency in graph-heavy systems. FalkorDB is an open-source property graph database that supports OpenCypher (with our own extensions) and is used under the hood for retrieval-augmented generation setups where accuracy matters. The big problem we’re working on is scaling graph databases without…
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, April 2023
the whole month →
- G4
Hi HN, Today we’re launching GPT-4 answers on Phind.com, a developer-focused search engine that uses generative AI to browse the web and answer technical questions, complete with code examples and detailed explanations. Unlike vanilla GPT-4, Phind feeds in relevant websites and technical documentation, reducing the model’s hallucination and keeping it up-to-date. To use it, simply enable the “Expert” toggle before doing a search. GPT-4 is making a night-and-day difference in terms of answer quality. For a question like “How can I RLHF a LLaMa model”, Phind in Expert mode delivers a…
AI · 2023 · phind.com
