Protobuf Based Schema Centric Logging Framework
Hi HN, have been working on this as a side project, would appreciate any feedback :) LogUnify is built around schemas based on protobuf and all the events in LogUnify are structured. By schematizing events, we offer the following benefits: - Consistency: All the events across all platforms and languages are produced in a uniform way with the generated type-safe SDKs, which ensures data consistency from the root. - Shared Understanding: Event schemas with rich data types and metadata are self-explained, which enables different departments from developers to business stakeholders to share the…
What it does
In the maker’s words, at launch
Hi HN, have been working on this as a side project, would appreciate any feedback :) LogUnify is built around schemas based on protobuf and all the events in LogUnify are structured. By schematizing events, we offer the following benefits: - Consistency: All the events across all platforms and languages are produced in a uniform way with the generated type-safe SDKs, which ensures data consistency from the root. - Shared Understanding: Event schemas with rich data types and metadata are self-explained, which enables different departments from developers to business stakeholders to share the same understanding when consuming the events. - Flexibility: LogUnify offers flexibility in terms of integrating with different systems, as the schemas can be easily converted into different formats and protocols without requiring dedicated transformations from developers. The platform currently offers seamless integration with BigQuery and is expanding to support other systems. - Reliability: Structured events are more reliable as they are logged in the desired format from the start by developers who have full control over the producing logic. While traditional solutions require developers to log events in an unstructured manner and then set up the transformation on the server side. Data Analysis: Structured events enable better and more accurate data analysis naturally, as they provide a standardized and consistent format that can be easily processed and analyzed using various data analysis tools and techniques.
Does the same job
all alternatives →
- NCNanosecond C message logger2019 · ▲131
Hello, Some time ago I did a data logger for fun, just to check if I could beat the performance of an old C++ project of mine (mini-async-log) and to avoid letting my multithreading-C skills rust when on a non-programming gig (using Yocto/OE, very little programming). This project is a BSD licensed, producer-wait-free (when using thread-local storage) generic message logger with high performance, decent test coverage, and type-safe C strings (requires C11 or C++ compiler). It was a shame to let this project to die unknown, as I think that it has potential to be used on some niches as…
- SOSchema.org with GitHub and scripts: A tool to make data more useful2019 · ditabase.io · ▲69
- HMHome-made database with log-structured writes2017 · ▲7
Hi, I'm Marcus. I've spent the last 15 months or so home-coding on a document database, after work, on weekends (every waking hour). My plans for this particular weekend was to implement log-structured writing. It went faster than I thought and the results were faster querying times and fast, append-only writes. I've been working on this for almost a decade and being this close to the finish line feels surreal. This is my seventh iteration I believe. Everytime I realized I had an architecture built on a bad model I walked away, often in fury, depressed over my weak coding abilities but…
- SGSchemabuf – Generate a protobuf schema from a MySQL database schema2016 · github.com · ▲10
- PPPg_protobuf – Protobuf support for PostgreSQL2017 · afiskon.github.io · ▲7
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, October 2023
the whole month →
Nudge 2.0▲1,051In-app experiences to activate, retain, & understand users
Growth · 2023 · nudgenow.com
Unlock AI magic for elevated customer engagement, fast
AI · 2023 · tiledesk.com
- OD
Effortlessly discover API behaviour with a Chrome extension that automatically generates OpenAPI specifications in real time for any app or website.
Dev tools · 2023 · github.com