nowfound

Life & fun · alternatives · 2026

24 alternatives to Golang service to read records from kafka and write to elasticsearch

Golang app to read records from a set of kafka topics and write them to an elasticsearch cluster - inloco/kafka-elasticsearch-injector

This Go service reads records from Kafka and writes them to Elasticsearch, enabling data pipeline automation between these two systems. It's designed for developers and engineers who need to stream data from Kafka… Below are 24 products that do a similar job, ranked by how close each is in meaning and then by launch-day votes. Golang service to read records from kafka and write to elasticsearch launched in 2018; newer entries below may have overtaken it.

  1. 1

    Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go. - lovoo/goka

    2017 · github.com · its alternatives →

  2. 2

    I wrote this simple WAL library in Golang that I use to write data that my kafka producer fails due to errors like Broker going down or some other issue. Took inspiration from etcd/wal

    2024 · github.com · its alternatives →

  3. 3

    How to connect Lenses to your Kafka and Elasticsearch environment for unified data observability

    2020 · lenses.io · its alternatives →

  4. 4

    Hello folks, We are launching OpenObserve. An open source Elasticsearch/Splunk/Datadog alternative written in rust and vue that is super easy to get started with and has 140x lower storage cost compared to elasticsearch. It offers logs, metrics, traces, dashboards, alerts, functions (run aws lambda like functions during ingestion and query to enrich, redact, transform, normalize and whatever else you want to do. Think redacting email IDs from logs, adding geolocation based on IP address, etc). You can do all of this from the UI, no messing up with configuration files. OpenObserve…

    2023 · github.com · its alternatives →

  5. 5

    Recently created a minimal persistent relational database in Go. Main focus was on implementing & understanding working the of database, storage management & transaction handling. Use of B+ Tree for storage engine(support for indexing), managing a Free List (for reusing nodes), Support for transactions, Concurrent Reads. Still have many things to add & fix like query processing being one of the main & fixing some bugs Repo link - https://github.com/Sahilb315/AtomixDB Would love to hear your thoughts

    2025 · github.com · its alternatives →

  6. 6

    Open-Source Web UI for Apache Kafka Management. Contribute to provectus/kafka-ui development by creating an account on GitHub.

    2021 · github.com · its alternatives →

  7. 7

    SQL micro-dialect implementation for querying JSON objects. Written purely in Scala. - mmalek06/JsonSql

    2020 · github.com · its alternatives →

  8. 8GF
  9. 9

    CLI for importing MongoDB, SQL, CSV, JSON to Elasticsearch

    2017 · its alternatives →

  10. 10

    A brief overview: 1. Workflows steps share a running context, with access to data they need require. 2. Steps in the workflow (builders) are chained together based on a topologically sorted built from the predefined input & output. 3. No servers spin up (like Conductor/Cadence) - the orchestrator is low level and meant for simplifying business logic. 4. Before/After listeners for each step. Would love to hear your thoughts and feedback!

    2024 · github.com · its alternatives →

  11. 11

    Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://sql-flow.com/docs/category/tutorials/ https://github.com/turbolytics/sql-flow We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or…

    Dec 2025 · sql-flow.com · its alternatives →

  12. 12

    We built Gonzo to make log analysis faster and friendlier in the terminal. Think of it like k9s for logs — a TUI that can ingest JSON, text, or OpenTelemetry (OTLP) logs, highlight and boil up patterns, and even run AI models locally or via API to summarize logs. We’re still iterating, so ideas and contributions are welcome!

    2025 · github.com · its alternatives →

  13. 13
    KloudMate▲279

    Logs, metrics, and traces in one platform. KloudMate helps engineers find and fix issues fast. Ask the built-in AI assistant to help track down the cause.

    2023 · kloudmate.com · its alternatives →

  14. 14

    [Deprecated] Load data from Kafka to any data warehouse. BQ sink is being supported in Firehose now. https://github.com/odpf/firehose - gojekfarm/beast

    2019 · github.com · its alternatives →

  15. 15

    go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch. - kevwan/go-stash

    2021 · github.com · its alternatives →

  16. 16

    go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch. - kevwan/go-stash

    2021 · github.com · its alternatives →

  17. 17

    Hi folks, Quickwit cofounder here. We started Quickwit 3 years ago with a POC, "Searching the web for under $1000/month" (see HN discussions [0]), with the goal of making a robust OSS alternative to Elasticsearch / Splunk / Datadog. We have reached a significant milestone with our latest release (0.7) [1], as we have witnessed users of the nightly version of Quickwit deploy clusters with hundreds of nodes, ingest hundreds of terabytes of data daily, and enjoy considerable cost savings. To give you a concrete example, one company is ingesting hundreds of terabytes of logs daily…

    2024 · github.com · its alternatives →

  18. 18

    high performance JSON encoder/decoder with stream API for Golang - GitHub - francoispqt/gojay: high performance JSON encoder/decoder with stream API for Golang

    2018 · github.com · its alternatives →

  19. 19

    2014 · journal.paul.querna.org · its alternatives →

  20. 20LO

    I don't like the existing query languages for Elasticsearch and Grafana Loki, because they are too awkward to use for typical logs' investigation cases. So I designed new query language - LogsQL - and wrote reference implementation for it as a part of VictoriaLogs - an open source database for logs. LogsQL is based on the following principles: - Simplicity. It is easy to write typical queries over logs in it. For example, a single word `error` is a valid LogsQL query, which returns all the logs with the `error` word. Another example is `_time:5m error`, which returns all the logs with the…

    2024 · docs.victoriametrics.com · its alternatives →

  21. 21

    Kafka-based Job Queue for Python. Contribute to joowani/kq development by creating an account on GitHub.

    2016 · github.com · its alternatives →

  22. 22

    An easy-to-use, lightweight KafkaJS to Socket.io library

    2021 · github.com · its alternatives →

  23. 23
    Wafka▲67

    Apache Kafka over the web

    2020 · josephp91.github.io · its alternatives →

  24. 24

    A highly configurable Google Cloud Dataflow pipeline that writes data into Google Big Query table from Pub/Sub - bomboradata/pubsub-to-bigquery

    2017 · github.com · its alternatives →

Also compare

Ranked by how close each launch is in meaning, then by votes. Prices were read from each product’s own site when checked and can change. Refine with your own description →