this post was submitted on 05 Jul 2023
1 points (100.0% liked)

Data Engineering

259 readers
1 users here now

News and discussion on Data Engineering topics

founded 1 year ago
MODERATORS
 

I plan to run a few tests to determine if Kafka is suitable for a certain usecase I have in mind.

My idea is to run a local cluster of Kafka servers (either VMs or containers), produce/consume a series of messages, observe a bunch of metrics (Prometheus & Grafana) and custom business logic outcomes.

What are some good tools to record and visualise the internals of Kafka cluster?

I'm looking for things like consumer lag, topic replication, possibly tracing messages, ...

Originally posted on https://mastodon.social/@bahmanm/110662538718523380

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here