Monitor partition size and consumer lag

Version 16.1 by Erik Bakker on 2023/09/11 13:52

This exercise will provide you with practical guidance on the interpretation of the event streaming statistics overview and specifically around partition size and consumer lag.

Should you have any questions, please contact academy@emagiz.com.

1. Prerequisites

Completed previous exercises and microlearnings
Access to an eMagiz model with an Event Streaming license
At least one configured topic on which something produces data and some other thing consumes data

2. Exercise

Navigate to Manage -> Monitoring -> Event Streaming Statistics for the model you have selected to execute this exercise with. In here analyze the partition size and consumer lag that you see on at least one topic.

Given that the implementation of the prerequisites can differ the results of what you see can also differ. In our case we use example data that is part of our Sales Demo model to feed the Vehicle Event topic. An event processor determines subsequently based on the type of event whether a vehicle alert needs to be generated. This accounts for the difference in partition size between both topics. The event processor itself is shown as a consumer group and we can conclude that due to the high volume of messages placed on the Vehicle Event topic we see that a consumer lag is reported.

3. Solution

In this short movie, you will find the workout of this exercise. Take a moment to review this one and compare it to your solution.