Skip to Content
Last modified by Erik Bakker on 2024/09/03 08:22
From version 9.1
edited by Erik Bakker
on 2022/10/03 13:11
Change comment: There is no comment for this version
To version 4.1
edited by Erik Bakker
on 2022/06/13 10:16
Change comment: There is no comment for this version

Summary

Details

Page properties
Default language
... ... @@ -1,1 +1,0 @@
1 -en
Content
... ... @@ -12,8 +12,8 @@
12 12  
13 13  Retention configuration in Event Streaming helps to delete data from a topic once that data (messages) reaches one of the retention thresholds. The main retention parameters that can be influenced in Event Streaming topis are:
14 14  
15 -* Retention bytes -> once the topic reaches this size the oldest messages will be deleted from the topic (FIFO approach)
16 -* Retention hours -> once a message on a topic is older than these retention bytes, this message will be deleted
15 +1. Retention bytes * once the topic reaches this size the oldest messages will be deleted from the topic (FIFO approach)
16 +2. Retention hours * once a message on a topic is older than these retention bytes, this message will be deleted
17 17  
18 18  The cleanup policy is set to <delete> which effectively means the message is deleted. The cleanup policy <compact> is not used in eMagiz.
19 19  
... ... @@ -25,17 +25,17 @@
25 25  
26 26  === 3.2 Does the size in Design Architecture consider the segment size? ===
27 27  
28 -The total size in eMagiz that is displayed in the Design phase * Architecture takes into account the complex calculations around segment sizing, cleanup policies etc. So your sizing can never exceed that value on our Event Streaming cluster. eMagiz uses this value to determine the required licensing.
28 +The total size in eMagiz that is displayed in the Design phase * Architecture takes into account the complex calculations around segment sizing, cleanup policies etc. So your sizing can never exceeed that value on our Event Streaming cluster. eMagiz uses this value to determine the required licensing.
29 29  
30 30  === 3.3 Actual retention vs. budget retention ===
31 31  
32 -Despite the fact that you set a retention hours setting, it may occur that the amount of messages is so large that the retention bytes kicks in earlier than the retention hours. This could cause an effect that the oldest messages is younger than your retention hour setting. In specific scenario's this can be an issue.
32 +Despite the fact that you set a retention hours setting, it may occur that the amount of messages is so large that the retention bytes kicks in earlier than the retention hours. This could cause an effect that the oldest messages is younger than your retention hour setting. In specific scenario's this can be an issues
33 33  
34 34  === 3.4 Managing retention across TAP ===
35 35  
36 -You are able to set the retention bytes and hours per Test, Acceptance and Production. You can play with these configuration values by setting a smaller value for Test compared to Production. So that each topic is optimized for the environment at hand. One advice can be to keep Acceptance and Production similar in terms of configuration for retention whereas Test can be set to a lower value.
36 +You are able to set the retention bytes and hours per Test, Acceptance and Production. You can play with this configuration values by setting a smaller value for Test compared to Production. So that each topic is optimized for the environment at hand. One advice can be to keep Acceptance and Production similar in terms of configuration for retention * test can be set to a lower value.
37 37  
38 -{{info}}During development of a new business process that involves the use of topics, only test can be given sufficient retention values. In this case, Acceptance and Production topics can be disabled so that the total licensed size is not exceeded.{{/info}}
38 +During development of a new business process that involves the use of topics, only test can be given sufficient retention values. In this case, Acceptance and Production topics can be disabled so that the total licensed size is not exceeded.
39 39  
40 40  === 3.5 Duplication of data ===
41 41  
... ... @@ -55,9 +55,9 @@
55 55  
56 56  == 6. Suggested Additional Readings ==
57 57  
58 -* [[Understanding retention policy in eMagiz>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Key concepts Event Streaming.intermediate-key-concepts-emagiz-event-streaming-retention-policy.WebHome||target="blank"]]
59 -* [[Understanding topic configured size across environments>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Solution Architecture.intermediate-solution-architecture-topic-storage.WebHome||target="blank"]]
60 -* [[Key concepts of Event Streaming>>doc:Main.eMagiz Academy.Fundamentals.fundamental-event-streaming-introduction.WebHome||target="blank"]]
58 +1. Understanding retention policy in eMagiz: https://emagiz.github.io/docs/microlearning/intermediate-key-concepts-emagiz-event-streaming-retention-policy
59 +2. Understanding topic configured size across environments: https://emagiz.github.io/docs/microlearning/intermediate-solution-architecture-topic-storage
60 +3. Key concepts of Event Streaming: https://emagiz.github.io/docs/fundamental/fundamental-event-streaming-introduction
61 61  
62 62  == 7. Silent demonstration video ==
63 63