Skip to Content
Last modified by Erik Bakker on 2026/01/02 11:41
From version 67.1
edited by Erik Bakker
on 2025/09/12 09:18
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Configuring Event Streaming
1 +Data Pipelines
Default language
... ... @@ -1,1 +1,1 @@
1 -sw
1 +en
Content
... ... @@ -1,6 +1,11 @@
1 -{{container}}{{container layoutStyle="columns"}}(((In this course, you will expand your knowledge with regards to the Event Streaming pattern. In this course, you'll visit the relevant event processor-related items that you need on top of the crash course event streaming. So that you can create your first event processing solution to a go-live state. You'll find the proper exercises for each topic, and you can relate the 5 Integration Lifecycle Management phases in the platform. The course contains small exercises to learn each subject and can act as a reference as well.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">40-50 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
2 2  
6 +* **Total time:** between 30 and 45 minutes
3 3  
8 +
4 4  (% style="border-color:#10137e" %)
5 5  ----
6 6  {{html}}
... ... @@ -9,119 +9,70 @@
9 9   <main class="master">
10 10   <ul class="strip-container">
11 11   <li class="strip">
12 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-event-streaming-data-model" target="_blank" class="strip__link">
13 - <div class="strip__attribute__new__stack">
14 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
15 - </div>
16 - <label for="" class="strip__label">
17 - <span>224</span>
18 - Event Streaming Data Model
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 + <label for="" class="strip__label">
19 + <span>208</span>
20 + Understanding Data Pipelines
19 19   </label>
20 20   <div class="strip__attribute">
21 21   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
22 - <div class="strip__attribute-label">7 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
23 23   </div>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
26 - <div class="strip__attribute-label">All</div>
27 - </div>
28 - </a>
29 - </li><li class="strip">
30 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-design-an-event-processor" target="_blank" class="strip__link">
31 - <div class="strip__attribute__new__stack">
32 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
33 - </div>
34 - <label for="" class="strip__label">
35 - <span>224</span>
36 - Design an Event Processor
37 - </label>
38 - <div class="strip__attribute">
39 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 - <div class="strip__attribute-label">6 minutes</div>
41 - </div>
42 - <div class="strip__attribute">
43 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 44   <div class="strip__attribute-label">Developer</div>
45 45   </div>
46 46   </a>
47 47   </li>
48 48   <li class="strip">
49 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-event-streaming-event-processor-transformation" target="_blank" class="strip__link">
50 - <div class="strip__attribute__new__stack">
51 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
52 - </div>
53 - <label for="" class="strip__label">
54 - <span>224</span>
55 - Design an Event Processor with Transformation
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 + <label for="" class="strip__label">
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
56 56   </label>
57 57   <div class="strip__attribute">
58 58   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
59 - <div class="strip__attribute-label">6 minutes</div>
40 + <div class="strip__attribute-label">5 minutes</div>
60 60   </div>
61 61   <div class="strip__attribute">
62 62   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
63 63   <div class="strip__attribute-label">Developer</div>
64 64   </div>
65 - </a>
46 + </a>
66 66   </li>
67 67   <li class="strip">
68 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-creating-a-passthrough-event-processor" target="_blank" class="strip__link">
69 - <div class="strip__attribute__new__stack">
70 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
71 - </div>
72 - <label for="" class="strip__label">
73 - <span>224</span>
74 - Create an Event Processor without Transformation (passthrough)
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 + <label for="" class="strip__label">
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
75 75   </label>
76 76   <div class="strip__attribute">
77 77   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
78 - <div class="strip__attribute-label">6 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
79 79   </div>
80 80   <div class="strip__attribute">
81 81   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
82 82   <div class="strip__attribute-label">Developer</div>
83 83   </div>
84 - </a>
62 + </a>
85 85   </li>
86 - <li class="strip">
87 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-creating-a-event-processor-with-transformation" target="_blank" class="strip__link">
88 - <div class="strip__attribute__new__stack">
89 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
90 - </div>
91 - <label for="" class="strip__label">
92 - <span>224</span>
93 - Create an Event Processor with Transformation
64 + <li class="strip">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 + <label for="" class="strip__label">
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
94 94   </label>
95 95   <div class="strip__attribute">
96 96   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
97 - <div class="strip__attribute-label">6 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
98 98   </div>
99 99   <div class="strip__attribute">
100 100   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
101 101   <div class="strip__attribute-label">Developer</div>
102 102   </div>
103 - </a>
78 + </a>
104 104   </li>
105 - <li class="strip">
106 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-configuration-of-event-streaming" target="_blank" class="strip__link">
107 - <div class="strip__attribute__new__stack">
108 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
109 - </div>
110 - <label for="" class="strip__label">
111 - <span>224</span>
112 - Configuration of event streaming
113 - </label>
114 - <div class="strip__attribute">
115 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
116 - <div class="strip__attribute-label">10 minutes</div>
117 - </div>
118 - <div class="strip__attribute">
119 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
120 - <div class="strip__attribute-label">Developer</div>
121 - </div>
122 - </a>
123 - </li>
124 - </ul>
80 + </ul>
125 125   </main>
126 126   </div>
127 127  </div>