Skip to Content
Last modified by Erik Bakker on 2024/09/24 16:19
From version 56.1
edited by eMagiz
on 2022/09/30 13:52
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Configuring Event Streaming
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.eMagiz
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, you will expand your knowledge with regards to the Event Streaming pattern. In this course, you'll visit the relevant event processor-related items that you need on top of the crash course event streaming. So that you can create your first event processing solution to a go-live state. You'll find the proper exercises for each topic, and you can relate the 5 Integration Lifecycle Management phases in the platform. The course contains small exercises to learn each subject and can act as a reference as well.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">30-40 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,14 +13,14 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-design-an-event-processor" class="strip__link">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
17 17   <label for="" class="strip__label">
18 - <span>224</span>
19 - Design an Event Processor
19 + <span>208</span>
20 + Understanding Data Pipelines
20 20   </label>
21 21   <div class="strip__attribute">
22 22   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
23 - <div class="strip__attribute-label">6 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
24 24   </div>
25 25   <div class="strip__attribute">
26 26   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -29,68 +29,52 @@
29 29   </a>
30 30   </li>
31 31   <li class="strip">
32 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-creating-a-passthrough-event-processor" class="strip__link">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
33 33   <label for="" class="strip__label">
34 - <span>224</span>
35 - Creating a passthrough Event Processor
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
36 36   </label>
37 37   <div class="strip__attribute">
38 38   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
39 - <div class="strip__attribute-label">6 minutes</div>
40 + <div class="strip__attribute-label">5 minutes</div>
40 40   </div>
41 41   <div class="strip__attribute">
42 42   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
43 43   <div class="strip__attribute-label">Developer</div>
44 44   </div>
45 - </a>
46 + </a>
46 46   </li>
47 47   <li class="strip">
48 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-event-streaming-data-model" class="strip__link">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
49 49   <label for="" class="strip__label">
50 - <span>224</span>
51 - Event Streaming Data Model
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
52 52   </label>
53 53   <div class="strip__attribute">
54 54   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
55 - <div class="strip__attribute-label">7 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
56 56   </div>
57 57   <div class="strip__attribute">
58 58   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
59 - <div class="strip__attribute-label">All</div>
60 - </div>
61 - </a>
62 - </li>
63 - <li class="strip">
64 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-event-streaming-event-processor-transformation" class="strip__link">
65 - <label for="" class="strip__label">
66 - <span>224</span>
67 - Design an Event Processor with Transformation
68 - </label>
69 - <div class="strip__attribute">
70 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
71 - <div class="strip__attribute-label">6 minutes</div>
72 - </div>
73 - <div class="strip__attribute">
74 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
75 75   <div class="strip__attribute-label">Developer</div>
76 76   </div>
77 - </a>
62 + </a>
78 78   </li>
79 - <li class="strip">
80 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Configuring%20Event%20Streaming/intermediate-configuring-emagiz-event-streaming-creating-a-event-processor-with-transformation" class="strip__link">
64 + <li class="strip">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
81 81   <label for="" class="strip__label">
82 - <span>224</span>
83 - Create an Event Processor with Transformation
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
84 84   </label>
85 85   <div class="strip__attribute">
86 86   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
87 - <div class="strip__attribute-label">6 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
88 88   </div>
89 89   <div class="strip__attribute">
90 90   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
91 91   <div class="strip__attribute-label">Developer</div>
92 92   </div>
93 - </a>
78 + </a>
94 94   </li>
95 95   </ul>
96 96   </main>