Skip to Content
Last modified by Erik Bakker on 2024/09/24 16:19
From version 59.1
edited by Eva Torken
on 2023/09/01 10:35
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Event Streaming Connectors
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.etorken
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course we will focus on event streaming connectors. There are several alternatives on how you can connect your Event Streaming solution to the outside world. In the microlearnings for this course we will zoom in on several alternatives that are used most.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">25-30 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,40 +13,30 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-using-kafka-module-mendix" target="_blank" class="strip__link">
17 - <div class="strip__attribute__new__stack">
18 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
19 - </div>
20 - <label for="" class="strip__label">
21 - <span>225</span>
22 - Using the Kafka module in Mendix
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 + <label for="" class="strip__label">
19 + <span>208</span>
20 + Understanding Data Pipelines
23 23   </label>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
26 - <div class="strip__attribute-label">10 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
27 27   </div>
28 28   <div class="strip__attribute">
29 29   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
30 30   <div class="strip__attribute-label">Developer</div>
31 31   </div>
32 - <div class="strip__attribute">
33 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
34 - <div class="strip__attribute-label">Architect</div>
35 - </div>
36 36   </a>
37 37   </li>
38 38   <li class="strip">
39 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-emagiz-as-producer" target="_blank" class="strip__link">
40 - <div class="strip__attribute__new__stack">
41 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
42 - </div>
43 - <label for="" class="strip__label">
44 - <span>225</span>
45 - Using eMagiz as producer
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 + <label for="" class="strip__label">
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
46 46   </label>
47 47   <div class="strip__attribute">
48 48   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
49 - <div class="strip__attribute-label">7 minutes</div>
40 + <div class="strip__attribute-label">5 minutes</div>
50 50   </div>
51 51   <div class="strip__attribute">
52 52   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -55,17 +55,14 @@
55 55   </a>
56 56   </li>
57 57   <li class="strip">
58 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-emagiz-as-consumer" target="_blank" class="strip__link">
59 - <div class="strip__attribute__new__stack">
60 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
61 - </div>
62 - <label for="" class="strip__label">
63 - <span>225</span>
64 - Using eMagiz as consumer
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 + <label for="" class="strip__label">
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
65 65   </label>
66 66   <div class="strip__attribute">
67 67   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
68 - <div class="strip__attribute-label">7 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
69 69   </div>
70 70   <div class="strip__attribute">
71 71   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -73,18 +73,15 @@
73 73   </div>
74 74   </a>
75 75   </li>
76 - <li class="strip">
77 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-building-a-working-solution" target="_blank" class="strip__link">
78 - <div class="strip__attribute__new__stack">
79 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
80 - </div>
81 - <label for="" class="strip__label">
82 - <span>225</span>
83 - Building a working solution
64 + <li class="strip">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 + <label for="" class="strip__label">
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
84 84   </label>
85 85   <div class="strip__attribute">
86 86   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
87 - <div class="strip__attribute-label">10 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
88 88   </div>
89 89   <div class="strip__attribute">
90 90   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -92,7 +92,7 @@
92 92   </div>
93 93   </a>
94 94   </li>
95 - </ul>
80 + </ul>
96 96   </main>
97 97   </div>
98 98  </div>