Last modified by Erik Bakker on 2024/09/24 16:19
From version 57.1
edited by Eva Torken
on 2023/06/08 13:31
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Event Streaming Connectors
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.etorken
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course we will focus on event streaming connectors. There are several alternatives on how you can connect your Event Streaming solution to the outside world. In the microlearnings for this course we will zoom in on several alternatives that are used most.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">25-30 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,34 +13,46 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-using-kafka-module-mendix" target="_blank" class="strip__link">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
17 17   <label for="" class="strip__label">
18 - <span>225</span>
19 - Using the Kafka module in Mendix
19 + <span>208</span>
20 + Understanding Data Pipelines
20 20   </label>
21 21   <div class="strip__attribute">
22 22   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
23 - <div class="strip__attribute-label">10 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
24 24   </div>
25 25   <div class="strip__attribute">
26 26   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
27 27   <div class="strip__attribute-label">Developer</div>
28 28   </div>
29 - <div class="strip__attribute">
30 + </a>
31 + </li>
32 + <li class="strip">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 + <label for="" class="strip__label">
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
37 + </label>
38 + <div class="strip__attribute">
39 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 + <div class="strip__attribute-label">5 minutes</div>
41 + </div>
42 + <div class="strip__attribute">
30 30   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
31 - <div class="strip__attribute-label">Architect</div>
44 + <div class="strip__attribute-label">Developer</div>
32 32   </div>
33 33   </a>
34 34   </li>
35 35   <li class="strip">
36 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-emagiz-as-producer" target="_blank" class="strip__link">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
37 37   <label for="" class="strip__label">
38 - <span>225</span>
39 - Using eMagiz as producer
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
40 40   </label>
41 41   <div class="strip__attribute">
42 42   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
43 - <div class="strip__attribute-label">7 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
44 44   </div>
45 45   <div class="strip__attribute">
46 46   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -49,10 +49,10 @@
49 49   </a>
50 50   </li>
51 51   <li class="strip">
52 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Event%20Streaming%20Connectors/intermediate-event-streaming-connectors-emagiz-as-consumer" target="_blank" class="strip__link">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
53 53   <label for="" class="strip__label">
54 - <span>225</span>
55 - Using eMagiz as consumer
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
56 56   </label>
57 57   <div class="strip__attribute">
58 58   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>