Skip to Content

Changes for page State Generation

Last modified by Erik Bakker on 2024/09/24 16:22
From version 60.2
edited by Danniar Firdausy
on 2024/06/06 11:48
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -State Generation
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.dfirdausy
1 +XWiki.ebakker
Content
... ... @@ -1,23 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, we will focus on the concept of state generation and
6 -how to properly implement it with the help of the eMagiz platform. This course is focusses four operations: enrichment,
7 -change detection, duplication detection, and aggregation.)))((({{html}}<div class="strip__attribute"
8 - style="text-align:center">
9 - <table>
10 - <tr>
11 - <td><img class="strip__attribute-icon strip__attribute-icon--duration"
12 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" /></td>
13 - </tr>
14 - <tr>
15 - <td>
16 - <div class="strip__attribute-label">20-30 minutes</div>
17 - </td>
18 - </tr>
19 - </table>
20 -</div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
21 21  
22 22  
23 23  (% style="border-color:#10137e" %)
... ... @@ -24,149 +24,75 @@
24 24  ----
25 25  {{html}}
26 26  <div class="ez-academy">
27 - <div class="ez-academy_body">
28 - <main class="master">
29 - <ul class="strip-container">
30 - <li class="strip">
31 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
32 - target="_blank" class="strip__link">
33 - <div class="strip__attribute__new__stack">
34 - <img class="strip__attribute-icon strip__attribute-icon--duration"
35 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
36 - </div>
37 - <label for="" class="strip__label">
38 - <span>226</span>
39 - Introduction
40 - </label>
41 - <div class="strip__attribute">
42 - <img class="strip__attribute-icon strip__attribute-icon--duration"
43 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
44 - <div class="strip__attribute-label">4 minutes</div>
45 - </div>
46 - <div class="strip__attribute">
47 - <img class="strip__attribute-icon strip__attribute-icon--roles"
48 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
49 - <div class="strip__attribute-label">Developer</div>
50 - </div>
51 - </a>
52 - </li>
53 - <li class="strip">
54 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
55 - target="_blank" class="strip__link">
56 - <div class="strip__attribute__new__stack">
57 - <img class="strip__attribute-icon strip__attribute-icon--duration"
58 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
59 - </div>
60 - <label for="" class="strip__label">
61 - <span>226</span>
62 - Enrichment
63 - </label>
64 - <div class="strip__attribute">
65 - <img class="strip__attribute-icon strip__attribute-icon--duration"
66 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
67 - <div class="strip__attribute-label">4 minutes</div>
68 - </div>
69 - <div class="strip__attribute">
70 - <img class="strip__attribute-icon strip__attribute-icon--roles"
71 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
72 - <div class="strip__attribute-label">Developer</div>
73 - </div>
74 - </a>
75 - </li>
76 - <li class="strip">
77 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
78 - target="_blank" class="strip__link">
79 - <div class="strip__attribute__new__stack">
80 - <img class="strip__attribute-icon strip__attribute-icon--duration"
81 - src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
82 - </div>
83 - <label for="" class="strip__label">
84 - <span>226</span>
85 - Enrichment
86 - </label>
87 - <div class="strip__attribute">
88 - <img class="strip__attribute-icon strip__attribute-icon--duration"
89 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
90 - <div class="strip__attribute-label">6 minutes</div>
91 - </div>
92 - <div class="strip__attribute">
93 - <img class="strip__attribute-icon strip__attribute-icon--roles"
94 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
95 - <div class="strip__attribute-label">Developer</div>
96 - </div>
97 - </a>
98 - </li>
99 - <li class="strip">
100 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-driver"
101 - target="_blank" class="strip__link">
102 - <div class="strip__attribute__new__stack">
103 - <img class="strip__attribute-icon strip__attribute-icon--duration"
104 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
105 - </div>
106 - <label for="" class="strip__label">
107 - <span>226</span>
108 - Change Detection
109 - </label>
110 - <div class="strip__attribute">
111 - <img class="strip__attribute-icon strip__attribute-icon--duration"
112 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
113 - <div class="strip__attribute-label">4 minutes</div>
114 - </div>
115 - <div class="strip__attribute">
116 - <img class="strip__attribute-icon strip__attribute-icon--roles"
117 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
118 - <div class="strip__attribute-label">Developer</div>
119 - </div>
120 - </a>
121 - </li>
122 - <li class="strip">
123 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-sql-query"
124 - target="_blank" class="strip__link">
125 - <div class="strip__attribute__new__stack">
126 - <img class="strip__attribute-icon strip__attribute-icon--duration"
127 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
128 - </div>
129 - <label for="" class="strip__label">
130 - <span>226</span>
131 - Duplication Detection
132 - </label>
133 - <div class="strip__attribute">
134 - <img class="strip__attribute-icon strip__attribute-icon--duration"
135 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
136 - <div class="strip__attribute-label">6 minutes</div>
137 - </div>
138 - <div class="strip__attribute">
139 - <img class="strip__attribute-icon strip__attribute-icon--roles"
140 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
141 - <div class="strip__attribute-label">Developer</div>
142 - </div>
143 - </a>
144 - </li>
145 - <li class="strip">
146 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-update-database-after-retrieval"
147 - target="_blank" class="strip__link">
148 - <div class="strip__attribute__new__stack">
149 - <img class="strip__attribute-icon strip__attribute-icon--duration"
150 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
151 - </div>
152 - <label for="" class="strip__label">
153 - <span>226</span>
154 - Aggregation
155 - </label>
156 - <div class="strip__attribute">
157 - <img class="strip__attribute-icon strip__attribute-icon--duration"
158 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
159 - <div class="strip__attribute-label">4 minutes</div>
160 - </div>
161 - <div class="strip__attribute">
162 - <img class="strip__attribute-icon strip__attribute-icon--roles"
163 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
164 - <div class="strip__attribute-label">Developer</div>
165 - </div>
166 - </a>
167 - </li>
168 - </ul>
169 - </main>
13 + <div class="ez-academy_body">
14 + <main class="master">
15 + <ul class="strip-container">
16 + <li class="strip">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 + <label for="" class="strip__label">
19 + <span>208</span>
20 + Understanding Data Pipelines
21 + </label>
22 + <div class="strip__attribute">
23 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
24 + <div class="strip__attribute-label">5 minutes</div>
25 + </div>
26 + <div class="strip__attribute">
27 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
28 + <div class="strip__attribute-label">Developer</div>
29 + </div>
30 + </a>
31 + </li>
32 + <li class="strip">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 + <label for="" class="strip__label">
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
37 + </label>
38 + <div class="strip__attribute">
39 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 + <div class="strip__attribute-label">5 minutes</div>
41 + </div>
42 + <div class="strip__attribute">
43 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 + <div class="strip__attribute-label">Developer</div>
45 + </div>
46 + </a>
47 + </li>
48 + <li class="strip">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 + <label for="" class="strip__label">
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
53 + </label>
54 + <div class="strip__attribute">
55 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
56 + <div class="strip__attribute-label">10 minutes</div>
57 + </div>
58 + <div class="strip__attribute">
59 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
60 + <div class="strip__attribute-label">Developer</div>
61 + </div>
62 + </a>
63 + </li>
64 + <li class="strip">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 + <label for="" class="strip__label">
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
69 + </label>
70 + <div class="strip__attribute">
71 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
72 + <div class="strip__attribute-label">7 minutes</div>
73 + </div>
74 + <div class="strip__attribute">
75 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
76 + <div class="strip__attribute-label">Developer</div>
77 + </div>
78 + </a>
79 + </li>
80 + </ul>
81 + </main>
170 170   </div>
171 171  </div>
172 172  {{/html}}