Skip to Content

Changes for page State Generation

Last modified by Erik Bakker on 2024/09/24 16:22
From version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version
To version 60.3
edited by Danniar Firdausy
on 2024/06/06 11:49
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Data Pipelines
1 +State Generation
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.ebakker
1 +XWiki.dfirdausy
Content
... ... @@ -1,9 +1,23 @@
1 -In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 -eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 -Within eMagiz, we support several combinations of those source and sink systems.
4 -For the combinations that are used most, we have made separate microlearnings to explain how they work.
1 +{{velocity}}
2 +#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 +{{/velocity}}
5 5  
6 -* **Total time:** between 30 and 45 minutes
5 +{{container}}{{container layoutStyle="columns"}}(((In this course, we will focus on the concept of state generation and
6 +how to properly implement it with the help of the eMagiz platform. This course is focusses four operations: enrichment,
7 +change detection, duplication detection, and aggregation.)))((({{html}}<div class="strip__attribute"
8 + style="text-align:center">
9 + <table>
10 + <tr>
11 + <td><img class="strip__attribute-icon strip__attribute-icon--duration"
12 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" /></td>
13 + </tr>
14 + <tr>
15 + <td>
16 + <div class="strip__attribute-label">20-30 minutes</div>
17 + </td>
18 + </tr>
19 + </table>
20 +</div>{{/html}}))){{/container}}{{/container}}
7 7  
8 8  
9 9  (% style="border-color:#10137e" %)
... ... @@ -10,75 +10,218 @@
10 10  ----
11 11  {{html}}
12 12  <div class="ez-academy">
13 - <div class="ez-academy_body">
14 - <main class="master">
15 - <ul class="strip-container">
16 - <li class="strip">
17 - <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 - <label for="" class="strip__label">
19 - <span>208</span>
20 - Understanding Data Pipelines
21 - </label>
22 - <div class="strip__attribute">
23 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
24 - <div class="strip__attribute-label">5 minutes</div>
25 - </div>
26 - <div class="strip__attribute">
27 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
28 - <div class="strip__attribute-label">Developer</div>
29 - </div>
30 - </a>
31 - </li>
32 - <li class="strip">
33 - <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 - <label for="" class="strip__label">
35 - <span>208</span>
36 - Data pipeline - Job Dashboard
37 - </label>
38 - <div class="strip__attribute">
39 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 - <div class="strip__attribute-label">5 minutes</div>
41 - </div>
42 - <div class="strip__attribute">
43 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 - <div class="strip__attribute-label">Developer</div>
45 - </div>
46 - </a>
47 - </li>
48 - <li class="strip">
49 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 - <label for="" class="strip__label">
51 - <span>208</span>
52 - Data pipeline - Mendix to AWS Redshift
53 - </label>
54 - <div class="strip__attribute">
55 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
56 - <div class="strip__attribute-label">10 minutes</div>
57 - </div>
58 - <div class="strip__attribute">
59 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
60 - <div class="strip__attribute-label">Developer</div>
61 - </div>
62 - </a>
63 - </li>
64 - <li class="strip">
65 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 - <label for="" class="strip__label">
67 - <span>208</span>
68 - Data pipeline - Mendix to SFTP
69 - </label>
70 - <div class="strip__attribute">
71 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
72 - <div class="strip__attribute-label">7 minutes</div>
73 - </div>
74 - <div class="strip__attribute">
75 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
76 - <div class="strip__attribute-label">Developer</div>
77 - </div>
78 - </a>
79 - </li>
80 - </ul>
81 - </main>
27 + <div class="ez-academy_body">
28 + <main class="master">
29 + <ul class="strip-container">
30 + <li class="strip">
31 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
32 + target="_blank" class="strip__link">
33 + <div class="strip__attribute__new__stack">
34 + <img class="strip__attribute-icon strip__attribute-icon--duration"
35 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
36 + </div>
37 + <label for="" class="strip__label">
38 + <span>226</span>
39 + Introduction
40 + </label>
41 + <div class="strip__attribute">
42 + <img class="strip__attribute-icon strip__attribute-icon--duration"
43 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
44 + <div class="strip__attribute-label">4 minutes</div>
45 + </div>
46 + <div class="strip__attribute">
47 + <img class="strip__attribute-icon strip__attribute-icon--roles"
48 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
49 + <div class="strip__attribute-label">Developer</div>
50 + </div>
51 + </a>
52 + </li>
53 + <li class="strip">
54 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
55 + target="_blank" class="strip__link">
56 + <div class="strip__attribute__new__stack">
57 + <img class="strip__attribute-icon strip__attribute-icon--duration"
58 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
59 + </div>
60 + <label for="" class="strip__label">
61 + <span>226</span>
62 + Enrichment
63 + </label>
64 + <div class="strip__attribute">
65 + <img class="strip__attribute-icon strip__attribute-icon--duration"
66 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
67 + <div class="strip__attribute-label">4 minutes</div>
68 + </div>
69 + <div class="strip__attribute">
70 + <img class="strip__attribute-icon strip__attribute-icon--roles"
71 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
72 + <div class="strip__attribute-label">Developer</div>
73 + </div>
74 + </a>
75 + </li>
76 + <li class="strip">
77 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
78 + target="_blank" class="strip__link">
79 + <div class="strip__attribute__new__stack">
80 + <img class="strip__attribute-icon strip__attribute-icon--duration"
81 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
82 + </div>
83 + <label for="" class="strip__label">
84 + <span>226</span>
85 + Enrichment
86 + </label>
87 + <div class="strip__attribute">
88 + <img class="strip__attribute-icon strip__attribute-icon--duration"
89 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
90 + <div class="strip__attribute-label">6 minutes</div>
91 + </div>
92 + <div class="strip__attribute">
93 + <img class="strip__attribute-icon strip__attribute-icon--roles"
94 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
95 + <div class="strip__attribute-label">Developer</div>
96 + </div>
97 + </a>
98 + </li>
99 + <li class="strip">
100 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-driver"
101 + target="_blank" class="strip__link">
102 + <div class="strip__attribute__new__stack">
103 + <img class="strip__attribute-icon strip__attribute-icon--duration"
104 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
105 + </div>
106 + <label for="" class="strip__label">
107 + <span>226</span>
108 + Change Detection
109 + </label>
110 + <div class="strip__attribute">
111 + <img class="strip__attribute-icon strip__attribute-icon--duration"
112 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
113 + <div class="strip__attribute-label">4 minutes</div>
114 + </div>
115 + <div class="strip__attribute">
116 + <img class="strip__attribute-icon strip__attribute-icon--roles"
117 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
118 + <div class="strip__attribute-label">Developer</div>
119 + </div>
120 + </a>
121 + </li>
122 + <li class="strip">
123 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
124 + target="_blank" class="strip__link">
125 + <div class="strip__attribute__new__stack">
126 + <img class="strip__attribute-icon strip__attribute-icon--duration"
127 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
128 + </div>
129 + <label for="" class="strip__label">
130 + <span>226</span>
131 + Change Detection
132 + </label>
133 + <div class="strip__attribute">
134 + <img class="strip__attribute-icon strip__attribute-icon--duration"
135 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
136 + <div class="strip__attribute-label">6 minutes</div>
137 + </div>
138 + <div class="strip__attribute">
139 + <img class="strip__attribute-icon strip__attribute-icon--roles"
140 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
141 + <div class="strip__attribute-label">Developer</div>
142 + </div>
143 + </a>
144 + </li>
145 + <li class="strip">
146 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-sql-query"
147 + target="_blank" class="strip__link">
148 + <div class="strip__attribute__new__stack">
149 + <img class="strip__attribute-icon strip__attribute-icon--duration"
150 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
151 + </div>
152 + <label for="" class="strip__label">
153 + <span>226</span>
154 + Duplication Detection
155 + </label>
156 + <div class="strip__attribute">
157 + <img class="strip__attribute-icon strip__attribute-icon--duration"
158 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
159 + <div class="strip__attribute-label">6 minutes</div>
160 + </div>
161 + <div class="strip__attribute">
162 + <img class="strip__attribute-icon strip__attribute-icon--roles"
163 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
164 + <div class="strip__attribute-label">Developer</div>
165 + </div>
166 + </a>
167 + </li>
168 + <li class="strip">
169 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
170 + target="_blank" class="strip__link">
171 + <div class="strip__attribute__new__stack">
172 + <img class="strip__attribute-icon strip__attribute-icon--duration"
173 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
174 + </div>
175 + <label for="" class="strip__label">
176 + <span>226</span>
177 + Duplication Detection
178 + </label>
179 + <div class="strip__attribute">
180 + <img class="strip__attribute-icon strip__attribute-icon--duration"
181 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
182 + <div class="strip__attribute-label">6 minutes</div>
183 + </div>
184 + <div class="strip__attribute">
185 + <img class="strip__attribute-icon strip__attribute-icon--roles"
186 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
187 + <div class="strip__attribute-label">Developer</div>
188 + </div>
189 + </a>
190 + </li>
191 + <li class="strip">
192 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-update-database-after-retrieval"
193 + target="_blank" class="strip__link">
194 + <div class="strip__attribute__new__stack">
195 + <img class="strip__attribute-icon strip__attribute-icon--duration"
196 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
197 + </div>
198 + <label for="" class="strip__label">
199 + <span>226</span>
200 + Aggregation
201 + </label>
202 + <div class="strip__attribute">
203 + <img class="strip__attribute-icon strip__attribute-icon--duration"
204 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
205 + <div class="strip__attribute-label">4 minutes</div>
206 + </div>
207 + <div class="strip__attribute">
208 + <img class="strip__attribute-icon strip__attribute-icon--roles"
209 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
210 + <div class="strip__attribute-label">Developer</div>
211 + </div>
212 + </a>
213 + </li>
214 + <li class="strip">
215 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
216 + target="_blank" class="strip__link">
217 + <div class="strip__attribute__new__stack">
218 + <img class="strip__attribute-icon strip__attribute-icon--duration"
219 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
220 + </div>
221 + <label for="" class="strip__label">
222 + <span>226</span>
223 + Aggregation
224 + </label>
225 + <div class="strip__attribute">
226 + <img class="strip__attribute-icon strip__attribute-icon--duration"
227 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
228 + <div class="strip__attribute-label">6 minutes</div>
229 + </div>
230 + <div class="strip__attribute">
231 + <img class="strip__attribute-icon strip__attribute-icon--roles"
232 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
233 + <div class="strip__attribute-label">Developer</div>
234 + </div>
235 + </a>
236 + </li>
237 + </ul>
238 + </main>
82 82   </div>
83 83  </div>
84 84  {{/html}}