Skip to Content

Changes for page State Generation

Last modified by Erik Bakker on 2024/09/24 16:22
From version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version
To version 60.5
edited by Danniar Firdausy
on 2024/06/06 11:51
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Data Pipelines
1 +State Generation
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.ebakker
1 +XWiki.dfirdausy
Content
... ... @@ -1,9 +1,21 @@
1 -In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 -eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 -Within eMagiz, we support several combinations of those source and sink systems.
4 -For the combinations that are used most, we have made separate microlearnings to explain how they work.
1 +{{velocity}}
2 +#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 +{{/velocity}}
5 5  
6 -* **Total time:** between 30 and 45 minutes
5 +{{container}}{{container layoutStyle="columns"}}(((In this course, we will focus on the concept of state generation and how to properly implement it with the help of the eMagiz platform. This course focuses on four operations: enrichment, change detection, duplication detection, and aggregation.)))((({{html}}<div class="strip__attribute"
6 + style="text-align:center">
7 + <table>
8 + <tr>
9 + <td><img class="strip__attribute-icon strip__attribute-icon--duration"
10 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" /></td>
11 + </tr>
12 + <tr>
13 + <td>
14 + <div class="strip__attribute-label">20-30 minutes</div>
15 + </td>
16 + </tr>
17 + </table>
18 +</div>{{/html}}))){{/container}}{{/container}}
7 7  
8 8  
9 9  (% style="border-color:#10137e" %)
... ... @@ -10,75 +10,218 @@
10 10  ----
11 11  {{html}}
12 12  <div class="ez-academy">
13 - <div class="ez-academy_body">
14 - <main class="master">
15 - <ul class="strip-container">
16 - <li class="strip">
17 - <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 - <label for="" class="strip__label">
19 - <span>208</span>
20 - Understanding Data Pipelines
21 - </label>
22 - <div class="strip__attribute">
23 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
24 - <div class="strip__attribute-label">5 minutes</div>
25 - </div>
26 - <div class="strip__attribute">
27 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
28 - <div class="strip__attribute-label">Developer</div>
29 - </div>
30 - </a>
31 - </li>
32 - <li class="strip">
33 - <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 - <label for="" class="strip__label">
35 - <span>208</span>
36 - Data pipeline - Job Dashboard
37 - </label>
38 - <div class="strip__attribute">
39 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 - <div class="strip__attribute-label">5 minutes</div>
41 - </div>
42 - <div class="strip__attribute">
43 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 - <div class="strip__attribute-label">Developer</div>
45 - </div>
46 - </a>
47 - </li>
48 - <li class="strip">
49 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 - <label for="" class="strip__label">
51 - <span>208</span>
52 - Data pipeline - Mendix to AWS Redshift
53 - </label>
54 - <div class="strip__attribute">
55 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
56 - <div class="strip__attribute-label">10 minutes</div>
57 - </div>
58 - <div class="strip__attribute">
59 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
60 - <div class="strip__attribute-label">Developer</div>
61 - </div>
62 - </a>
63 - </li>
64 - <li class="strip">
65 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 - <label for="" class="strip__label">
67 - <span>208</span>
68 - Data pipeline - Mendix to SFTP
69 - </label>
70 - <div class="strip__attribute">
71 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
72 - <div class="strip__attribute-label">7 minutes</div>
73 - </div>
74 - <div class="strip__attribute">
75 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
76 - <div class="strip__attribute-label">Developer</div>
77 - </div>
78 - </a>
79 - </li>
80 - </ul>
81 - </main>
25 + <div class="ez-academy_body">
26 + <main class="master">
27 + <ul class="strip-container">
28 + <li class="strip">
29 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
30 + target="_blank" class="strip__link">
31 + <div class="strip__attribute__new__stack">
32 + <img class="strip__attribute-icon strip__attribute-icon--duration"
33 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
34 + </div>
35 + <label for="" class="strip__label">
36 + <span>226</span>
37 + Introduction
38 + </label>
39 + <div class="strip__attribute">
40 + <img class="strip__attribute-icon strip__attribute-icon--duration"
41 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
42 + <div class="strip__attribute-label">4 minutes</div>
43 + </div>
44 + <div class="strip__attribute">
45 + <img class="strip__attribute-icon strip__attribute-icon--roles"
46 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
47 + <div class="strip__attribute-label">Developer</div>
48 + </div>
49 + </a>
50 + </li>
51 + <li class="strip">
52 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-available-options"
53 + target="_blank" class="strip__link">
54 + <div class="strip__attribute__new__stack">
55 + <img class="strip__attribute-icon strip__attribute-icon--duration"
56 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
57 + </div>
58 + <label for="" class="strip__label">
59 + <span>226</span>
60 + Enrichment
61 + </label>
62 + <div class="strip__attribute">
63 + <img class="strip__attribute-icon strip__attribute-icon--duration"
64 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
65 + <div class="strip__attribute-label">4 minutes</div>
66 + </div>
67 + <div class="strip__attribute">
68 + <img class="strip__attribute-icon strip__attribute-icon--roles"
69 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
70 + <div class="strip__attribute-label">Developer</div>
71 + </div>
72 + </a>
73 + </li>
74 + <li class="strip">
75 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
76 + target="_blank" class="strip__link">
77 + <div class="strip__attribute__new__stack">
78 + <img class="strip__attribute-icon strip__attribute-icon--duration"
79 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
80 + </div>
81 + <label for="" class="strip__label">
82 + <span>226</span>
83 + Enrichment
84 + </label>
85 + <div class="strip__attribute">
86 + <img class="strip__attribute-icon strip__attribute-icon--duration"
87 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
88 + <div class="strip__attribute-label">6 minutes</div>
89 + </div>
90 + <div class="strip__attribute">
91 + <img class="strip__attribute-icon strip__attribute-icon--roles"
92 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
93 + <div class="strip__attribute-label">Developer</div>
94 + </div>
95 + </a>
96 + </li>
97 + <li class="strip">
98 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-driver"
99 + target="_blank" class="strip__link">
100 + <div class="strip__attribute__new__stack">
101 + <img class="strip__attribute-icon strip__attribute-icon--duration"
102 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
103 + </div>
104 + <label for="" class="strip__label">
105 + <span>226</span>
106 + Change Detection
107 + </label>
108 + <div class="strip__attribute">
109 + <img class="strip__attribute-icon strip__attribute-icon--duration"
110 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
111 + <div class="strip__attribute-label">4 minutes</div>
112 + </div>
113 + <div class="strip__attribute">
114 + <img class="strip__attribute-icon strip__attribute-icon--roles"
115 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
116 + <div class="strip__attribute-label">Developer</div>
117 + </div>
118 + </a>
119 + </li>
120 + <li class="strip">
121 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
122 + target="_blank" class="strip__link">
123 + <div class="strip__attribute__new__stack">
124 + <img class="strip__attribute-icon strip__attribute-icon--duration"
125 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
126 + </div>
127 + <label for="" class="strip__label">
128 + <span>226</span>
129 + Change Detection
130 + </label>
131 + <div class="strip__attribute">
132 + <img class="strip__attribute-icon strip__attribute-icon--duration"
133 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
134 + <div class="strip__attribute-label">6 minutes</div>
135 + </div>
136 + <div class="strip__attribute">
137 + <img class="strip__attribute-icon strip__attribute-icon--roles"
138 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
139 + <div class="strip__attribute-label">Developer</div>
140 + </div>
141 + </a>
142 + </li>
143 + <li class="strip">
144 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-sql-query"
145 + target="_blank" class="strip__link">
146 + <div class="strip__attribute__new__stack">
147 + <img class="strip__attribute-icon strip__attribute-icon--duration"
148 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
149 + </div>
150 + <label for="" class="strip__label">
151 + <span>226</span>
152 + Duplication Detection
153 + </label>
154 + <div class="strip__attribute">
155 + <img class="strip__attribute-icon strip__attribute-icon--duration"
156 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
157 + <div class="strip__attribute-label">6 minutes</div>
158 + </div>
159 + <div class="strip__attribute">
160 + <img class="strip__attribute-icon strip__attribute-icon--roles"
161 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
162 + <div class="strip__attribute-label">Developer</div>
163 + </div>
164 + </a>
165 + </li>
166 + <li class="strip">
167 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
168 + target="_blank" class="strip__link">
169 + <div class="strip__attribute__new__stack">
170 + <img class="strip__attribute-icon strip__attribute-icon--duration"
171 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
172 + </div>
173 + <label for="" class="strip__label">
174 + <span>226</span>
175 + Duplication Detection
176 + </label>
177 + <div class="strip__attribute">
178 + <img class="strip__attribute-icon strip__attribute-icon--duration"
179 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
180 + <div class="strip__attribute-label">6 minutes</div>
181 + </div>
182 + <div class="strip__attribute">
183 + <img class="strip__attribute-icon strip__attribute-icon--roles"
184 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
185 + <div class="strip__attribute-label">Developer</div>
186 + </div>
187 + </a>
188 + </li>
189 + <li class="strip">
190 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-update-database-after-retrieval"
191 + target="_blank" class="strip__link">
192 + <div class="strip__attribute__new__stack">
193 + <img class="strip__attribute-icon strip__attribute-icon--duration"
194 + src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
195 + </div>
196 + <label for="" class="strip__label">
197 + <span>226</span>
198 + Aggregation
199 + </label>
200 + <div class="strip__attribute">
201 + <img class="strip__attribute-icon strip__attribute-icon--duration"
202 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
203 + <div class="strip__attribute-label">4 minutes</div>
204 + </div>
205 + <div class="strip__attribute">
206 + <img class="strip__attribute-icon strip__attribute-icon--roles"
207 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
208 + <div class="strip__attribute-label">Developer</div>
209 + </div>
210 + </a>
211 + </li>
212 + <li class="strip">
213 + <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/Database%20connectivity/intermediate-database-connectivity-database-operations"
214 + target="_blank" class="strip__link">
215 + <div class="strip__attribute__new__stack">
216 + <img class="strip__attribute-icon strip__attribute-icon--duration"
217 + src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
218 + </div>
219 + <label for="" class="strip__label">
220 + <span>226</span>
221 + Aggregation
222 + </label>
223 + <div class="strip__attribute">
224 + <img class="strip__attribute-icon strip__attribute-icon--duration"
225 + src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
226 + <div class="strip__attribute-label">6 minutes</div>
227 + </div>
228 + <div class="strip__attribute">
229 + <img class="strip__attribute-icon strip__attribute-icon--roles"
230 + src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
231 + <div class="strip__attribute-label">Developer</div>
232 + </div>
233 + </a>
234 + </li>
235 + </ul>
236 + </main>
82 82   </div>
83 83  </div>
84 84  {{/html}}