Skip to Content

Changes for page State Generation

Last modified by Erik Bakker on 2024/09/24 16:22
From version 77.1
edited by Danniar Firdausy
on 2024/07/24 11:26
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -State Generation
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.dfirdausy
1 +XWiki.ebakker
Content
... ... @@ -1,243 +1,84 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((
6 -In this course, we will focus on the concept of state generation and how to properly implement it with the help of the eMagiz platform. This course focuses on the four state generation solutions that eMagiz provides, as well as the instruction to set up the mechanism to persist your state.
6 +* **Total time:** between 30 and 45 minutes
7 7  
8 -{{info}}Note that to use the state generation functionality that is explained here, a state generation license for your model is required.{{/info}}
9 9  
10 -)))((({{html}}<div class="strip__attribute"
11 - style="text-align:center">
12 - <table>
13 - <tr>
14 - <td><img class="strip__attribute-icon strip__attribute-icon--duration"
15 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" /></td>
16 - </tr>
17 - <tr>
18 - <td>
19 - <div class="strip__attribute-label">20-30 minutes</div>
20 - </td>
21 - </tr>
22 - </table>
23 -</div>{{/html}}))){{/container}}{{/container}}
24 -
25 25  (% style="border-color:#10137e" %)
26 26  ----
27 27  {{html}}
28 28  <div class="ez-academy">
29 - <div class="ez-academy_body">
30 - <main class="master">
31 - <ul class="strip-container">
32 - <li class="strip">
33 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-state-persistance-setup"
34 - target="_blank" class="strip__link">
35 - <div class="strip__attribute__new__stack">
36 - <img class="strip__attribute-icon strip__attribute-icon--duration"
37 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
38 - </div>
39 - <label for="" class="strip__label">
40 - <span>226</span>
41 - State Persistance Setup
42 - </label>
43 - <div class="strip__attribute">
44 - <img class="strip__attribute-icon strip__attribute-icon--duration"
45 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
46 - <div class="strip__attribute-label">5 minutes</div>
47 - </div>
48 - <div class="strip__attribute">
49 - <img class="strip__attribute-icon strip__attribute-icon--roles"
50 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
51 - <div class="strip__attribute-label">Developer</div>
52 - </div>
53 - </a>
54 - </li>
55 - <li class="strip">
56 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-state-generation-enrichment"
57 - target="_blank" class="strip__link">
58 - <div class="strip__attribute__new__stack">
59 - <img class="strip__attribute-icon strip__attribute-icon--duration"
60 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
61 - </div>
62 - <label for="" class="strip__label">
63 - <span>226</span>
64 - Enrichment
65 - </label>
66 - <div class="strip__attribute">
67 - <img class="strip__attribute-icon strip__attribute-icon--duration"
68 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
69 - <div class="strip__attribute-label">5 minutes</div>
70 - </div>
71 - <div class="strip__attribute">
72 - <img class="strip__attribute-icon strip__attribute-icon--roles"
73 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
74 - <div class="strip__attribute-label">Developer</div>
75 - </div>
76 - </a>
77 - </li>
78 - <!-- <li class="strip">
79 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-database-connectivity-database-operations"
80 - target="_blank" class="strip__link">
81 - <div class="strip__attribute__new__stack">
82 - <img class="strip__attribute-icon strip__attribute-icon--duration"
83 - src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
84 - </div>
85 - <label for="" class="strip__label">
86 - <span>226</span>
87 - Enrichment
88 - </label>
89 - <div class="strip__attribute">
90 - <img class="strip__attribute-icon strip__attribute-icon--duration"
91 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
92 - <div class="strip__attribute-label">6 minutes</div>
93 - </div>
94 - <div class="strip__attribute">
95 - <img class="strip__attribute-icon strip__attribute-icon--roles"
96 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
97 - <div class="strip__attribute-label">Developer</div>
98 - </div>
99 - </a>
100 - </li> -->
101 - <li class="strip">
102 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-state-generation-change-detection"
103 - target="_blank" class="strip__link">
104 - <div class="strip__attribute__new__stack">
105 - <img class="strip__attribute-icon strip__attribute-icon--duration"
106 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
107 - </div>
108 - <label for="" class="strip__label">
109 - <span>226</span>
110 - Change Detection
111 - </label>
112 - <div class="strip__attribute">
113 - <img class="strip__attribute-icon strip__attribute-icon--duration"
114 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
115 - <div class="strip__attribute-label">5 minutes</div>
116 - </div>
117 - <div class="strip__attribute">
118 - <img class="strip__attribute-icon strip__attribute-icon--roles"
119 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
120 - <div class="strip__attribute-label">Developer</div>
121 - </div>
122 - </a>
123 - </li>
124 - <!-- <li class="strip">
125 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-database-connectivity-database-operations"
126 - target="_blank" class="strip__link">
127 - <div class="strip__attribute__new__stack">
128 - <img class="strip__attribute-icon strip__attribute-icon--duration"
129 - src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
130 - </div>
131 - <label for="" class="strip__label">
132 - <span>226</span>
133 - Change Detection
134 - </label>
135 - <div class="strip__attribute">
136 - <img class="strip__attribute-icon strip__attribute-icon--duration"
137 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
138 - <div class="strip__attribute-label">6 minutes</div>
139 - </div>
140 - <div class="strip__attribute">
141 - <img class="strip__attribute-icon strip__attribute-icon--roles"
142 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
143 - <div class="strip__attribute-label">Developer</div>
144 - </div>
145 - </a>
146 - </li> -->
147 - <li class="strip">
148 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-state-generation-duplicate-detection"
149 - target="_blank" class="strip__link">
150 - <div class="strip__attribute__new__stack">
151 - <img class="strip__attribute-icon strip__attribute-icon--duration"
152 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
153 - </div>
154 - <label for="" class="strip__label">
155 - <span>226</span>
156 - Duplicate Detection
157 - </label>
158 - <div class="strip__attribute">
159 - <img class="strip__attribute-icon strip__attribute-icon--duration"
160 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
161 - <div class="strip__attribute-label">5 minutes</div>
162 - </div>
163 - <div class="strip__attribute">
164 - <img class="strip__attribute-icon strip__attribute-icon--roles"
165 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
166 - <div class="strip__attribute-label">Developer</div>
167 - </div>
168 - </a>
169 - </li>
170 - <!-- <li class="strip">
171 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-database-connectivity-database-operations"
172 - target="_blank" class="strip__link">
173 - <div class="strip__attribute__new__stack">
174 - <img class="strip__attribute-icon strip__attribute-icon--duration"
175 - src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
176 - </div>
177 - <label for="" class="strip__label">
178 - <span>226</span>
179 - Duplication Detection
180 - </label>
181 - <div class="strip__attribute">
182 - <img class="strip__attribute-icon strip__attribute-icon--duration"
183 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
184 - <div class="strip__attribute-label">6 minutes</div>
185 - </div>
186 - <div class="strip__attribute">
187 - <img class="strip__attribute-icon strip__attribute-icon--roles"
188 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
189 - <div class="strip__attribute-label">Developer</div>
190 - </div>
191 - </a>
192 - </li> -->
193 - <li class="strip">
194 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-state-generation-aggregation"
195 - target="_blank" class="strip__link">
196 - <div class="strip__attribute__new__stack">
197 - <img class="strip__attribute-icon strip__attribute-icon--duration"
198 - src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg" />
199 - </div>
200 - <label for="" class="strip__label">
201 - <span>226</span>
202 - Aggregation
203 - </label>
204 - <div class="strip__attribute">
205 - <img class="strip__attribute-icon strip__attribute-icon--duration"
206 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
207 - <div class="strip__attribute-label">5 minutes</div>
208 - </div>
209 - <div class="strip__attribute">
210 - <img class="strip__attribute-icon strip__attribute-icon--roles"
211 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
212 - <div class="strip__attribute-label">Developer</div>
213 - </div>
214 - </a>
215 - </li>
216 - <!-- <li class="strip">
217 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/State%20Generation/intermediate-database-connectivity-database-operations"
218 - target="_blank" class="strip__link">
219 - <div class="strip__attribute__new__stack">
220 - <img class="strip__attribute-icon strip__attribute-icon--duration"
221 - src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg" />
222 - </div>
223 - <label for="" class="strip__label">
224 - <span>226</span>
225 - Aggregation
226 - </label>
227 - <div class="strip__attribute">
228 - <img class="strip__attribute-icon strip__attribute-icon--duration"
229 - src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg" />
230 - <div class="strip__attribute-label">6 minutes</div>
231 - </div>
232 - <div class="strip__attribute">
233 - <img class="strip__attribute-icon strip__attribute-icon--roles"
234 - src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg" />
235 - <div class="strip__attribute-label">Developer</div>
236 - </div>
237 - </a>
238 - </li> -->
239 - </ul>
240 - </main>
13 + <div class="ez-academy_body">
14 + <main class="master">
15 + <ul class="strip-container">
16 + <li class="strip">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 + <label for="" class="strip__label">
19 + <span>208</span>
20 + Understanding Data Pipelines
21 + </label>
22 + <div class="strip__attribute">
23 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
24 + <div class="strip__attribute-label">5 minutes</div>
25 + </div>
26 + <div class="strip__attribute">
27 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
28 + <div class="strip__attribute-label">Developer</div>
29 + </div>
30 + </a>
31 + </li>
32 + <li class="strip">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 + <label for="" class="strip__label">
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
37 + </label>
38 + <div class="strip__attribute">
39 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 + <div class="strip__attribute-label">5 minutes</div>
41 + </div>
42 + <div class="strip__attribute">
43 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 + <div class="strip__attribute-label">Developer</div>
45 + </div>
46 + </a>
47 + </li>
48 + <li class="strip">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 + <label for="" class="strip__label">
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
53 + </label>
54 + <div class="strip__attribute">
55 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
56 + <div class="strip__attribute-label">10 minutes</div>
57 + </div>
58 + <div class="strip__attribute">
59 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
60 + <div class="strip__attribute-label">Developer</div>
61 + </div>
62 + </a>
63 + </li>
64 + <li class="strip">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 + <label for="" class="strip__label">
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
69 + </label>
70 + <div class="strip__attribute">
71 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
72 + <div class="strip__attribute-label">7 minutes</div>
73 + </div>
74 + <div class="strip__attribute">
75 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
76 + <div class="strip__attribute-label">Developer</div>
77 + </div>
78 + </a>
79 + </li>
80 + </ul>
81 + </main>
241 241   </div>
242 242  </div>
243 243  {{/html}}