Skip to Content
Last modified by Erik Bakker on 2024/09/24 16:19
From version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version
To version 16.2
edited by Erik Bakker
on 2022/05/03 11:21
Change comment: Update document after refactoring.

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Data Pipelines
1 +Data Handling
Parent
... ... @@ -1,1 +1,1 @@
1 -Main.eMagiz Academy.Microlearnings.Intermediate Level.WebHome
1 +Main.eMagiz Academy.Microlearnings.Advanced Level.WebHome
Content
... ... @@ -1,11 +1,10 @@
1 -In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 -eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 -Within eMagiz, we support several combinations of those source and sink systems.
4 -For the combinations that are used most, we have made separate microlearnings to explain how they work.
1 +In this section, we will focus on various migration paths available to migrate from a legacy approach to a new approach.
5 5  
6 -* **Total time:** between 30 and 45 minutes
7 7  
4 +* **Total time:** between 60 and 90 minutes
5 +* **Last updated:** March 2022
8 8  
7 +
9 9  (% style="border-color:#10137e" %)
10 10  ----
11 11  {{html}}
... ... @@ -14,69 +14,197 @@
14 14   <main class="master">
15 15   <ul class="strip-container">
16 16   <li class="strip">
17 - <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
18 - <label for="" class="strip__label">
19 - <span>208</span>
20 - Understanding Data Pipelines
21 - </label>
22 - <div class="strip__attribute">
23 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
24 - <div class="strip__attribute-label">5 minutes</div>
25 - </div>
26 - <div class="strip__attribute">
27 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
28 - <div class="strip__attribute-label">Developer</div>
29 - </div>
30 - </a>
31 - </li>
32 - <li class="strip">
33 - <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
34 - <label for="" class="strip__label">
35 - <span>208</span>
36 - Data pipeline - Job Dashboard
37 - </label>
38 - <div class="strip__attribute">
39 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
40 - <div class="strip__attribute-label">5 minutes</div>
41 - </div>
42 - <div class="strip__attribute">
43 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
44 - <div class="strip__attribute-label">Developer</div>
45 - </div>
46 - </a>
47 - </li>
48 - <li class="strip">
49 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
50 - <label for="" class="strip__label">
51 - <span>208</span>
52 - Data pipeline - Mendix to AWS Redshift
53 - </label>
54 - <div class="strip__attribute">
55 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
56 - <div class="strip__attribute-label">10 minutes</div>
57 - </div>
58 - <div class="strip__attribute">
59 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
60 - <div class="strip__attribute-label">Developer</div>
61 - </div>
62 - </a>
63 - </li>
64 - <li class="strip">
65 - <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
66 - <label for="" class="strip__label">
67 - <span>208</span>
68 - Data pipeline - Mendix to SFTP
69 - </label>
70 - <div class="strip__attribute">
71 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
72 - <div class="strip__attribute-label">7 minutes</div>
73 - </div>
74 - <div class="strip__attribute">
75 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
76 - <div class="strip__attribute-label">Developer</div>
77 - </div>
78 - </a>
79 - </li>
16 + <a href="../../docs/migrationpath/migration-path-root-cloud-to-emagiz-cloud" class="strip__link">
17 + <label for="" class="strip__label">
18 + <span>1</span>
19 + Root cloud to eMagiz Cloud
20 + </label>
21 + <div class="strip__attribute">
22 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
23 + <div class="strip__attribute-label">6 minutes</div>
24 + </div>
25 + <div class="strip__attribute">
26 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
27 + <div class="strip__attribute-label">Developer</div>
28 + </div>
29 + </a>
30 + </li>
31 + <li class="strip">
32 + <a href="../../docs/migrationpath/migration-path-emagiz-mendix-connector-4.2.0-to-5.0.0" class="strip__link">
33 + <label for="" class="strip__label">
34 + <span>1</span>
35 + eMagiz Mendix Connector - version 4.2.0 to 5.0.0
36 + </label>
37 + <div class="strip__attribute">
38 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
39 + <div class="strip__attribute-label">4 minutes</div>
40 + </div>
41 + <div class="strip__attribute">
42 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
43 + <div class="strip__attribute-label">Developer</div>
44 + </div>
45 + </a>
46 + </li>
47 + <li class="strip">
48 + <a href="../../docs/migrationpath/migration-path-error-handling-synchronous-messaging-flows" class="strip__link">
49 + <label for="" class="strip__label">
50 + <span>1</span>
51 + Error Handling Synchronous Messaging Flows
52 + </label>
53 + <div class="strip__attribute">
54 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
55 + <div class="strip__attribute-label">6 minutes</div>
56 + </div>
57 + <div class="strip__attribute">
58 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
59 + <div class="strip__attribute-label">Developer</div>
60 + </div>
61 + </a>
62 + </li>
63 + <li class="strip">
64 + <a href="../../docs/migrationpath/migration-path-emagiz-error-flow" class="strip__link">
65 + <label for="" class="strip__label">
66 + <span>1</span>
67 + Error Flow
68 + </label>
69 + <div class="strip__attribute">
70 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
71 + <div class="strip__attribute-label">4 minutes</div>
72 + </div>
73 + <div class="strip__attribute">
74 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
75 + <div class="strip__attribute-label">Developer</div>
76 + </div>
77 + </a>
78 + </li>
79 + <li class="strip">
80 + <a href="../../docs/migrationpath/migration-path-aws-redshift-refresh" class="strip__link">
81 + <label for="" class="strip__label">
82 + <span>1</span>
83 + AWS Redshift Refresh
84 + </label>
85 + <div class="strip__attribute">
86 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
87 + <div class="strip__attribute-label">6 minutes</div>
88 + </div>
89 + <div class="strip__attribute">
90 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
91 + <div class="strip__attribute-label">Developer</div>
92 + </div>
93 + </a>
94 + </li>
95 + <li class="strip">
96 + <a href="../../docs/migrationpath/migration-path-job-dashboard-cleanup" class="strip__link">
97 + <label for="" class="strip__label">
98 + <span>1</span>
99 + Job Dashboard Cleanup
100 + </label>
101 + <div class="strip__attribute">
102 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
103 + <div class="strip__attribute-label">6 minutes</div>
104 + </div>
105 + <div class="strip__attribute">
106 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
107 + <div class="strip__attribute-label">Developer</div>
108 + </div>
109 + </a>
110 + </li>
111 + <li class="strip">
112 + <a href="../../docs/migrationpath/migration-path-hosting-a-custom-rest-webservice" class="strip__link">
113 + <label for="" class="strip__label">
114 + <span>1</span>
115 + Hosting a custom REST Webservice
116 + </label>
117 + <div class="strip__attribute">
118 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
119 + <div class="strip__attribute-label">5 minutes</div>
120 + </div>
121 + <div class="strip__attribute">
122 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
123 + <div class="strip__attribute-label">Developer</div>
124 + </div>
125 + </a>
126 + </li>
127 + <li class="strip">
128 + <a href="../../docs/migrationpath/migration-path-json-related-transformations" class="strip__link">
129 + <label for="" class="strip__label">
130 + <span>1</span>
131 + JSON Related Transformations
132 + </label>
133 + <div class="strip__attribute">
134 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
135 + <div class="strip__attribute-label">6 minutes</div>
136 + </div>
137 + <div class="strip__attribute">
138 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
139 + <div class="strip__attribute-label">Developer</div>
140 + </div>
141 + </a>
142 + </li>
143 + <li class="strip">
144 + <a href="../../docs/migrationpath/migration-path-old-transformation-tooling" class="strip__link">
145 + <label for="" class="strip__label">
146 + <span>1</span>
147 + Old Transformation Tooling
148 + </label>
149 + <div class="strip__attribute">
150 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
151 + <div class="strip__attribute-label">7 minutes</div>
152 + </div>
153 + <div class="strip__attribute">
154 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
155 + <div class="strip__attribute-label">Developer</div>
156 + </div>
157 + </a>
158 + </li>
159 + <li class="strip">
160 + <a href="../../docs/migrationpath/migration-path-removing-headers-from-your-message" class="strip__link">
161 + <label for="" class="strip__label">
162 + <span>1</span>
163 + Removing Headers from your message
164 + </label>
165 + <div class="strip__attribute">
166 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
167 + <div class="strip__attribute-label">4 minutes</div>
168 + </div>
169 + <div class="strip__attribute">
170 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
171 + <div class="strip__attribute-label">Developer</div>
172 + </div>
173 + </a>
174 + </li>
175 + <li class="strip">
176 + <a href="../../docs/migrationpath/migration-path-legacy-components" class="strip__link">
177 + <label for="" class="strip__label">
178 + <span>1</span>
179 + Legacy Components
180 + </label>
181 + <div class="strip__attribute">
182 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
183 + <div class="strip__attribute-label">3 minutes</div>
184 + </div>
185 + <div class="strip__attribute">
186 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
187 + <div class="strip__attribute-label">Developer</div>
188 + </div>
189 + </a>
190 + </li>
191 + <li class="strip">
192 + <a href="../../docs/migrationpath/migration-path-emagiz-runtime-generation-3" class="strip__link">
193 + <label for="" class="strip__label">
194 + <span>1</span>
195 + eMagiz Runtime Generation 3
196 + </label>
197 + <div class="strip__attribute">
198 + <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
199 + <div class="strip__attribute-label">6 minutes</div>
200 + </div>
201 + <div class="strip__attribute">
202 + <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
203 + <div class="strip__attribute-label">Architect</div>
204 + </div>
205 + </a>
206 + </li>
80 80   </ul>
81 81   </main>
82 82   </div>