Skip to Content
Last modified by Erik Bakker on 2024/09/24 16:19
From version 21.1
edited by Erik Bakker
on 2022/05/03 12:19
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Solution Architecture
1 +Data Pipelines
Parent
... ... @@ -1,1 +1,1 @@
1 -Main.eMagiz Academy.Microlearnings.Expert Level.WebHome
1 +Main.eMagiz Academy.Microlearnings.Intermediate Level.WebHome
Content
... ... @@ -1,18 +1,11 @@
1 -In this course, we will zoom in on various critical parts of the solution architecture. Among others, we will take a look at how you can best determine the needed memory to correctly run your eMagiz solution.
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
2 2  
3 -This first part of the course is split up into four microlearnings. At first, we look at how you can determine, regardless of where the runtime is running, how much memory each runtime and therefore each machine needs. On top of that, we learn how we can configure these calculated memory settings per runtime for each of the options where you can run your eMagiz solution on:
6 +* **Total time:** between 30 and 45 minutes
4 4  
5 -* eMagiz Cloud
6 -* On-premise Windows
7 -* On-premise Linux
8 8  
9 -In the second part of our course, we will learn how our actions and configurations in Create can impact the message size and therefore the performance of the solution.
10 -
11 -In the third part of our course, we will look at some specific implementations that you might need when implementing very specific use cases
12 -
13 -* **Total time:** between 40 and 60 minutes
14 -
15 -
16 16  (% style="border-color:#10137e" %)
17 17  ----
18 18  {{html}}
... ... @@ -21,30 +21,26 @@
21 21   <main class="master">
22 22   <ul class="strip-container">
23 23   <li class="strip">
24 - <a href="../../docs/microlearning/expert-solution-architecture-determining-needed-memory" class="strip__link">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
25 25   <label for="" class="strip__label">
26 - <span>400</span>
27 - Determining Needed Memory
19 + <span>208</span>
20 + Understanding Data Pipelines
28 28   </label>
29 29   <div class="strip__attribute">
30 30   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
31 - <div class="strip__attribute-label">13 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
32 32   </div>
33 33   <div class="strip__attribute">
34 34   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
35 35   <div class="strip__attribute-label">Developer</div>
36 36   </div>
37 - <div class="strip__attribute">
38 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
39 - <div class="strip__attribute-label">Architect</div>
40 - </div>
41 41   </a>
42 42   </li>
43 - <li class="strip">
44 - <a href="../../docs/microlearning/expert-solution-architecture-configure-needed-memory-cloud" class="strip__link">
32 + <li class="strip">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
45 45   <label for="" class="strip__label">
46 - <span>400</span>
47 - Configure Needed Memory - Cloud
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
48 48   </label>
49 49   <div class="strip__attribute">
50 50   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
... ... @@ -52,106 +52,42 @@
52 52   </div>
53 53   <div class="strip__attribute">
54 54   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
55 - <div class="strip__attribute-label">All</div>
56 - </div>
57 - </a>
58 - </li>
59 - <li class="strip">
60 - <a href="../../docs/microlearning/expert-solution-architecture-impact-message-history-on-message-size" class="strip__link">
61 - <label for="" class="strip__label">
62 - <span>400</span>
63 - Impact Message History on Message Size
64 - </label>
65 - <div class="strip__attribute">
66 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
67 - <div class="strip__attribute-label">6 minutes</div>
68 - </div>
69 - <div class="strip__attribute">
70 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
71 71   <div class="strip__attribute-label">Developer</div>
72 72   </div>
73 73   </a>
74 74   </li>
75 75   <li class="strip">
76 - <a href="../../docs/microlearning/expert-solution-architecture-h2-database-for-other-applications" class="strip__link">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
77 77   <label for="" class="strip__label">
78 - <span>400</span>
79 - H2 Database for other applications
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
80 80   </label>
81 81   <div class="strip__attribute">
82 82   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
83 - <div class="strip__attribute-label">8 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
84 84   </div>
85 85   <div class="strip__attribute">
86 86   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
87 87   <div class="strip__attribute-label">Developer</div>
88 88   </div>
89 - <div class="strip__attribute">
90 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
91 - <div class="strip__attribute-label">Architect</div>
92 - </div>
93 93   </a>
94 94   </li>
95 95   <li class="strip">
96 - <a href="../../docs/microlearning/expert-solution-architecture-aws-direct-connect" class="strip__link">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
97 97   <label for="" class="strip__label">
98 - <span>400</span>
99 - AWS Direct Connect
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
100 100   </label>
101 101   <div class="strip__attribute">
102 102   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
103 - <div class="strip__attribute-label">5 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
104 104   </div>
105 105   <div class="strip__attribute">
106 106   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
107 107   <div class="strip__attribute-label">Developer</div>
108 108   </div>
109 - <div class="strip__attribute">
110 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
111 - <div class="strip__attribute-label">Architect</div>
112 - </div>
113 113   </a>
114 114   </li>
115 - <li class="strip">
116 - <a href="../../docs/microlearning/expert-platform-deploy-install-local-connector-windows" class="strip__link">
117 - <label for="" class="strip__label">
118 - <span>400</span>
119 - Install Magiz runtime for Windows
120 - </label>
121 - <div class="strip__attribute">
122 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
123 - <div class="strip__attribute-label">5 minutes</div>
124 - </div>
125 - <div class="strip__attribute">
126 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
127 - <div class="strip__attribute-label">Developer</div>
128 - </div>
129 - <div class="strip__attribute">
130 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
131 - <div class="strip__attribute-label">Architect</div>
132 - </div>
133 - </a>
134 - </li>
135 - <li class="strip">
136 - <a href="../../docs/microlearning/expert-platform-deploy-install-local-connector-linux" class="strip__link">
137 - <label for="" class="strip__label">
138 - <span>400</span>
139 - Install Magiz runtime for Linux
140 - </label>
141 - <div class="strip__attribute">
142 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
143 - <div class="strip__attribute-label">5 minutes</div>
144 - </div>
145 - <div class="strip__attribute">
146 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
147 - <div class="strip__attribute-label">Developer</div>
148 - </div>
149 - <div class="strip__attribute">
150 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
151 - <div class="strip__attribute-label">Architect</div>
152 - </div>
153 - </a>
154 - </li>
155 155   </ul>
156 156   </main>
157 157   </div>