Last modified by Erik Bakker on 2024/09/24 16:19
From version 32.1
edited by Erik Bakker
on 2022/05/03 13:16
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Solution Architecture
1 +Data Pipelines
Content
... ... @@ -1,6 +1,9 @@
1 -In this course, we will zoom in on various architectural aspects of the platform. We will zoom in on the choices to be made in Capture when choosing the correct system for the job. We will take a look at the various platform components that are important in eMagiz. We will expand our knowledge of Design Architecture. We learn how to update our memory settings for on-premise installations. Also, we will take a look at what the H2 database is and why it is in every entry (or should be). Last but not least we will take a look at the importance of topic storage. As you can see quite a mixed bag of topics. This should broaden your knowledge of the architectural sides of the platform.
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
2 2  
3 -* **Total time:** between 45 and 60 minutes
6 +* **Total time:** between 30 and 45 minutes
4 4  
5 5  
6 6  (% style="border-color:#10137e" %)
... ... @@ -11,10 +11,10 @@
11 11   <main class="master">
12 12   <ul class="strip-container">
13 13   <li class="strip">
14 - <a href="../../docs/microlearning/intermediate-solution-architecture-system-vs-multi-tenant-system" class="strip__link">
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
15 15   <label for="" class="strip__label">
16 - <span>204</span>
17 - System vs Multi-tenant system
19 + <span>208</span>
20 + Understanding Data Pipelines
18 18   </label>
19 19   <div class="strip__attribute">
20 20   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
... ... @@ -24,94 +24,54 @@
24 24   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
25 25   <div class="strip__attribute-label">Developer</div>
26 26   </div>
27 - <div class="strip__attribute">
28 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
29 - <div class="strip__attribute-label">Architect</div>
30 - </div>
31 31   </a>
32 32   </li>
33 33   <li class="strip">
34 - <a href="../../docs/microlearning/intermediate-solution-architecture-explaining-platform-components" class="strip__link">
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
35 35   <label for="" class="strip__label">
36 - <span>204</span>
37 - Explaining Platform Components
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
38 38   </label>
39 39   <div class="strip__attribute">
40 40   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
41 - <div class="strip__attribute-label">9 minutes</div>
40 + <div class="strip__attribute-label">5 minutes</div>
42 42   </div>
43 43   <div class="strip__attribute">
44 44   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
45 - <div class="strip__attribute-label">All</div>
44 + <div class="strip__attribute-label">Developer</div>
46 46   </div>
47 47   </a>
48 48   </li>
49 49   <li class="strip">
50 - <a href="../../docs/microlearning/intermediate-solution-architecture-understanding-design-architecture" class="strip__link">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
51 51   <label for="" class="strip__label">
52 - <span>204</span>
53 - Understanding Design Architecture
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
54 54   </label>
55 55   <div class="strip__attribute">
56 56   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
57 - <div class="strip__attribute-label">6 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
58 58   </div>
59 59   <div class="strip__attribute">
60 60   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
61 - <div class="strip__attribute-label">All</div>
60 + <div class="strip__attribute-label">Developer</div>
62 62   </div>
63 63   </a>
64 64   </li>
65 65   <li class="strip">
66 - <a href="../../docs/microlearning/intermediate-solution-architecture-edit-memory-on-premise-runtime-windows" class="strip__link">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
67 67   <label for="" class="strip__label">
68 - <span>204</span>
69 - Edit memory for on-premise runtime (Windows)
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
70 70   </label>
71 71   <div class="strip__attribute">
72 72   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
73 - <div class="strip__attribute-label">6 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
74 74   </div>
75 75   <div class="strip__attribute">
76 76   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
77 - <div class="strip__attribute-label">All</div>
78 - </div>
79 - </a>
80 - </li>
81 - <li class="strip">
82 - <a href="../../docs/microlearning/intermediate-solution-architecture-function-of-h2-database" class="strip__link">
83 - <label for="" class="strip__label">
84 - <span>204</span>
85 - H2 Database, Function
86 - </label>
87 - <div class="strip__attribute">
88 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
89 - <div class="strip__attribute-label">5 minutes</div>
90 - </div>
91 - <div class="strip__attribute">
92 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
93 - <div class="strip__attribute-label">All</div>
94 - </div>
95 - </a>
96 - </li>
97 - <li class="strip">
98 - <a href="../../docs/microlearning/intermediate-solution-architecture-topic-storage" class="strip__link">
99 - <label for="" class="strip__label">
100 - <span>204</span>
101 - Topic Storage
102 - </label>
103 - <div class="strip__attribute">
104 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
105 - <div class="strip__attribute-label">5 minutes</div>
106 - </div>
107 - <div class="strip__attribute">
108 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
109 109   <div class="strip__attribute-label">Developer</div>
110 110   </div>
111 - <div class="strip__attribute">
112 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
113 - <div class="strip__attribute-label">Architect</div>
114 - </div>
115 115   </a>
116 116   </li>
117 117   </ul>