Skip to Content

Changes for page File based connectivity

Last modified by Erik Bakker on 2024/09/24 16:20
From version 65.1
edited by Bouke Reitsma
on 2023/09/29 13:16
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -File based connectivity
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.BoukeReitsma
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, we will learn how to use file-based components within eMagiz to set up a connection with an FTP and SFTP. We will build on what we have learned previously in the Novice course on this same topic in this course. For this course, the focus will be setting up a secure connection with the FTP and SFTP.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">40-50 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,35 +13,13 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity" target="_blank" class="strip__link">
17 - <div class="strip__attribute__new__stack">
18 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
19 - </div>
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
20 20   <label for="" class="strip__label">
21 - <span>227</span>
22 - FTP Connectivity
19 + <span>208</span>
20 + Understanding Data Pipelines
23 23   </label>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
26 - <div class="strip__attribute-label">4 minutes</div>
27 - </div>
28 - <div class="strip__attribute">
29 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
30 - <div class="strip__attribute-label">Developer</div>
31 - </div>
32 - </a>
33 - </li>
34 - <li class="strip">
35 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity-exercise" target="_blank" class="strip__link">
36 - <div class="strip__attribute__new__stack">
37 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
38 - </div>
39 - <label for="" class="strip__label">
40 - <span>227</span>
41 - FTP Connectivity
42 - </label>
43 - <div class="strip__attribute">
44 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
45 45   <div class="strip__attribute-label">5 minutes</div>
46 46   </div>
47 47   <div class="strip__attribute">
... ... @@ -51,35 +51,13 @@
51 51   </a>
52 52   </li>
53 53   <li class="strip">
54 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity" target="_blank" class="strip__link">
55 - <div class="strip__attribute__new__stack">
56 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
57 - </div>
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
58 58   <label for="" class="strip__label">
59 - <span>227</span>
60 - SFTP Connectivity
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
61 61   </label>
62 62   <div class="strip__attribute">
63 63   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
64 - <div class="strip__attribute-label">4 minutes</div>
65 - </div>
66 - <div class="strip__attribute">
67 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
68 - <div class="strip__attribute-label">Developer</div>
69 - </div>
70 - </a>
71 - </li>
72 - <li class="strip">
73 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity-exercise" target="_blank" class="strip__link">
74 - <div class="strip__attribute__new__stack">
75 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
76 - </div>
77 - <label for="" class="strip__label">
78 - <span>227</span>
79 - SFTP Connectivity
80 - </label>
81 - <div class="strip__attribute">
82 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
83 83   <div class="strip__attribute-label">5 minutes</div>
84 84   </div>
85 85   <div class="strip__attribute">
... ... @@ -89,17 +89,14 @@
89 89   </a>
90 90   </li>
91 91   <li class="strip">
92 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-emagiz-sftp-connectivity" target="_blank" class="strip__link">
93 - <div class="strip__attribute__new__stack">
94 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
95 - </div>
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
96 96   <label for="" class="strip__label">
97 - <span>227</span>
98 - eMagiz SFTP Connectivity
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
99 99   </label>
100 100   <div class="strip__attribute">
101 101   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
102 - <div class="strip__attribute-label">6 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
103 103   </div>
104 104   <div class="strip__attribute">
105 105   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -108,17 +108,14 @@
108 108   </a>
109 109   </li>
110 110   <li class="strip">
111 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/eMagiz%20SFTP%20Connection%20guide" target="_blank" class="strip__link">
112 - <div class="strip__attribute__new__stack">
113 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
114 - </div>
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
115 115   <label for="" class="strip__label">
116 - <span>227</span>
117 - eMagiz SFTP Connection guide
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
118 118   </label>
119 119   <div class="strip__attribute">
120 120   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
121 - <div class="strip__attribute-label">3 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
122 122   </div>
123 123   <div class="strip__attribute">
124 124   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -126,44 +126,6 @@
126 126   </div>
127 127   </a>
128 128   </li>
129 - <li class="strip">
130 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/eMagiz%20SFTP%20-exercise" target="_blank" class="strip__link">
131 - <div class="strip__attribute__new__stack">
132 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
133 - </div>
134 - <label for="" class="strip__label">
135 - <span>227</span>
136 - eMagiz SFTP
137 - </label>
138 - <div class="strip__attribute">
139 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
140 - <div class="strip__attribute-label">5 minutes</div>
141 - </div>
142 - <div class="strip__attribute">
143 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
144 - <div class="strip__attribute-label">Developer</div>
145 - </div>
146 - </a>
147 - </li>
148 - <li class="strip">
149 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-security" target="_blank" class="strip__link">
150 - <div class="strip__attribute__new__stack">
151 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
152 - </div>
153 - <label for="" class="strip__label">
154 - <span>227</span>
155 - SFTP Security
156 - </label>
157 - <div class="strip__attribute">
158 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
159 - <div class="strip__attribute-label">5 minutes</div>
160 - </div>
161 - <div class="strip__attribute">
162 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
163 - <div class="strip__attribute-label">Developer</div>
164 - </div>
165 - </a>
166 - </li>
167 167   </ul>
168 168   </main>
169 169   </div>