Skip to Content

Changes for page File based connectivity

Last modified by Erik Bakker on 2024/09/24 16:20
From version 63.1
edited by Bouke Reitsma
on 2023/09/29 13:07
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -File based connectivity
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.BoukeReitsma
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, we will learn how to use file-based components within eMagiz to set up a connection with an FTP and SFTP. We will build on what we have learned previously in the Novice course on this same topic in this course. For this course, the focus will be setting up a secure connection with the FTP and SFTP.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">40-50 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,35 +13,13 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity" target="_blank" class="strip__link">
17 - <div class="strip__attribute__new__stack">
18 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
19 - </div>
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
20 20   <label for="" class="strip__label">
21 - <span>227</span>
22 - FTP Connectivity
19 + <span>208</span>
20 + Understanding Data Pipelines
23 23   </label>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
26 - <div class="strip__attribute-label">4 minutes</div>
27 - </div>
28 - <div class="strip__attribute">
29 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
30 - <div class="strip__attribute-label">Developer</div>
31 - </div>
32 - </a>
33 - </li>
34 - <li class="strip">
35 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity-exercise" target="_blank" class="strip__link">
36 - <div class="strip__attribute__new__stack">
37 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
38 - </div>
39 - <label for="" class="strip__label">
40 - <span>227</span>
41 - FTP Connectivity
42 - </label>
43 - <div class="strip__attribute">
44 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
45 45   <div class="strip__attribute-label">5 minutes</div>
46 46   </div>
47 47   <div class="strip__attribute">
... ... @@ -51,35 +51,13 @@
51 51   </a>
52 52   </li>
53 53   <li class="strip">
54 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity" target="_blank" class="strip__link">
55 - <div class="strip__attribute__new__stack">
56 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
57 - </div>
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
58 58   <label for="" class="strip__label">
59 - <span>227</span>
60 - SFTP Connectivity
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
61 61   </label>
62 62   <div class="strip__attribute">
63 63   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
64 - <div class="strip__attribute-label">4 minutes</div>
65 - </div>
66 - <div class="strip__attribute">
67 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
68 - <div class="strip__attribute-label">Developer</div>
69 - </div>
70 - </a>
71 - </li>
72 - <li class="strip">
73 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity-exercise" target="_blank" class="strip__link">
74 - <div class="strip__attribute__new__stack">
75 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
76 - </div>
77 - <label for="" class="strip__label">
78 - <span>227</span>
79 - SFTP Connectivity
80 - </label>
81 - <div class="strip__attribute">
82 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
83 83   <div class="strip__attribute-label">5 minutes</div>
84 84   </div>
85 85   <div class="strip__attribute">
... ... @@ -89,14 +89,14 @@
89 89   </a>
90 90   </li>
91 91   <li class="strip">
92 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-emagiz-sftp-connectivity" target="_blank" class="strip__link">
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
93 93   <label for="" class="strip__label">
94 - <span>227</span>
95 - eMagiz SFTP Connectivity
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
96 96   </label>
97 97   <div class="strip__attribute">
98 98   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
99 - <div class="strip__attribute-label">9 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
100 100   </div>
101 101   <div class="strip__attribute">
102 102   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -105,14 +105,14 @@
105 105   </a>
106 106   </li>
107 107   <li class="strip">
108 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-security" target="_blank" class="strip__link">
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
109 109   <label for="" class="strip__label">
110 - <span>227</span>
111 - SFTP Security
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
112 112   </label>
113 113   <div class="strip__attribute">
114 114   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
115 - <div class="strip__attribute-label">5 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
116 116   </div>
117 117   <div class="strip__attribute">
118 118   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -120,22 +120,6 @@
120 120   </div>
121 121   </a>
122 122   </li>
123 - <li class="strip">
124 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/eMagiz%20SFTP%20Connection%20guide" target="_blank" class="strip__link">
125 - <label for="" class="strip__label">
126 - <span>227</span>
127 - eMagiz SFTP Connection guide
128 - </label>
129 - <div class="strip__attribute">
130 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
131 - <div class="strip__attribute-label">5 minutes</div>
132 - </div>
133 - <div class="strip__attribute">
134 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
135 - <div class="strip__attribute-label">Developer</div>
136 - </div>
137 - </a>
138 - </li>
139 139   </ul>
140 140   </main>
141 141   </div>