Skip to Content
Last modified by Erik Bakker on 2024/02/21 21:51
From version 14.1
edited by eMagiz
on 2022/06/09 12:35
Change comment: There is no comment for this version
To version 17.1
edited by Eva Torken
on 2024/02/21 21:51
Change comment: Renamed from xwiki:Main.eMagiz Academy.Microlearnings.Intermediate Level.Data Pipelines.intermediate-data-pipelines-understanding-data-pipelines

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.eMagiz
1 +XWiki.etorken
Default language
... ... @@ -1,0 +1,1 @@
1 +en
Content
... ... @@ -7,9 +7,6 @@
7 7  
8 8  Should you have any questions, please contact academy@emagiz.com.
9 9  
10 -* Last update: April 1th 2021
11 -* Required reading time: 5 minutes
12 -
13 13  == 1. Prerequisites ==
14 14  
15 15  * Basic knowledge of the eMagiz platform
... ... @@ -22,8 +22,6 @@
22 22  
23 23  In this microlearning, we will explain a bit about what the data pipeline pattern in eMagiz means and see which choices you have for source and sink systems.
24 24  
25 -
26 -
27 27  == 3. Understanding Data Pipelines ==
28 28  
29 29  Imagine you are a global event organizer and want to track which events were hits and misses during the year.
... ... @@ -56,32 +56,17 @@
56 56  * Azure Event Hub
57 57  * Database
58 58  * Remote directory (FTP or SFTP) in flat-file (CSV) format
59 -
60 -== 4. Assignment ==
61 61  
62 -Browse the public store of eMagiz to see which combinations of source and sink systems are used frequently and are therefore standardized.
63 -This assignment can be completed with the help of the (Academy) project that you have created/used in the previous assignment.
55 +== 4. Key takeaways ==
64 64  
65 -== 5. Key takeaways ==
66 -
67 67  * A data pipeline is useful when transferring large volumes of data without the need for transformation
68 68  * Data pipelines are a standardized piece of software in eMagiz that can be implemented with ease
69 69  * eMagiz offers a limited number of source and sink options when you use the data pipeline pattern.
70 70  
61 +== 5. Suggested Additional Readings ==
71 71  
72 -
73 -== 6. Suggested Additional Readings ==
74 -
75 75  If you are interested in this topic and want more information on it please read the help text provided by eMagiz.
64 +)))
76 76  
77 -== 7. Silent demonstration video ==
78 -
79 -This video demonstrates a working solution and how you can validate whether the refresh has worked in AWS Redshift.
80 -
81 -
82 -{{video attachment="intermediate-datapipelines-understanding-data-pipelines.mp4" reference="Main.Videos.Microlearning.WebHome"/}}
83 -
84 - )))
85 -
86 86  ((({{toc/}}))){{/container}}
87 87  {{/container}}