Skip to Content
Last modified by Erik Bakker on 2024/02/21 21:51
From version 16.1
edited by Eva Torken
on 2023/08/10 13:54
Change comment: There is no comment for this version
To version 14.1
edited by eMagiz
on 2022/06/09 12:35
Change comment: There is no comment for this version

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.etorken
1 +XWiki.eMagiz
Default language
... ... @@ -1,1 +1,0 @@
1 -en
Content
... ... @@ -7,6 +7,9 @@
7 7  
8 8  Should you have any questions, please contact academy@emagiz.com.
9 9  
10 +* Last update: April 1th 2021
11 +* Required reading time: 5 minutes
12 +
10 10  == 1. Prerequisites ==
11 11  
12 12  * Basic knowledge of the eMagiz platform
... ... @@ -19,6 +19,8 @@
19 19  
20 20  In this microlearning, we will explain a bit about what the data pipeline pattern in eMagiz means and see which choices you have for source and sink systems.
21 21  
25 +
26 +
22 22  == 3. Understanding Data Pipelines ==
23 23  
24 24  Imagine you are a global event organizer and want to track which events were hits and misses during the year.
... ... @@ -51,17 +51,32 @@
51 51  * Azure Event Hub
52 52  * Database
53 53  * Remote directory (FTP or SFTP) in flat-file (CSV) format
59 +
60 +== 4. Assignment ==
54 54  
55 -== 4. Key takeaways ==
62 +Browse the public store of eMagiz to see which combinations of source and sink systems are used frequently and are therefore standardized.
63 +This assignment can be completed with the help of the (Academy) project that you have created/used in the previous assignment.
56 56  
65 +== 5. Key takeaways ==
66 +
57 57  * A data pipeline is useful when transferring large volumes of data without the need for transformation
58 58  * Data pipelines are a standardized piece of software in eMagiz that can be implemented with ease
59 59  * eMagiz offers a limited number of source and sink options when you use the data pipeline pattern.
60 60  
61 -== 5. Suggested Additional Readings ==
62 62  
72 +
73 +== 6. Suggested Additional Readings ==
74 +
63 63  If you are interested in this topic and want more information on it please read the help text provided by eMagiz.
64 -)))
65 65  
77 +== 7. Silent demonstration video ==
78 +
79 +This video demonstrates a working solution and how you can validate whether the refresh has worked in AWS Redshift.
80 +
81 +
82 +{{video attachment="intermediate-datapipelines-understanding-data-pipelines.mp4" reference="Main.Videos.Microlearning.WebHome"/}}
83 +
84 + )))
85 +
66 66  ((({{toc/}}))){{/container}}
67 67  {{/container}}