Skip to Content
Last modified by Erik Bakker on 2024/02/21 21:52
From version 25.2
edited by eMagiz
on 2022/06/09 12:36
Change comment: Update document after refactoring.
To version 30.1
edited by Eva Torken
on 2023/08/10 14:04
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -intermediate-data-pipelines-job-dashboard-for-data-pipeline
1 +Data pipeline - Job Dashboard
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.marijn
1 +XWiki.etorken
Default language
... ... @@ -1,0 +1,1 @@
1 +en
Content
... ... @@ -1,21 +1,11 @@
1 -{{html wiki="true"}}
2 -<div class="ez-academy">
3 - <div class="ez-academy_body">
1 +{{container layoutStyle="columns"}}
2 +(((
4 4  
5 -<div class="doc">
6 -
7 -
8 -
9 -= Data pipeline * Job Dashboard =
10 -
11 11  In this microlearning, we will learn what the Job Dashboard is, what the Job Dashboard tells you, and how the Job Dashboard works.
12 12  With the help of such a data pipeline, you can transfer large volumes of data between Mendix and the SFTP for data warehousing / BI analytics purposes. The Job Dashboard gives you the ability to monitor if your process of transferring has succeeded or whether it failed.
13 13  
14 14  Should you have any questions, please contact academy@emagiz.com.
15 15  
16 -* Last update: April 1th 2021
17 -* Required reading time: 5 minutes
18 -
19 19  == 1. Prerequisites ==
20 20  
21 21  * Basic knowledge of the eMagiz platform
... ... @@ -28,29 +28,27 @@
28 28  With data pipeline we mean: A integration pattern that can transfer large volumes of data between a specific set of source and sink systems
29 29  With Job Dashboard we mean: A overview within the context of eMagiz that shows management data (i.e. how many lines were processed, did the process run successfully) to the user
30 30  
21 +== 3. Data pipeline - Job Dashboard ==
31 31  
32 -
33 -== 3. Data pipeline * Job Dashboard ==
34 -
35 35  The Job Dashboard is an eMagiz dashboard that can be accessed via the Runtime Dashboard. On this level, you can select a specific flow and for that flow, you can retrieve the management data of your data pipeline by clicking on the button called Jobs.
36 36  
37 -<p align="center">[[image:intermediate-datapipelines-job-dashboard-for-data-pipeline--jobs-button-runtime-dashboard.png||]]</p>
25 +[[image:Main.Images.Microlearning.WebHome@intermediate-datapipelines-job-dashboard-for-data-pipeline--jobs-button-runtime-dashboard.png]]
38 38  
39 39  This Job Dashboard will show you when a certain job has been executed, what the result was of the job, and if you zoom in it tells you how much data is processed in how many batches.
40 40  
41 -<p align="center">[[image:intermediate-datapipelines-job-dashboard-for-data-pipeline--job-dashboard-view.png||]]</p>
29 +[[image:Main.Images.Microlearning.WebHome@intermediate-datapipelines-job-dashboard-for-data-pipeline--job-dashboard-view.png]]
42 42  
43 43  === 3.1 Explaining the inner workings of the Job Dashboard ===
44 44  
45 45  By clicking on the Job dashboard you send a command to the flow you have selected in your runtime dashboard. This flow receives the command and thereby activates the job manager.
46 46  
47 -<p align="center">[[image:intermediate-datapipelines-job-dashboard-for-data-pipeline--job-manager-and-other-support-objects.png||]]</p>
35 +[[image:Main.Images.Microlearning.WebHome@intermediate-datapipelines-job-dashboard-for-data-pipeline--job-manager-and-other-support-objects.png]]
48 48  
49 49  The job manager in turn will look in the H2 database linked to that specific flow for relevant information on the executions of jobs via the data pipeline solutions.
50 50  
51 51  This information is then shown to the user via a popup where you can see all executions and see the details of executions when you click through them
52 52  
53 -<p align="center">[[image:intermediate-datapipelines-job-dashboard-for-data-pipeline--job-dashboard-view.png||]]</p>
41 +[[image:Main.Images.Microlearning.WebHome@intermediate-datapipelines-job-dashboard-for-data-pipeline--job-dashboard-view.png]]
54 54  
55 55  === 3.2 Clean up Job Dashboard ===
56 56  
... ... @@ -67,34 +67,16 @@
67 67  * Clean up the H2 database periodically to keep its contents in check to prevent that the Job dashboard will stop functioning
68 68  * Use the Job dashboard in conjunction with the Manage phase to monitor and set up alerting surrounding the performance of the data pipeline solutions
69 69  
70 -===== Practice =====
58 +== 4. Key takeaways ==
71 71  
72 -== 4. Assignment ==
73 -
74 -The assignment is simple this time. Navigate to the Runtime Dashboard and see if you have a Jobs button that you can press for your data pipeline runtime. If there is a button click on it so you can see the Job Dashboard with your own eyes.
75 -
76 -This assignment can be completed with the help of the (Academy) project that you have created/used in the previous assignment.
77 -
78 -== 5. Key takeaways ==
79 -
80 80  * The job dashboard is an overview within the context of eMagiz that shows management data (i.e. how many lines were processed, did the process run successfully) to the user
81 81  * Clean up the H2 database periodically to keep its contents in check to prevent that the Job dashboard will stop functioning
82 82  * Use the Job dashboard in conjunction with the Manage phase to monitor and set up alerting surrounding the performance of the data pipeline solutions
83 83  * You can import your data pipeline solution from the store
84 84  
65 +== 5. Suggested Additional Readings ==
85 85  
86 -
87 -== 6. Suggested Additional Readings ==
88 -
89 89  If you are interested in this topic and want more information on it please read the help text provided by eMagiz.
68 +)))
90 90  
91 -== 7. Silent demonstration video ==
92 -
93 -There is no demonstration video for this microlearning. We believe that when you follow the steps detailed above the solution will work for your specific use case.
94 -
95 -</div>
96 -
97 -</div>
98 -</div>
99 -
100 -{{/html}}
70 +((({{toc/}}))){{/container}}