Skip to Content
Last modified by Erik Bakker on 2024/02/21 21:51
From version 23.1
edited by Erik Bakker
on 2022/05/02 11:41
Change comment: There is no comment for this version
To version 24.1
edited by Erik Bakker
on 2022/05/02 11:44
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -Local File -> Remote File - Data Pipeline
1 +Mendix -> Redshift - Data Pipeline
Content
... ... @@ -2,17 +2,18 @@
2 2  {{container layoutStyle="columns"}}
3 3  (((
4 4  == About ==
5 -Data pipeline configuration inside an entry connector to transfer local CVS files to CSV files on SFTP server. This flow can also be used as starting point for other data pipeline integrations.
5 +Data pipeline configuration inside an entry connector to transfer Mendix App object data to an Amazon Redshift table. This flow can also be used as starting point for other data pipeline integrations.
6 6  
7 7  == Documentation ==
8 8  
9 9  ==== 1. How to use====
10 -With the help of this store item, you have a data pipeline configuration inside an entry connector to transfer local CSV files to CSV files on the SFTP server. This allows for the following:
10 +With the help of this store item, you have a data pipeline configuration inside an entry connector to transfer Mendix App object data to an Amazon Redshift table. This allows for the following:
11 11  
12 -* Reading CSV data from a local file system.
13 -* Convert data to flat files (CSV).
14 -* Writing data to SFTP.
12 +* Reading data from Mendix using OData v3.
13 +* Writing data to Amazon Redshift using Amazon S3 ([[https:~~/~~/docs.aws.amazon.com/redshift/latest/dg/t_loading-tables-from-s3.html>>url:https://docs.aws.amazon.com/redshift/latest/dg/t_loading-tables-from-s3.html]]).
14 +* Merge behavior using staging tables (documentation).
15 15  * Job dashboard (See Deploy -> Runtime Dashboard -> [Select Runtime] - > [Select Flow] -> Jobs ).
16 +* Refresh an AWS Materialized View a minute after the job completes successfully.
16 16  
17 17  ==== 2. Keynotes & restrictions====
18 18