Changes for page Local File -> Remote File - Data Pipeline
Last modified by Erik Bakker on 2024/02/21 21:51
To version 3.1
edited by Erik Bakker
on 2022/04/29 15:21
on 2022/04/29 15:21
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - LocalFile->RemoteFile - DataPipeline1 +REST - Request & Response - Content
-
... ... @@ -1,45 +1,34 @@ 1 1 {{container}} 2 2 {{container layoutStyle="columns"}} 3 -((( 4 - ==About==3 +(((**~1. How to use** 4 +With this store component, you can easily set up a connection to a REST endpoint using various authentication mechanisms while taking the response into account. 5 5 6 - Datapipeline configuration inside an entryconnectorto transfer local CVS filestoCSV files on SFTP server. Thisflow can also be used as starting pointfor other data pipeline integrations.6 +**2. Keynotes & restrictions ** 7 7 8 - ==Documentation==8 +a. Note that you need to select the valid authentication based on the requirement of the external system. 9 9 10 -==== 1. How to use ==== 10 +**3. License Information** 11 +Part of the standard license agreement as agreed upon when using the store for the first time. 11 11 12 - Withthehelp of this storeitem, you haveadatapipelineconfiguration insidean entry connectortotransferlocal CSV files to CSV files on the SFTP server. Thisallows forthe following:13 - 13 +**4. Relevant eMagiz Academy Microlearnings** 14 +[[https:~~/~~/emagiz.github.io/docs/microlearning/intermediate-rest-webservice-connectivity-index>>url:https://emagiz.github.io/docs/microlearning/intermediate-rest-webservice-connectivity-index]] 14 14 15 -* Reading CSV data from a local file system. 16 -* Convert data to flat files (CSV). 17 -* Writing data to SFTP. 18 -* Job dashboard (See Deploy -> Runtime Dashboard -> [Select Runtime] - > [Select Flow] -> Jobs ). 19 19 20 - ====2. Keynotes&restrictions ====17 +Would you please consult the privacy policy of eMagiz at the following link: [[https:~~/~~/www.emagiz.com/privacy-policy/?>>url:https://www.emagiz.com/privacy-policy/?]]))) 21 21 22 -* Before use, please rename job 'system.message.job' and step 'system.message.step1' to match your system and integration name. Make sure to update support.job-launch-request accordingly. 23 -* When using multiple pipeline flows on one runtime, an h2 'already in use' exception might occur. To prevent these errors please keep the name of the h2 database different for each flow on one runtime by renaming the 'dp.h2.message.database' deploy property in the "support.h2-database" component. 24 -* When you want to import the flow multiple times for one system, you should change the names of the following properties by replacing 'message' with the name of the message type of each integration: 25 -** dp.odata.message.cron (component: receive.cron) 26 -** dp.odata.message.url (component: system.message.job -> system.message.step1 -> Item reader) 27 -** dp.h2.message.database (component: support.h2-database) 28 -** dp.sftp.message.filename.prefix (component: transform.job-launch-request - > Expression) 29 29 30 -==== 3. License Information ==== 31 31 32 -Part of the standard license agreement as agreed upon when using the store for the first time. 33 - 34 -==== 4. Relevant eMagiz Academy Microlearnings ==== 35 - 36 -* [[eMagiz Data pipelines>>doc:Main.eMagiz Academy.Microlearnings.Legacy Functionality.intermediate-data-pipelines-understanding-data-pipelines.WebHome||target="blank"]] 37 - 38 -//Would you please consult the privacy policy of eMagiz at the following [[link>>https://www.emagiz.com/privacy-policy/||target="blank"]]// 21 +((((% border="2" cellpadding="10" cellspacing="10" style="width:292px" %) 22 +|=(% style="width: 45px;" %)#|=(% style="width: 241px;" %)Option 23 +|(% style="width:45px" %) a|(% style="width:241px" %) OAuth 2.0 - Authorization Code 24 +|(% style="width:45px" %) b|(% style="width:241px" %) REST - Basic Auth 25 +|(% style="width:45px" %) c|(% style="width:241px" %) REST - Client Certificate 26 +|(% style="width:45px" %) d|(% style="width:241px" %) REST - Header Mapper 27 +|(% style="width:45px" %) e|(% style="width:241px" %) OAuth 2.0 - Client Credentials 28 +|(% style="width:45px" %) f|(% style="width:241px" %) REST - SSL 29 +|(% style="width:45px" %) g|(% style="width:241px" %) Dynamic Token 30 +|(% style="width:45px" %) h|(% style="width:241px" %) Token 31 +|(% style="width:45px" %) i|(% style="width:241px" %) No Authentication (Fire & Forget) 39 39 ))) 40 - 41 -((( 42 - 43 -))) 44 44 {{/container}} 45 45 {{/container}}