Changes for page Data Exchange
Last modified by Waria on 2026/07/23 10:11
From version 7.1
edited by Erik Bakker
on 2022/07/26 09:05
on 2022/07/26 09:05
Change comment:
There is no comment for this version
Summary
-
Page properties (4 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - expert-create-your-transformations-xpath-expert1 +Data Exchange - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. ebakker1 +XWiki.waria - Default language
-
... ... @@ -1,0 +1,1 @@ 1 +en - Content
-
... ... @@ -1,5 +1,7 @@ 1 -{{container}}{{container layoutStyle="columns"}}((( 2 -Within the crash course, we already explained XPath conceptually. In that same microlearning, we looked at some more uncomplicated cases of using XPath within your transformation. If you need to brush up on that knowledge, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]]. In the intermediate microlearning on this subject, we built upon that knowledge. Please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] if you need a refresher on that. In the [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] that followed, we built upon that knowledge and looked at some concrete, practical examples that could be useful in your project. In this microlearning, we will wrap the concept of XPath by looking at three complex XPath alternatives that are sometimes needed when dealing with messages in eMagiz. 1 +{{container}} 2 +{{container layoutStyle="columns"}} 3 +((( 4 +In this section, we’ll examine how eMagiz manages data exchange between applications and integrations, focusing on security considerations for each method. eMagiz supports three main integration patterns: Messaging, API Gateway, and Event Streaming. We'll explore the security measures associated with each pattern, including options like OpenID Connect, OAuth2.0, and access control lists. By understanding these patterns and their specific security configurations, you'll be better equipped to protect data and ensure secure interactions across your integrations. 3 3 4 4 Should you have any questions, please get in touch with [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 5 5 ... ... @@ -6,82 +6,80 @@ 6 6 == 1. Prerequisites == 7 7 8 8 * Expert knowledge of the eMagiz platform 9 -* [[XPath Basic>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]] 10 -* [[XPath Intermediate>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] 11 -* [[XPath Advanced>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] 12 12 13 - 14 14 == 2. Key concepts == 15 15 16 -This microlearning focuses on very complexXPathoperations.14 +This microlearning focuses on security considerations when exchanging data via the platform. 17 17 18 - WithXPathExpert,wemeanlearningthatXPathoptionsare sometimesverycomplexbut couldbenefityou in specific casesinyourdaily work.16 +* Each pattern comes with generic and specific checks and balances to ensure security is taken care of when exchanging data. 19 19 20 - Someofthevery complexXPathoptionsare:18 +== 3. Data Exchange == 21 21 22 -* matches 23 -* replace 24 -* tokenize 20 +Because eMagiz provides the integration between two or more applications via the eMagiz platform, the point at which the data is interchanged between application and integration is a critical part of the integration in terms of security. 21 +Within eMagiz, there are three main integration patterns a user can configure to support their business case most optimally. First, this section will look at all three integration types and specify the security measures. 25 25 26 -== 3. XPathExpert==23 +=== 3.1 Messaging === 27 27 28 -Within the crash course, we already explained XPath conceptually. In that same microlearning, we looked at some more uncomplicated cases of using XPath within your transformation. If you need to brush up on that knowledge, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]]. In the intermediate microlearning on this subject, we built upon that knowledge. Please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] if you need a refresher on that. In the [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] that followed, we built upon that knowledge and looked at some concrete, practical examples that could be useful in your project. In this microlearning, we will wrap the concept of XPath by looking at three complex XPath alternatives that are sometimes needed when dealing with messages in eMagiz. 25 +Messaging is the most flexible option of the three; therefore, a wide range of options is available within eMagiz to secure the connections. 26 +eMagiz offers users the tools to set up integrations and end-points securely. eMagiz supports well-known market standards, including: 29 29 30 -Some of the very complex XPath options are: 28 +* OpenID Connect 29 +* WS-Security 30 +* API Keys in combination with HTTPS/SSL 31 +* SOAP Authentication 32 +* OAuth2.0 33 +* Basic Authentication 31 31 32 -* matches 33 -* replace 34 -* tokenize 35 +This way, each connection between the application and the integration (end-point) can be adequately secured and gives the flexibility to confer with the external application which method best suits their needs. 35 35 36 -=== 3. 1matches===37 +=== 3.2 API Gateway === 37 37 38 - Sometimes,you wanttodeterminewhethera specific value withinyourpayloadmatches apattern.In thosecases, youcanusetheXPath function calledmatches.Thefunctionwillreturntrueif the supplied stringmatchesa givenregularexpression.So,forexample, if youwantto checkwhetheryourOrderID containsexactlysevendigitsand nothingelse,the followingXPathexpressionwill work for your usecase.39 +The front-end of your API Gateway can be secured using a structure with users and permissions. The security of the backend of the API Gateway can be customized just as for messaging. Confer with your external party how the backend needs to be secured. 39 39 40 -matches(OrderID,'^\d{7}$') 41 +eMagiz offers multiple authentication methods for API Gateway users: OAuth 2.0, Basic Auth and API Key. These can be configured per user. This means that you can choose the strongest authentication method supported by the consuming application. 42 + 43 +For OAuth 2.0 eMagiz hosts an authorization server per customer environment which functions as the IDP (identity provider). By communicating with this IDP via the OAuth2.0 protocol, a check is done every time a client calls a specific operation to see whether that client can access the API Gateway and has sufficient rights to access the operation. 44 + 45 +Although users can authenticate using OAuth 2.0, Basic Auth, or an API Key, eMagiz validates all requests through the same authorization infrastructure. Basic Auth and API Key credentials are translated internally to OAuth-based authorization, ensuring that user permissions are evaluated consistently regardless of the chosen authentication method. This centralizes authorization logic and reduces the risk of differences in security behavior between authentication mechanisms. 46 + 47 +To learn more about configuring API security and user permissions check out the [[API Gateway Crash Course>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.WebHome||target="blank"]]. 41 41 42 - Asaresult,you will geta trueor false back which you canthen use as a filter or within an if-then-else construction.49 +=== 3.3 Event Streaming === 43 43 44 -=== 3.2 replace === 51 +Within the Event Streaming solution, eMagiz provides Event Streaming users, and topics can be created. 52 +Access to a topic within a cluster is governed by an Access Control List (ACL). This ACL links users to a topic and defines what the user can do on a topic (consume, produce, both). 45 45 46 - The replacefunction hasmany similarities withthe matchesfunction. Itbuildson thepremiseofthe matchesfunction, but insteadofreturningatrueorfalse,you canstate withwhat you wantto replace the matched string.In otherwords,this functionreturnsastringproducedfromtheinputstring by replacingany substrings that match a given regular expression with a suppliedreplacement string.54 +Only users with sufficient rights in the Deploy phase of eMagiz can add users, and topics and change the ACL entries specific to the Event Streaming cluster. 47 47 48 - When we applythisto ourearlierexample,we can state thatwhen theOrderIDcontains any non-digit,wewillreplacethisvaluewith nothing.Thiswillleadto thefollowingXPathexpression.56 +Apart from producing or consuming data on specific topics based on the ACL, users also need a valid Keystore (containing the key and cert generated automatically) and a valid truststore (containing the CA certificate of the event streaming cluster) to produce or consume data. 49 49 50 -re place(OrderID,'\D','')58 +These are all security measures to prevent third parties from unauthorized access to the data stored on the topics. 51 51 52 - With agiveninput string of12C34A567, the returnedresultwill be1234567.60 +For more information on how this precisely can be configured via the eMagiz platform, please check the following [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Event Streaming.crashcourse-eventstreaming-user-management||target="blank"]]. 53 53 54 -=== 3. 3tokenize ===62 +=== 3.4 General === 55 55 56 - Thetokenizefunctioncansplitastringintomultiple entries foryou.This is particularlyusefulwhenyouwanttomatch an inputstringtoa listofpossiblevaluesthatarevalidforthat string.Forexample,thefunctionreturnsa sequenceofstrings constructed bysplittingtheinputwhereveraseparatorisfound;the separatoris anysubstringthatmatches agivenregularexpression.64 +Regardless of the selected pattern for your solution, it would be best if you always considered that you only exchange relevant information with the external party. This means you should consider both headers as the payload you need to exchange with the external party. This is particularly interesting for any communication via HTTP gateways as they hold functionality to send all message headers as HTTP headers and vice versa. 57 57 58 - So,forexample, when the input string for AddressID is "street,housenumber,housenumberaddition" andyouwantto tokenize thiswith the help of the separator,you could use,in this example, the comma between the values as the separator. This will lead to the following XPath expression.66 +== 4. Key takeaways == 59 59 60 -tokenize(AddressID,',') 68 +* Each pattern comes with generic and specific checks and balances to ensure security is taken care of when exchanging data. 69 +* When you are not careful, you might share too much information with external parties. 61 61 62 - Thegiveninput detailedabove will resultin the followingoutput: street housenumber housenumberaddition.71 +== 5. Suggested Additional Readings == 63 63 64 -== 4. Assignment == 73 +* [[Fundamentals (Navigation)>>doc:Main.eMagiz Academy.Fundamentals.WebHome||target="blank"]] 74 +** [[eMagiz Security Guide (Explanation)>>doc:Main.eMagiz Academy.Fundamentals.fundamental-emagiz-security-guide||target="blank"]] 75 +* [[Crash Course (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.WebHome||target="blank"]] 76 +** [[Crash Course API Gateway (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.WebHome||target="blank"]] 77 +*** [[API User Management (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.crashcourse-api-gateway-user-management||target="blank"]] 78 +** [[Crash Course Event Streaming (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Event Streaming.WebHome||target="blank"]] 79 +*** [[User Management - Event Streaming (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Event Streaming.crashcourse-eventstreaming-user-management||target="blank"]] 80 +* [[Data exchange (Search Result)>>url:https://docs.emagiz.com/bin/view/Main/Search?sort=score&sortOrder=desc&highlight=true&facet=true&r=1&f_space_facet=0%2FMain.&f_type=DOCUMENT&f_locale=en&f_locale=&f_locale=en&text=data+exchange||target="blank"]] 81 +))) 65 65 66 -Check out which of the XPaths we have discussed today can be found within your project. 67 -This assignment can be completed within the (Academy) project you created/used in the previous assignment. 68 - 69 -== 5. Key takeaways == 70 - 71 -Some of the very complex XPath options are: 72 - 73 -* matches 74 -* replace 75 -* tokenize 76 - 77 -== 6. Suggested Additional Readings == 78 - 79 -If you are interested in this topic and want more information on it, please read the help text provided by eMagiz and read more information on the following links: 80 - 81 -* http://www.xsltfunctions.com/xsl/fn_matches.html 82 -* http://www.xsltfunctions.com/xsl/fn_replace.html 83 -* http://www.xsltfunctions.com/xsl/fn_tokenize.html 84 - 85 -== 7. Silent demonstration video == 86 - 87 -As this is more of theoretical microlearning, there is no video accompanying the microlearning.)))((({{toc/}}))){{/container}}{{/container}} 83 +((( 84 +{{toc/}} 85 +))) 86 +{{/container}} 87 +{{/container}}