Changes for page Data Exchange
Last modified by Waria on 2026/07/23 10:11
From version 21.1
edited by Waria
on 2026/07/23 10:11
on 2026/07/23 10:11
Change comment:
There is no comment for this version
To version 7.1
edited by Erik Bakker
on 2022/07/26 09:05
on 2022/07/26 09:05
Change comment:
There is no comment for this version
Summary
-
Page properties (4 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - DataExchange1 +expert-create-your-transformations-xpath-expert - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. waria1 +XWiki.ebakker - Default language
-
... ... @@ -1,1 +1,0 @@ 1 -en - Content
-
... ... @@ -1,7 +1,5 @@ 1 -{{container}} 2 -{{container layoutStyle="columns"}} 3 -((( 4 -In this section, we’ll examine how eMagiz manages data exchange between applications and integrations, focusing on security considerations for each method. eMagiz supports three main integration patterns: Messaging, API Gateway, and Event Streaming. We'll explore the security measures associated with each pattern, including options like OpenID Connect, OAuth2.0, and access control lists. By understanding these patterns and their specific security configurations, you'll be better equipped to protect data and ensure secure interactions across your integrations. 1 +{{container}}{{container layoutStyle="columns"}}((( 2 +Within the crash course, we already explained XPath conceptually. In that same microlearning, we looked at some more uncomplicated cases of using XPath within your transformation. If you need to brush up on that knowledge, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]]. In the intermediate microlearning on this subject, we built upon that knowledge. Please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] if you need a refresher on that. In the [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] that followed, we built upon that knowledge and looked at some concrete, practical examples that could be useful in your project. In this microlearning, we will wrap the concept of XPath by looking at three complex XPath alternatives that are sometimes needed when dealing with messages in eMagiz. 5 5 6 6 Should you have any questions, please get in touch with [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 7 7 ... ... @@ -8,80 +8,82 @@ 8 8 == 1. Prerequisites == 9 9 10 10 * Expert knowledge of the eMagiz platform 9 +* [[XPath Basic>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]] 10 +* [[XPath Intermediate>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] 11 +* [[XPath Advanced>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] 11 11 13 + 12 12 == 2. Key concepts == 13 13 14 -This microlearning focuses on security considerations when exchangingdata via theplatform.16 +This microlearning focuses on very complex XPath operations. 15 15 16 - *Each patterncomeswith generic andspecific checksandbalancestoensure securityistakencare ofwhen exchangingdata.18 +With XPath Expert, we mean learning that XPath options are sometimes very complex but could benefit you in specific cases in your daily work. 17 17 18 - ==3.DataExchange==20 +Some of the very complex XPath options are: 19 19 20 -Because eMagiz provides the integration between two or more applications via the eMagiz platform, the point at which the data is interchanged between application and integration is a critical part of the integration in terms of security. 21 -Within eMagiz, there are three main integration patterns a user can configure to support their business case most optimally. First, this section will look at all three integration types and specify the security measures. 22 +* matches 23 +* replace 24 +* tokenize 22 22 23 -== =3.1Messaging===26 +== 3. XPath Expert == 24 24 25 -Messaging is the most flexible option of the three; therefore, a wide range of options is available within eMagiz to secure the connections. 26 -eMagiz offers users the tools to set up integrations and end-points securely. eMagiz supports well-known market standards, including: 28 +Within the crash course, we already explained XPath conceptually. In that same microlearning, we looked at some more uncomplicated cases of using XPath within your transformation. If you need to brush up on that knowledge, please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]]. In the intermediate microlearning on this subject, we built upon that knowledge. Please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] if you need a refresher on that. In the [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] that followed, we built upon that knowledge and looked at some concrete, practical examples that could be useful in your project. In this microlearning, we will wrap the concept of XPath by looking at three complex XPath alternatives that are sometimes needed when dealing with messages in eMagiz. 27 27 28 -* OpenID Connect 29 -* WS-Security 30 -* API Keys in combination with HTTPS/SSL 31 -* SOAP Authentication 32 -* OAuth2.0 33 -* Basic Authentication 30 +Some of the very complex XPath options are: 34 34 35 -This way, each connection between the application and the integration (end-point) can be adequately secured and gives the flexibility to confer with the external application which method best suits their needs. 32 +* matches 33 +* replace 34 +* tokenize 36 36 37 -=== 3. 2API Gateway===36 +=== 3.1 matches === 38 38 39 - The front-endofyourAPI Gateway canbesecured usinga structure with usersand permissions.The securityofthe backendoftheAPI Gatewaycanbe customizedjustasfor messaging.Conferwith your externalpartyhowthebackend needs tobe secured.38 +Sometimes, you want to determine whether a specific value within your payload matches a pattern. In those cases, you can use the XPath function called matches. The function will return true if the supplied string matches a given regular expression. So, for example, if you want to check whether your OrderID contains exactly seven digits and nothing else, the following XPath expression will work for your use case. 40 40 41 -eMagiz offers multiple authentication methods for API Gateway users: OAuth 2.0, Basic Auth and API Key. These can be configured per user. This means that you can choose the strongest authentication method supported by the consuming application. 42 - 43 -For OAuth 2.0 eMagiz hosts an authorization server per customer environment which functions as the IDP (identity provider). By communicating with this IDP via the OAuth2.0 protocol, a check is done every time a client calls a specific operation to see whether that client can access the API Gateway and has sufficient rights to access the operation. 44 - 45 -Although users can authenticate using OAuth 2.0, Basic Auth, or an API Key, eMagiz validates all requests through the same authorization infrastructure. Basic Auth and API Key credentials are translated internally to OAuth-based authorization, ensuring that user permissions are evaluated consistently regardless of the chosen authentication method. This centralizes authorization logic and reduces the risk of differences in security behavior between authentication mechanisms. 46 - 47 -To learn more about configuring API security and user permissions check out the [[API Gateway Crash Course>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.WebHome||target="blank"]]. 40 +matches(OrderID,'^\d{7}$') 48 48 49 - ===3.3EventStreaming===42 +As a result, you will get a true or false back which you can then use as a filter or within an if-then-else construction. 50 50 51 -Within the Event Streaming solution, eMagiz provides Event Streaming users, and topics can be created. 52 -Access to a topic within a cluster is governed by an Access Control List (ACL). This ACL links users to a topic and defines what the user can do on a topic (consume, produce, both). 44 +=== 3.2 replace === 53 53 54 - Onlyusers with sufficientrightsin theDeployphase of eMagiz can addusers, andtopicsandchangetheACLentries specificto theEventStreaming cluster.46 +The replace function has many similarities with the matches function. It builds on the premise of the matches function, but instead of returning a true or false, you can state with what you want to replace the matched string. In other words, this function returns a string produced from the input string by replacing any substrings that match a given regular expression with a supplied replacement string. 55 55 56 - Apartfromproducingorconsumingdataon specifictopics basedon theACL, users also needa valid Keystore(containingthe keyandcertgeneratedautomatically)andavalid truststore(containingtheCAcertificateoftheevent streamingcluster)toproduceor consume data.48 +When we apply this to our earlier example, we can state that when the OrderID contains any non-digit, we will replace this value with nothing. This will lead to the following XPath expression. 57 57 58 - These areall security measures to prevent third parties from unauthorized access to the data storedon thetopics.50 +replace(OrderID,'\D','') 59 59 60 - For moreinformation onhowthis precisely canbe configured via theeMagizplatform,please checkthe following [[microlearning>>doc:Main.eMagizAcademy.Microlearnings.CrashCourse.CrashCourse EventStreaming.crashcourse-eventstreaming-user-management||target="blank"]].52 +With a given input string of 12C34A567, the returned result will be 1234567. 61 61 62 -=== 3. 4General===54 +=== 3.3 tokenize === 63 63 64 - Regardlessoftheselectedpatternforyoursolution,itwould bebestif you alwaysconsideredthatyouonly exchange relevantinformationwiththe externalparty.Thismeans youshould considerboth headersasthepayloadyouneedto exchangewith theexternalparty.Thisisparticularlyinterestingforany communicationviaHTTP gatewaysasthey holdfunctionality to sendallmessageheadersas HTTPheaders andviceversa.56 +The tokenize function can split a string into multiple entries for you. This is particularly useful when you want to match an input string to a list of possible values that are valid for that string. For example, the function returns a sequence of strings constructed by splitting the input wherever a separator is found; the separator is any substring that matches a given regular expression. 65 65 66 - ==4.Keytakeaways==58 +So, for example, when the input string for AddressID is "street,housenumber,housenumberaddition" and you want to tokenize this with the help of the separator, you could use, in this example, the comma between the values as the separator. This will lead to the following XPath expression. 67 67 68 -* Each pattern comes with generic and specific checks and balances to ensure security is taken care of when exchanging data. 69 -* When you are not careful, you might share too much information with external parties. 60 +tokenize(AddressID,',') 70 70 71 - ==5.SuggestedAdditionalReadings==62 +The given input detailed above will result in the following output: street housenumber housenumberaddition. 72 72 73 -* [[Fundamentals (Navigation)>>doc:Main.eMagiz Academy.Fundamentals.WebHome||target="blank"]] 74 -** [[eMagiz Security Guide (Explanation)>>doc:Main.eMagiz Academy.Fundamentals.fundamental-emagiz-security-guide||target="blank"]] 75 -* [[Crash Course (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.WebHome||target="blank"]] 76 -** [[Crash Course API Gateway (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.WebHome||target="blank"]] 77 -*** [[API User Management (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course API Gateway.crashcourse-api-gateway-user-management||target="blank"]] 78 -** [[Crash Course Event Streaming (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Event Streaming.WebHome||target="blank"]] 79 -*** [[User Management - Event Streaming (Explanation)>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Event Streaming.crashcourse-eventstreaming-user-management||target="blank"]] 80 -* [[Data exchange (Search Result)>>url:https://docs.emagiz.com/bin/view/Main/Search?sort=score&sortOrder=desc&highlight=true&facet=true&r=1&f_space_facet=0%2FMain.&f_type=DOCUMENT&f_locale=en&f_locale=&f_locale=en&text=data+exchange||target="blank"]] 81 -))) 64 +== 4. Assignment == 82 82 83 -((( 84 -{{toc/}} 85 -))) 86 -{{/container}} 87 -{{/container}} 66 +Check out which of the XPaths we have discussed today can be found within your project. 67 +This assignment can be completed within the (Academy) project you created/used in the previous assignment. 68 + 69 +== 5. Key takeaways == 70 + 71 +Some of the very complex XPath options are: 72 + 73 +* matches 74 +* replace 75 +* tokenize 76 + 77 +== 6. Suggested Additional Readings == 78 + 79 +If you are interested in this topic and want more information on it, please read the help text provided by eMagiz and read more information on the following links: 80 + 81 +* http://www.xsltfunctions.com/xsl/fn_matches.html 82 +* http://www.xsltfunctions.com/xsl/fn_replace.html 83 +* http://www.xsltfunctions.com/xsl/fn_tokenize.html 84 + 85 +== 7. Silent demonstration video == 86 + 87 +As this is more of theoretical microlearning, there is no video accompanying the microlearning.)))((({{toc/}}))){{/container}}{{/container}}