Changes for page Communication between models
Last modified by Erik Bakker on 2024/09/05 14:00
From version 6.1
edited by Erik Bakker
on 2022/07/26 08:31
on 2022/07/26 08:31
Change comment:
There is no comment for this version
To version 19.1
edited by Eva Torken
on 2023/12/07 15:01
on 2023/12/07 15:01
Change comment:
There is no comment for this version
Summary
-
Page properties (4 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - expert-create-your-transformations-xpath-expert1 +Communication between models - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki.e bakker1 +XWiki.etorken - Default language
-
... ... @@ -1,0 +1,1 @@ 1 +en - Content
-
... ... @@ -1,5 +1,5 @@ 1 1 {{container}}{{container layoutStyle="columns"}}((( 2 -W ithinthe crash course,we already explained XPath conceptually.In thatsamemicrolearning,welookedatsomemoreuncomplicatedcasesofusing XPathwithin your transformation.If youed to brushupn that knowledge, pleasecheckoutthis [[microlearning>>doc:Main.eMagizAcademy.Microlearnings.CrashCourse.CrashCourse Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]].Intheintermediate microlearningonthis subject, we built upon that knowledge. Pleasecheck out this [[microlearning>>doc:Main.eMagizAcademy.Microlearnings.Intermediate Level.Createyour transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] ifyouneed aefresher on that.In the[[microlearning>>doc:Main.eMagizAcademy.Microlearnings.Advanced Level.Createyour transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]]thatfollowed, we builtuponthat knowledge andlookedatsomeconcrete,practical examplesthat couldbe useful inyourproject. In thismicrolearning,we will wrap the conceptof XPathby looking at three complex XPathalternativesthat are sometimes neededwhen dealing withmessagesin eMagiz.2 +When your integration landscape grows through time, you might decide to split functional business processes into multiple eMagiz models. In those cases, the question of connecting these models easily, stable, and securely could arise. This microlearning will focus on that question and provide an answer based on our vision and best practices when dealing with the platform. 3 3 4 4 Should you have any questions, please get in touch with [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 5 5 ... ... @@ -6,86 +6,44 @@ 6 6 == 1. Prerequisites == 7 7 8 8 * Expert knowledge of the eMagiz platform 9 -* [[XPath Basic>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]] 10 -* [[XPath Intermediate>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.Create your transformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]] 11 -* [[XPath Advanced>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.Create your transformations.advanced-create-your-transformations-xpath-advanced.WebHome||target="blank"]] 12 12 13 - 14 14 == 2. Key concepts == 15 15 16 -This microlearning focuses on mo recomplexXPathoperations.12 +This microlearning focuses on communication between two eMagiz models. When communicating to any external party (from the view of a specific model), you should always consider the following: 17 17 18 -With XPath Advanced, we mean learning that XPath options are complex but could benefit you in your daily work. 14 +* Security 15 +* Loose coupling 16 +* Maintainability 17 +* Clarity 19 19 20 - Someofthe morecomplex XPath optionsare:19 +== 3. Communication between models == 21 21 22 -* dateTime calculation 23 -* Filter list 24 -* XPath on JSON 25 -* SpEL notation for XPath 21 +Most users would think that communication via queues to connect two separate eMagiz models is a bright idea. However, this is something that we do not encourage. We discourage this for several practical and technical reasons alike. 26 26 23 +When looking at the practical side of things getting it configured correctly is time-consuming and an error-prone action (as is evident by the question). Furthermore, it can lead to unexpected situations where you make a typo to listen to a queue on which no messages are provided. This queue will, however, be registered on the JMS level (when you activate the flow in question with the custom configuration), which can lead to confusing queue statistics and even more troublesome false-positive alerting based on missing queue metrics or missing consumers. 27 27 25 +On top of that, when you allow one model to write and read from queues registered in another model, maintaining both models will become very complex. This holds for the ones working on the project at the moment but also for those working on it at a later stage and does that need to provide (incidental) support on the environments. 28 28 29 - ==3.XPathAdvanced==27 +Another practical reason for not wanting this is that we do not actively support this use case from eMagiz. This means that when we update our technical infrastructure, we will not consider this scenario. This could lead to additional work in the future and reduced stability of your solution. 30 30 31 - Withinthe crashourse, wealreadyexplained XPathconceptually.Inthat samemicrolearning, we also looked at some moreuncomplicatedcasesofusing XPathwithinyour transformation.Ifyouneed tobrush up on thatknowledge,pleasecheckoutthis[[microlearning>>doc:Main.eMagizAcademy.Microlearnings.CrashCourse.CrashCourse Platform.crashcourse-platform-create-transformation-xpath-basic.WebHome||target="blank"]]. In the intermediatemicrolearningon this subject, we built uponthatknowledge. Pleasecheckoutthis [[microlearning>>doc:Main.eMagizAcademy.Microlearnings.IntermediateLevel.Createyourtransformations.intermediate-create-your-transformations-xpath-intermediate.WebHome||target="blank"]]ifyouneedarefresheron that.Inthismicrolearning, wewill build upon that knowledgeand look atsomeconcrete, practicalexamplesthatcould be usefulinyourproject.29 +From the technical point of view, the consequence of this construction is that both models need to know each other certificates and credentials, which are not considered secure. On top of that, because you, theoretically, can exchange data from any queue to any queue, you could create a situation in which updates in one model trigger changes in the other model (i.e., when using the same data model) that are unexpected (and frankly unwanted). 32 32 33 -Some of the more complex XPath options are: 31 +We advise using functionality that makes it explicit that both models function independently of each other. From eMagiz, we consider two valid alternatives for this: 32 +- Using a web service as a communication layer between the two models. This web service can be REST or SOAP and has been implemented before 33 +- Using the Event Streaming functionality of eMagiz to write and read from topics. 34 34 35 -* dateTime calculation 36 -* Filter list 37 -* XPath on JSON 38 -* SpEL notation for XPath 35 +Both alternatives have the benefit that the security can be tight and explicit (i.e., only model A can write/post data to model B). Furthermore, managing the solution becomes much easier as it uses the standard functionality within the platform. Therefore, we have no plans to support this approach in the product. 39 39 40 -== =3.1dateTimecalculation===37 +== 4. Key takeaways == 41 41 42 -Sometimes we see that a dateTime calculation is needed within a transformation to determine a specific action. As these calculations are not natively supported within the eMagiz platform, you need to use XPath's functionality to calculate the new valid date (or dateTime). 39 +* Consider the following when communication between two models 40 +** Security 41 +** Loose coupling 42 +** Maintainability 43 +** Clarity 43 43 44 - TheXPath standard offers several functions to calculate with dateTime values.The two mostused options are dayTimeDuration and yearMonthDuration. With the help of the dayTimeDuration, you can add, subtract, multiple, or divide seconds, minutes, hours, and days regardingtheoriginal value. The yearMonthDuration workssimilarly butthen for months andyears.An example of such an XPath is: <xsl:value-of xmlns:xs="http://www.w3.org/2001/XMLSchema" select="CDM:StartDate + xs:dayTimeDuration('P1D') * xs:yearMonthDuration('P1M')"/>. In this example,XPath adds oneday andsubtracts one month from theinput date. Note that makingthiswork requires the additional namespace to be defined. Therefore you need a custom snippet within your transformation or a custom transformation to make this work. Furthermore, note that the P1D and P1M could also be filled with the help of parameters to make them dynamic in nature.45 +== 5. Suggested Additional Readings == 45 45 46 - Some examples that we sawduringtheyears:47 +If you are interested in this topic and want more information, please consult us at [[productmanagement@emagiz.com>>mailto:productmanagement@emagiz.com]] 47 47 48 -* https://my.emagiz.com/p/question/172825635700358186 49 -* https://my.emagiz.com/p/question/172825635700352588 50 - 51 -=== 3.2 Filter list === 52 - 53 -Sometimes you have a large message which contains a certain list within it. However, logic dictates that you can only send the message if at least one entry in the list for which attribute A is filled and attribute B equals type C. To make that happen in XPath, we first need to navigate to the list within the message. As we previously learned, there are two options to do so. One is to use // to navigate to the entity somewhere in the tree directly. The other is to start at the root and walk the tree from there. In this example, we use the latter. That results in the following XPath example: /root/list[attributeB = 'type C']/attributeA !=''. With this XPath, you filter the list on the specified check and subsequently check whether one of those entries that remains has an attributeA which is filled in. 54 - 55 -=== 3.3 XPath on JSON === 56 - 57 -With the release of build number .50, we expanded our offering on JSON messages to resemble much of the functionality we previously offered for XML messages. As a result, you can use XPath expressions on JSON messages within the following components (related to XPath): 58 - 59 -* XPath header enricher 60 -* XPath transformer 61 -* XPath router 62 - 63 -To activate the functionality, simply link the JSON source factory support object to one of these components to achieve the desired result. For more information, check out: https://emagiz.github.io/docs/release-notes/build50. 64 - 65 -=== 3.4 SpEL notation for XPath === 66 - 67 -Sometimes you want to perform an XPath operation but store the header via a standard message header enricher component. As a result, you need a valid SpEL expression to help you in this cause. To do so, you need to know the correct notation for an XPath expression when using the SpEL language. An example of the correct notation is: #xpath(payload,'/root/entity/attribute') 68 - 69 -== 4. Assignment == 70 - 71 -Check out which of the XPaths we have discussed today can be found within your project. 72 -This assignment can be completed within the (Academy) project you created/used in the previous assignment. 73 - 74 -== 5. Key takeaways == 75 - 76 -Some of the more complex XPath options are: 77 - 78 -* dateTime calculation 79 -* Filter list 80 -* XPath on JSON 81 -* SpEL notation for XPath 82 - 83 -== 6. Suggested Additional Readings == 84 - 85 -If you are interested in this topic and want more information on it, please read the help text provided by eMagiz and read more information on the following link: 86 - 87 -* https://www.w3schools.com/xml/xpath_intro.asp 88 - 89 -== 7. Silent demonstration video == 90 - 91 -As this is more of theoretical microlearning, there is no video accompanying the microlearning.)))((({{toc/}}))){{/container}}{{/container}} 49 +)))((({{toc/}}))){{/container}}{{/container}}