Changes for page Communication between models
Last modified by Erik Bakker on 2024/09/05 14:00
From version 10.1
edited by Erik Bakker
on 2022/07/26 13:17
on 2022/07/26 13:17
Change comment:
There is no comment for this version
To version 23.1
edited by Erik Bakker
on 2024/09/05 13:54
on 2024/09/05 13:54
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - expert-securing-data-traffic-api-gw-security-external-idp1 +Communication between models - Content
-
... ... @@ -1,5 +1,5 @@ 1 1 {{container}}{{container layoutStyle="columns"}}((( 2 -In th ecrashcourseontheAPIGateway we discussedthe variousoptionsavailable to[[secure>>doc:Main.eMagizAcademy.Microlearnings.CrashCourse.CrashCourse API Gateway.crashcourse-api-gateway-security.WebHome||target="blank"]]your API Gatewayproperly.Inthismicrolearning,we willexpandourknowledgeonthatopicbylookingataspecialcaseofsecuringyourAPI Gateway.Thatcaseisspecial as youuseanexternalidentityprovider(IDP)togoverntheroles andusers thathaverightsonyourAPI Gateway.2 +In this microlearning, we'll explore the best practices for communication between two eMagiz models. Effective communication is crucial, and it's important to prioritize security, loose coupling, maintainability, and clarity. We'll discuss why using queues for inter-model communication is generally discouraged and why alternatives like web services and Event Streaming are preferred. By focusing on these key considerations, you'll be better equipped to design robust and maintainable integration solutions within eMagiz. 3 3 4 4 Should you have any questions, please get in touch with [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 5 5 ... ... @@ -9,55 +9,44 @@ 9 9 10 10 == 2. Key concepts == 11 11 12 -This microlearning focuses on performingimagetransformationsineMagiz.12 +This microlearning focuses on communication between two eMagiz models. When communicating to any external party (from the view of a specific model), you should always consider the following: 13 13 14 -By image transformation, we mean transforming the raw data that represents an image into another image format. 14 +* Security 15 +* Loose coupling 16 +* Maintainability 17 +* Clarity 15 15 16 -* Read the help text of the component to understand which formats are supported 17 -* Ensure the input image is supplied in the correct format 18 -* Ensure you wrap the output image in something if you want to do additional transformations on the data further downstream 19 +== 3. Communication between models == 19 19 20 - ==3.ImageTransformation==21 +Most users would think that communication via queues to connect two separate eMagiz models is a bright idea. However, this is something that we do not encourage. We discourage this for several practical and technical reasons alike. 21 21 22 - Inmost cases,youwilltransformXML messagestootherXML messages,orouwilltransformJSONorEDImessages inanotherofthese formats.However,sometimes youwant toperforman imagetransformation.Withthis imagetransformation,youcanconvertmagesinspecific formatstoanotherformat(i.e., png).Thiscancomein handywhenyouwanttostandardize theimage format beforeusingit furtherdownstreaminyourbusinessapplication(s).23 +When looking at the practical side of things getting it configured correctly is time-consuming and an error-prone action (as is evident by the question). Furthermore, it can lead to unexpected situations where you make a typo to listen to a queue on which no messages are provided. This queue will, however, be registered on the JMS level (when you activate the flow in question with the custom configuration), which can lead to confusing queue statistics and even more troublesome false-positive alerting based on missing queue metrics or missing consumers. 23 23 24 - Before we dive into thespecifics ofhowtoconfigure this,let us firstconsider thefollowing:25 +On top of that, when you allow one model to write and read from queues registered in another model, maintaining both models will become very complex. This holds for the ones working on the project at the moment but also for those working on it at a later stage and does that need to provide (incidental) support on the environments. 25 25 26 -* Read the help text of the component to understand which formats are supported 27 -* Ensure the input image is supplied in the correct format 28 -* Ensure you wrap the output image in something if you want to do additional transformations on the data further downstream 27 +Another practical reason for not wanting this is that we do not actively support this use case from eMagiz. This means that when we update our technical infrastructure, we will not consider this scenario. This could lead to additional work in the future and reduced stability of your solution. 29 29 30 - {{warning}}Thismicrolearning focusesonheimage transformercomponent.Ensuringthat theinputisvalidandtheoutputfitstheremainder of theprocessishighlydependent onthe use case andwilltherefore notbe discussedin this microlearning{{/warning}}29 +From the technical point of view, the consequence of this construction is that both models need to know each other certificates and credentials, which are not considered secure. On top of that, because you, theoretically, can exchange data from any queue to any queue, you could create a situation in which updates in one model trigger changes in the other model (i.e., when using the same data model) that are unexpected (and frankly unwanted). 31 31 32 -When turning to the Create phase of eMagiz, we need to open the flow and enter "Start Editing" mode to add the necessary component. For example, in the left panel, you can search for "Image." This will yield the following result. 31 +We advise using functionality that makes it explicit that both models function independently of each other. From eMagiz, we consider two valid alternatives for this: 32 +- Using a web service as a communication layer between the two models. This web service can be REST or SOAP and has been implemented before 33 +- Using the Event Streaming functionality of eMagiz to write and read from topics. 33 33 34 - [[image:Main.Images.Microlearning.WebHome@expert-create-your-transformations-image-transformation-image-transformation-component.png]]35 +Both alternatives have the benefit that the security can be tight and explicit (i.e., only model A can write/post data to model B). Furthermore, managing the solution becomes much easier as it uses the standard functionality within the platform. Therefore, we have no plans to support this approach in the product. 35 35 36 - Afterdraggingthecomponentonto thecanvas,you mustdefine the channels first.37 +== 4. Key takeaways == 37 37 38 -[[image:Main.Images.Microlearning.WebHome@expert-create-your-transformations-image-transformation-image-transformation-component-help.png]] 39 +* Consider the following when communication between two models 40 +** Security 41 +** Loose coupling 42 +** Maintainability 43 +** Clarity 39 39 40 - Secondly,wemust select the desired imageformat we want to transform. Finally,thefieldindicates all valid values you canchoose. Pleasenotethat 'PNG' is thedefault selection.45 +== 5. Suggested Additional Readings == 41 41 42 -[[image:Main.Images.Microlearning.WebHome@expert-create-your-transformations-image-transformation-image-transformation-component-image-options.png]] 43 - 44 -Once you have done this, the component configuration is finished, and you can transform your input image to a desired output image format. 45 - 46 -== 4. Assignment == 47 - 48 -Check whether the solution we discussed today can be found within your project. 49 -This assignment can be completed within the (Academy) project you created/used in the previous assignment. 50 - 51 -== 5. Key takeaways == 52 - 53 -* Read the help text of the component to understand which formats are supported 54 -* Ensure the input image is supplied in the correct format 55 -* Ensure you wrap the output image in something if you want to do additional transformations on the data further downstream 56 - 57 -== 6. Suggested Additional Readings == 58 - 59 -If you are interested in this topic and want more information, please read the help text provided by eMagiz. 60 - 61 -== 7. Silent demonstration video == 62 - 63 -As this is more of theoretical microlearning, there is no video accompanying the microlearning.)))((({{toc/}}))){{/container}}{{/container}} 47 +* [[Fundamentals (Navigation)>>doc:Main.eMagiz Academy.Fundamentals.WebHome||target="blank"]] 48 +** [[eMagiz Security Guide (Explanation)>>doc:Main.eMagiz Academy.Fundamentals.fundamental-emagiz-security-guide||target="blank"]] 49 +** [[Multi-Model Explained (Explanation)>>doc:Main.eMagiz Academy.Fundamentals.fundamental-emagiz-multi-model-explained.WebHome||target="blank"]] 50 +** [[Multi-Model Best Practice (Explanation)>>doc:Main.eMagiz Academy.Fundamentals.fundamental-emagiz-multi-model-best-practice.WebHome||target="blank"]] 51 +* [[Communication between models (Search Result)>>url:https://docs.emagiz.com/bin/view/Main/Search?sort=score&sortOrder=desc&highlight=true&facet=true&r=1&f_space_facet=0%2FMain.&f_type=DOCUMENT&f_locale=en&f_locale=&f_locale=en&text=communication+between+models||target="blank"]] 52 +)))((({{toc/}}))){{/container}}{{/container}}