Changes for page 213 - Joyful Journeys
Last modified by Carlijn Kokkeler on 2024/04/18 13:07
From version 75.1
edited by Erik Bakker
on 2023/01/31 13:02
on 2023/01/31 13:02
Change comment:
There is no comment for this version
To version 200.1
edited by Carlijn Kokkeler
on 2023/10/24 09:06
on 2023/10/24 09:06
Change comment:
There is no comment for this version
Summary
-
Page properties (3 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - 191-FiftyFifty1 +207 - Aligned State - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. ebakker1 +XWiki.CarlijnKokkeler - Content
-
... ... @@ -2,110 +2,117 @@ 2 2 {{container layoutStyle="columns"}}((( 3 3 [[image:Main.Images.Release Blog.WebHome@release-blog-intro.png]] 4 4 5 -**Hi there, eMagiz developers!** Inthelast coupleofweekswe hadourquarterly"hackathon"inwhichwefixedaseriesofannoying bugsandintroducedmanysmallimprovements.On top of that welso finishedseveraladditionalfeaturesfor our 3rdgenerationruntime thatwillmakeyourlife whilerunningon the3rdgenerationruntime easierandbetter manageable.Amongthe additionalfeatureswe havethe dynamicalertingandthedebuggerfunctionality.5 +**Hi there, eMagiz developers!** We have done much work for state generation, so that you can derive more information from your data! Examples are enrichment, aggregation, change detection and duplicate detection. State generation functionality is only accessible for models with an add-on state generation license. Next to state generation, several improvements regarding the alignment of components have been made. Moreover, performance improvements and bug fixes have been implemented. Lastly, a change in the metrics storage duration has been performed. 6 6 7 -== ** DynamicAlerts**~*~*==7 +== **State Generation** == 8 8 9 -{{warning}}Note that depending on the alert this functionality will only work when your JMS server is running on the 3rd generation runtime{{/warning}} 9 +//__New components__// 10 +The following components have been added: 11 +* Aggregator: reverse of the splitter, used to combine multiple messages into a single one. 12 +* Infinispan metadata outbound channel adapter: used to (temporarily) store metadata, which can be used to enrich messages, or make decisions in filters or scripts. 13 +* Content enricher: used to add properties to the payload of messages, similar to what the header enricher can do for headers. 14 +* Duplicate detector: support object used to detect duplicate messages for a certain key on an inbound channel of a flow component. Duplicates can be marked or discarded. 15 +* Infinispan support objects, supporting the aggregator, metadata outbound channel adapter and content enricher. 10 10 11 -To enhance the observability of your integration landscape while running in the 3rd generation runtime architecture, we have added a new feature to our Manage phase called "Dynamic Alerts." You can access this functionality via the "Alerting" menu in Manage. Then, with the help of the "Trigger" overview, you can view all triggers on your environment. On the top of the list you will see all "static" alerts as defined by eMagiz. Below that you will see all "dynamic" alerts that you and your fellow teammembers (with sufficient rights) can view, edit and delete. 17 +//__SpEL functions & JSON__// 18 +Added SpEL functions for: 19 +* Encoding & decoding Base64, Hex and hmac. 20 +* Date retrieval (currentDateTime, currentEpochMilli, currentEpochSecond). 21 +* Date conversion (DateTime to Epoch, Epoch to DateTime, DateTime formatter and DateTime parser). 12 12 13 - We offer alerting onfive types.23 +Added support for SpEL property accessors for XML and JSON, meaning that you can read message payloads in SpEL expressions easily. For example, to retrieve the value for 'id' in the following JSON String: `{"id":"123"}`, this SpEL expression suffices: `payload.id`. 14 14 15 -* Error message 16 -* Log message 17 -* Queue consumers 18 -* Messages in queue 19 -* Queue throughput 25 +Added support for `#JsonPath` usage in SpEL expressions. 20 20 21 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--dynamic-alert-trigger-options.png]] 27 +//__New image version 2.0.0__// 28 +The above functionalities are features of the new image version 2.0.0. Important to note is that the library used for Code Mappings has been changed. Changed the library used for Code Mappings. Any customer with Gen3 runtimes and code mappings is required to reset their infra flows prior to deploying on image 2.0.0. 22 22 23 -These five options give you the option to configure more or less the same as you are currently used to when configuring triggers. Once you make a choice for a type you can press the "Next" button to fill in the details of the trigger. One example of how this can look is shown below. 30 +//__Component pages__// 31 +Pages to add the new components have been created. Forms have been created nicely with proper help texts. The EHCache cache manager has been removed. 24 24 25 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--dynamic-alert-trigger-input.png]] 33 +== **Metrics Storage Duration** == 34 +We will change the retention of monitoring data of different environments. For minute level data, it will be kept for test, acceptance and production environments for 5, 7 and 30 days respectively. Then the minute level data will be reduced to hour level data then will be stored for test, acceptance and production for 3, 6 and 12 months respectively. 26 26 27 - Once the trigger tabis filled inyou can navigateto the "Output" tab toselect therecipients for thetrigger youareconfiguring. Onop of thatyou can reduce the number of message atwhich congestion control is enabled if tenis too high for you.36 +[[image:Main.Images.Release Blog.WebHome@release-blog-207-aligned-state-metrics-storage.png]] 28 28 29 - [[image:Main.Images.ReleaseBlog.WebHome@191-release-blog--dynamic-alert-trigger-output.png]]38 +== **Feedback Items** == 30 30 31 -== **Debugger ** ~*~* ~* == 40 +//__Import from store__// 41 +The button 'Import from Store' in Design will directly open the store instead of showing a pop asking whether the store should be opened. 32 32 33 -{{warning}}Note that this functionality only works when the following criteria are met. 34 -* Your JMS server is running on the 3rd generation runtime 35 -* The store item called "3rd generation debugger" is imported in the infra flow of each runtime for which you want the ability to debug 36 -* The beta image is activated 37 -* A new release is created that includes the flow changes and this release is deployed to the environment(s){{/warning}} 43 +//__Save and cancel buttons placement__// 44 +The save and cancel buttons have been placed slightly further apart from each other to avoid misclicking. 38 38 39 -As with our current offering, we now offer a functionality with which you can debug channels and see them via the eMagiz portal. As stated above to get to this point you need to execute several steps to get your model ready to be "debugged". Once you have done this you can activate the "debug" mode, via Deploy -> Containers for **one** specific flow **per** runtime that is of particular interest to you. Once you have done this you will see a pop-up telling you whether the "debug" mode was indeed activated or not. 46 +//__User session times__// 47 +The user session times for 3rd generation runtime dashboards have been extended, so that the user is not thrown out of the model when using the Manage phase for longer than an hour. 40 40 41 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--debugger-action-success.png]] 49 +//__Cancel and next buttons order__// 50 +The order of the cancel and next buttons when creating a new trigger has been changed to increase alignment across the platform. Now, all cancel buttons are placed on the right of a 'next' or 'save' button. 42 42 43 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--debugger-action-failure.png]] 52 +//__Data sink page__// 53 +The data sink page has been moved to the “Explore” tab. 44 44 45 -Assuming it was activated correctly you can navigate to Manage -> Explore -> Queue browser and select the emagiz.debug queue to see the messages coming through. 55 +//__Unused images removal__// 56 +When a release is removed, the related unused images in the on-premises machines will be removed as well. 46 46 47 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--debugger-output-queue-browser.png]] 58 +//__Flow Designer performance__// 59 +Performance improvements for the Flow Designer have been implemented. 48 48 49 -{{info}}Note the following limitations when working with the debugger. 50 - * Your entire model needs to be migrated to the 3rd generation runtime 51 - * Only **one** flow **per** runtime can be debugged **per** environment 52 - * There is only **one** overview in which **all** debugged messages are shown 53 - * Message payload in excess of 100KB are not shown in the queue browser as they constitute a "large message" 54 - * The debug functionality works for a period of five minutes in which you can use the refresh button to see new messages coming in. 55 - ** After five minutes the debug functionality will be shutdown automatically under water. 56 - ** To see new messages after the five minutes you will have to access the debug functionality again from scratch.{{/info}} 61 +//__Properties with special characters__// 62 +When a user would migrate to gen3 and deploy their release containing properties with special characters, certain flows could not find the correct values to properties anymore or could not find the properties altogether. With this release, special characters such as a backslash do not break properties after deployment. 57 57 58 -== **Volume mapping - Network Share** == 64 +//__Hidden flow fragements__// 65 +When importing items from the store, flow fragments that are hidden in design will be listed under the versions in create. 59 59 60 -This release will introduce an additional functionality within our [[volume mapping>>doc:Main.eMagiz Academy.Microlearnings.Novice.File based connectivity.novice-file-based-connectivity-volume-mapping-on-premise||target="blank"]] offering. With this additional configuration option you can configure a network share and configure it to create a mapping between a network share and a docker volume. 67 +//__Resources disappearances__// 68 +Resources would disappear in the flow designer when pressing Cancel on selecting a new resource. With this release, resources without a name will not trigger error messages when users select components. 61 61 62 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--volume-mapping-network-share-overview.png]] 70 +//__Error channel for all inbounds__// 71 +If there is no custom error handling, Gen3 migration would set the error channel to “errorChannel” only for the first inbound in an entry flow. 72 +We added a migration step, such that the error channel is set to “errorChannel” of all inbounds in a flow if the custom error handling is set to false. 63 63 64 -[[image:Main.Images.Release Blog.WebHome@191-release-blog--volume-mapping-network-share-detail.png]] 74 +//__Highlighting resources__// 75 +The performance of highlighting resources of selected components is improved in Read only mode. 65 65 66 -== ** Feedbackitems77 +== **Bug Fixes** == 67 67 68 -We have also solved other feedback items besides the flow designer's critical updates. 79 +//__Topic and event-processor names__// 80 +The styling of the event streaming canvas in the Create and Deploy phases has been altered slightly to make topic and event-processor names more readable. 69 69 70 -//__ Improvedvalidationfeedback onnon-supported WSS4J interceptor__//71 - Wehaveimproved the validation feedbackwhensomeonetries toimplementaspecificWSS4Jinterceptorimplementation.82 +//__System alignment__// 83 +The positioning of Systems across Design, Create and Deploy phases are now synchronized to the position of their respective System in the Capture phase. So, systems are aligned regarding positioning across all phases. 72 72 73 -//__ Improvehelp textinflow testingon Java classes__//74 - Wehaveimprovedthe helptext when you are addingheaders toyourtest message.Inthis helptextweexplain the topfiveJava classesand howtootethemdowntomakeit work intheflowtestingfunctionalityandineMagizin general.85 +//__Error checking__// 86 +Besides checking error header, the error trigger is now configured to check if an error message contains a term. 75 75 76 -//__Improved readibility of notification when trying to delete a runtime__// 77 -When you have forgotten one or more steps when deleting a runtime you will be notified by the system on this. With this release we have improved the readibility of the notification. 88 +//__Alerting__// 89 +For gen3 models, you will no longer receive alert messages for every error message, every log message of 'level' ERROR, and for memory usage above 80%. 90 +For gen3 models with event streaming, the threshold to receive the 'Topic approaching maximum size' alert has been increased from 95% of configured size used to 110%. 91 +The gen3 configurable trigger for error messages has been extended with the option to check whether the 'last-exception' message contained a certain text. This can be combined with the header-value match. 78 78 79 -== **Bug fixes ** == 93 +//__Unused containers__// 94 +Containers are set inactive when they are unused and removed in Design. 80 80 81 -//__ Keepselectionwhencopyingproperties__//82 -We havefixedthebugthatpreventedyoufromeasily copyingpropertiesfrom oneruntimetoanotherbasedon theruntimelist.96 +//__Error popups when promoting a release version__// 97 +We fixed an issue that a lot of error popups were shown when you promoted a release version to a next environment. 83 83 84 -//__Check on security header improved for API Gateway__// 85 -We improved the check in the API Gateway through which we validate whether an API caller is authenticated when using the API Key method to secure the API Gateway. 86 - 87 -//__Copy and paste default support objects__// 88 -With this release, you can now copy and paste components without worrying that additional support objects already existing in your target flow are copied over and over into the same flow. 89 - 90 -//__Fix editability of properties when importing store items__// 91 -With this release, you can once again change property names upon importing a store item. 92 - 93 93 == **Fancy Forum Answers** == 94 94 95 95 As always, this is a gentle reminder to ask questions via the Q&A forum. The Q&A forum is available in the eMagiz iPaaS portal, so we can all benefit from the knowledge within the community. For some inspiration, take a look at these forum answers: 96 96 97 -* [[ Can I changemy 2FA secret, eg. movetoanotherauthenticator?>>https://my.emagiz.com/p/question/172825635703274697||target="blank"]]98 -* [[ Webrequestheader'SOAPAction'>>https://my.emagiz.com/p/question/172825635703274615||target="blank"]]99 -* [[ XPathException onXPATHrouter>>https://my.emagiz.com/p/question/172825635703274295||target="blank"]]100 -* [[ Changepropertywith newreleaseingeneration3 runtimes>>https://my.emagiz.com/p/question/172825635703274441||target="blank"]]103 +* [[Message Redelivery blank error message>>https://my.emagiz.com/p/question/172825635703619933||target="blank"]] 104 +* [[Timeout error kafka batch creation>>https://my.emagiz.com/p/question/172825635703620012||target="blank"]] 105 +* [[SFTP Connectivity: Transfering a whole folder structure>>https://my.emagiz.com/p/question/172825635703632587||target="blank"]] 106 +* [[3rd generation runtime with dynamic file pickup / filedrop>>https://my.emagiz.com/p/question/172825635703632732||target="blank"]] 101 101 108 + 102 102 == **Key takeaways** == 103 103 104 -Thanks to all thathelped build and those who tested and gave feedback to improve the product. To end this post, here are some key takeaways for you:111 +Thanks to all who helped build and those who tested and gave feedback to improve the product. To end this post, here are some key takeaways for you: 105 105 106 106 * If you have questions surrounding our Program Increment Planning, please get in touch with [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] 107 107 * If you have feedback or ideas for us, talk to the Platypus 108 -* Please inform us of new additions to the store ([[productmanagement@emagiz.com>>mailto:academy@emagiz.com]]) so we can all benefit from these. 115 +* Please inform us of new additions to the store ([[productmanagement@emagiz.com>>mailto:academy@emagiz.com]]) so we can all benefit from these. 109 109 * Clear your browser cache (Ctrl + Shift + Del) 110 110 * Check out the release notes [here] 111 111 * Start thinking about how the license tracker can aid your development ... ... @@ -118,6 +118,6 @@ 118 118 {{info}} 119 119 ~* Indicates a Beta feature. If you would like to get access to this beta feature, please contact [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] 120 120 121 -~*~* Indicates a GEN3-only feature.128 +~*~* Indicates a next-generation-architecture only feature. 122 122 {{/info}})))((({{toc/}}))){{/container}} 123 123 {{/container}}