Changes for page 216 - Hack Heaven
Last modified by CarlijnKokkeler on 2024/04/18 13:04
From version 418.1
edited by Erik Bakker
on 2024/03/11 15:17
on 2024/03/11 15:17
Change comment:
There is no comment for this version
To version 197.1
edited by CarlijnKokkeler
on 2023/10/23 16:07
on 2023/10/23 16:07
Change comment:
There is no comment for this version
Summary
-
Page properties (3 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 -2 16-Hack Heaven1 +207 - Aligned State - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. ebakker1 +XWiki.CarlijnKokkeler - Content
-
... ... @@ -1,127 +1,117 @@ 1 1 {{container}} 2 -{{container layoutStyle="columns"}} 3 -((( 2 +{{container layoutStyle="columns"}}((( 4 4 [[image:Main.Images.Release Blog.WebHome@release-blog-intro.png]] 5 5 6 -**Hi there, eMagiz developers!** Aspartofour alignment week,we also hadahackathon eventfocusingonawidearrayofreportedfeedback ontheportal. Themajorityofthereleaseblog will be focusedonthis.Ontop of that, welaunchnewfunctionalitythat makesiteasierto transformtoJSON,selectinfraflowsina release,and deploymultipleagents to asinglemachinethatadherestospecificconditions.Butbeforewediveintoallthathaschanged,wewillpublish several announcementsviathis releaseblog (andotherchannels)toprepareyourmodelforupcomingmajorchanges.5 +**Hi there, eMagiz developers!** We have done much work for state generation, so that you can derive more information from your data! Examples are enrichment, aggregation, change detection and duplicate detection. State generation functionality is only accessible for models with an add-on state generation license. Next to state generation, several improvements regarding the alignment of components have been made. Moreover, performance improvements and bug fixes have been implemented. Lastly, a change in the metrics storage duration has been performed. 7 7 8 -== ** Announcement- TLS versions deprecated** ==7 +== **State Generation** == 9 9 10 -Placeholder for info from Bas 9 +//__New components__// 10 +The following components have been added: 11 +* Aggregator: reverse of the splitter, used to combine multiple messages into a single one. 12 +* Infinispan metadata outbound channel adapter: used to (temporarily) store metadata, which can be used to enrich messages, or make decisions in filters or scripts. 13 +* Content enricher: used to add properties to the payload of messages, similar to what the header enricher can do for headers. 14 +* Duplicate detector: support object used to detect duplicate messages for a certain key on an inbound channel of a flow component. Duplicates can be marked or discarded. 15 +* Infinispan support objects, supporting the aggregator, metadata outbound channel adapter and content enricher. 11 11 12 -{{info}}Text{{/info}} 17 +//__SpEL functions & JSON__// 18 +Added SpEL functions for: 19 +* Encoding & decoding Base64, Hex and hmac. 20 +* Date retrieval (currentDateTime, currentEpochMilli, currentEpochSecond). 21 +* Date conversion (DateTime to Epoch, Epoch to DateTime, DateTime formatter and DateTime parser). 13 13 14 - == **Announcement-Spring6**==23 +Added support for SpEL property accessors for XML and JSON, meaning that you can read message payloads in SpEL expressions easily. For example, to retrieve the value for 'id' in the following JSON String: `{"id":"123"}`, this SpEL expression suffices: `payload.id`. 15 15 16 - In thenext release, we expect torelease a major version of our currentruntime base imageforall our clientsrunningonthe**current runtime** architecture. Thisimagemoves the eMagiz stack from Java 8 to Java 17, andfromSpringFramework 5 to Spring Framework 6. Although eMagiz will try to make the transition assmooth as possible, we recommend that youstart with the following preparations.25 +Added support for `#JsonPath` usage in SpEL expressions. 17 17 18 -{{warning}} 19 -* Make sure that your release is running on the **latest** flow versions. After the release of the new image, eMagiz will push new flow versions of components that have changes. These new flow versions must be included in the subsequent release. Having your release already on the **latest** flow versions makes this less affecting 20 -* To help you identify which flow versions are especially important here, you can consider all flows that contain any of the following components: 21 -** Simple job launcher (data pipelines) 22 -** Job explorer (data pipelines) 23 -** HTTP components message sender (support object) 24 -** Web service outbound gateway (with a 'message sender' attribute specified) 25 -** SFTP session factory (support object) 26 -** API gateways with OAuth2 as security mechanism. 27 -* We recommend identifying flows with (advanced) custom Groovy scripts. As our Java version changes and the Spring version changes, this may affect the availability of the libraries on the classpath, and therefore the validity of import statements. You can already test the Groovy script using the flow testing functionality as flow testing is already running on the Java 17 and Spring Framework 6 baseline. 28 -** In addition, the groovy version used has been moved from version 3.0.19 to 4.0.18. These changes may affect your scripts as well. These release notes outline the major changes 29 -* The code handling SFTP file transfer has been overhauled completely. Although this should not affect you, we encourage you to test your SFTP integrations before deploying to Production.{{/warning}} 27 +//__New image version 2.0.0__// 28 +The above functionalities are features of the new image version 2.0.0. Important to note is that the library used for Code Mappings has been changed. Changed the library used for Code Mappings. Any customer with Gen3 runtimes and code mappings is required to reset their infra flows prior to deploying on image 2.0.0. 30 30 30 +//__Component pages__// 31 +Pages to add the new components have been created. Forms have been created nicely with proper help texts. The EHCache cache manager has been removed. 31 31 32 -== **Infra flow selection** == 33 +== **Metrics Storage Duration** == 34 +We will change the retention of monitoring data of different environments. For minute level data, it will be kept for test, acceptance and production environments for 5, 7 and 30 days respectively. Then the minute level data will be reduced to hour level data then will be stored for test, acceptance and production for 3, 6 and 12 months respectively. 33 33 34 - This releasewill includeasignificant updateto our releasefunctionality, which allows you to configureyourrelease. Presently, eMagiz willallow you to see changesonthe infra-flow level visually.36 +[[image:Main.Images.Release Blog.WebHome@release-blog-207-aligned-state-metrics-storage.png]] 35 35 36 - [[image:Main.Images.ReleaseBlog.WebHome@release-216-hack-heaven--infra-flow-comparison.png]]38 +== **Feedback Items** == 37 37 38 -In edit mode, you can select a new version via the right-click option, which you already use for other flows. 40 +//__Import from store__// 41 +The button 'Import from Store' in Design will directly open the store instead of showing a pop asking whether the store should be opened. 39 39 40 -[[image:Main.Images.Release Blog.WebHome@release-216-hack-heaven--infra-flow-selection.png]] 43 +//__Save and cancel buttons placement__// 44 +The save and cancel buttons have been placed slightly further apart from each other to avoid misclicking. 41 41 42 -We have also added a title to each context menu that specifies the flow type (e.g., exit connector, container infra, connector infra) for additional clarity while constructing your release. 46 +//__User session times__// 47 +The user session times for 3rd generation runtime dashboards have been extended, so that the user is not thrown out of the model when using the Manage phase for longer than an hour. 43 43 44 -[[image:Main.Images.Release Blog.WebHome@release-216-hack-heaven--context-menu-title.png]] 49 +//__Cancel and next buttons order// 50 +The order of the cancel and next buttons when creating a new trigger has been changed to increase alignment across the platform. Now, all cancel buttons are placed on the right of a 'next' or 'save' button. 45 45 46 -== **Multiple environments selection** == 52 +//__Data sink page__// 53 +The data sink page has been moved to the “Explore” tab. 47 47 48 -{{warning}}The following is only applicable under the following conditions: 49 - * Windows 2022 server 50 - * At least one port opened (as a consequence of a hosted web service){{/warning}} 55 +//__Unused images removal__// 56 +When a release is removed, the related unused images in the on-premises machines will be removed as well. 51 51 52 -When configuring your Deploy Agent, you now have an additional option that the user can activate. This checkbox unlocks the possibility of stability when running multiple deploy agents on one machine. 58 +//__Flow Designer performance__// 59 +Performance improvements for the Flow Designer have been implemented. 53 53 54 -[[image:Main.Images.Release Blog.WebHome@release-216-hack-heaven--multiple-environments.png]] 61 +//__Properties with special characters__// 62 +When a user would migrate to gen3 and deploy their release containing properties with special characters, certain flows could not find the correct values to properties anymore or could not find the properties altogether. With this release, special characters such as a backslash do not break properties after deployment. 55 55 56 -== **Feedback Items** == 57 -//__Easier component selection in flow designer__// 58 -The area selector through which you can select one or more components has improved to allow for an easier selection of said components when displayed close to the edge of the canvas. Expanding the area allows you to select these components, which will become much easier. 64 +//__Hidden flow fragements__// 65 +When importing items from the store, flow fragments that are hidden in design will be listed under the versions in create. 59 59 60 -//__ Improvedhandling of optionality inJSON on lists__//61 - Previously,eMagizalwayscreatedaJSON arrayifyour datamodelexpectedalist.This ledtounexpectedandundesirablebehaviorofthe message, as emptyarraysarenotalways accepted by external parties.67 +//__Resources disappearances__// 68 +Resources would disappear in the flow designer when pressing Cancel on selecting a new resource. With this release, resources without a name will not trigger error messages when users select components. 62 62 63 -With this release, we have changed the way in which we generate the JSON output should there be an empty list. Consequently, the empty list will **not** be part of the output anymore, as desired. 70 +//__Error channel for all inbounds__// 71 +If there is no custom error handling, Gen3 migration would set the error channel to “errorChannel” only for the first inbound in an entry flow. 72 +We added a migration step, such that the error channel is set to “errorChannel” of all inbounds in a flow if the custom error handling is set to false. 64 64 65 -//__ Loadingbar when searchingforlogentries__//66 -T o indicate to theuserthateMagizisstill busy retrievinglogentries,wehaveaddeda loading bar tothelog entryoverviewupon pressingsearch.74 +//__Highlighting resources__// 75 +The performance of highlighting resources of selected components is improved in Read only mode. 67 67 68 -//__Improved feedback when deleting elements from Capture__// 69 -To better specify to the user which integration or system the user intends to delete, we have improved the text in the confirmation pop-up. This way, we can provide more information to the user to avoid mistakes. 70 - 71 -//__Enhanced filter options in Manage__// 72 -With this release, we have added filter options on both the Alerting tab and the Trigger configuration pop-up. This allows users to filter on Status (Alerting) and Queues, Topics, Recipients, and more (Trigger configuration pop-up) in these places. 73 - 74 -//__Copy property names from Create__// 75 -This release unlocks the possibility of easily copying the name of a property placeholder so it can be used while deploying. 76 - 77 -//__Improved feedback during migration to the current runtime architecture__// 78 -Should you try to migrate the JMS before any other runtime under Create -> Settings, we have improved the feedback. This feedback will tell you why you cannot migrate in this order. 79 - 80 -//__Block user from making changes to their cloud while another upgrade is still in progress__// 81 -We now block users from changing their cloud configuration when another upgrade is ongoing. 82 - 83 -//__Cron trigger validation__// 84 -We have added a validation check upon saving a cron expression in the Flow Designer to avoid flows not starting due to a misconfigured cron expression. 85 - 86 86 == **Bug Fixes** == 87 -//__Making Edit (and View) the default action when configuring parameters__// 88 -We have made the Edit (and View) button the default action when configuring parameters in a transformation. 89 89 90 -//__ Property configurationpop-upresized__//91 - We have resizedthepropertyconfiguration overviews to make thepropertyvaluebetter readable.79 +//__Topic and event-processor names__// 80 +The styling of the event streaming canvas in the Create and Deploy phases has been altered slightly to make topic and event-processor names more readable. 92 92 93 -//__ Alphabeticallysorted componentsin the flow designer__//94 - As of this release,we now sort thecomponentsalphabetically in theflowdesigner.82 +//__System alignment__// 83 +The positioning of Systems across Design, Create and Deploy phases are now synchronized to the position of their respective System in the Capture phase. So, systems are aligned regarding positioning across all phases. 95 95 96 -//__ Improved sortingonruntimeoverview__//97 - Asof this release,we now sort theruntimes intheruntime overview correctlyby time. This means that theruntime with a changed status,closestto thecurrentdate and time,isshownat the top ofthe list. This shouldreducethechanceofoverlookinga critical mistake.85 +//__Error checking__// 86 +Besides checking error header, the error trigger is now configured to check if an error message contains a term. 98 98 99 -//__Improved sorting on catalog overview__// 100 -As of this release, we now sort the topics in the catalog by name. 88 +//__Alerting__// 89 +For gen3 models, you will no longer receive alert messages for every error message, every log message of 'level' ERROR, and for memory usage above 80%. 90 +For gen3 models with event streaming, the threshold to receive the 'Topic approaching maximum size' alert has been increased from 95% of configured size used to 110%. 91 +The gen3 configurable trigger for error messages has been extended with the option to check whether the 'last-exception' message contained a certain text. This can be combined with the header-value match. 101 101 102 -//__ Stylingfixonrichtext editors__//103 - Richtext editors areusedinvariousparts of theportal. This releasefixesabrokenstyling configurationthat madeitdifficultto fill ininformationinthese editors.93 +//__Unused containers__// 94 +Containers are set inactive when they are unused and removed in Design. 104 104 105 -//__ Stylingfixonrelease edit__//106 - Asofthis release,thecorrecticon(green)willbe shown whenwanting toadda secondAPI operationunderthesame"header."96 +//__Error popups when promoting a release version__// 97 +We fixed an issue that a lot of error popups were shown when you promoted a release version to a next environment. 107 107 108 -//__ Removedfalse-positivealerts on transformations__//109 - Whentransforming a string to a non-emptystring,eMagizwould also show an alert evenif theuser made a check to avoid an empty stringasoutput. This behavioris nowcorrected. Thiswill significantly reduce the number ofalertsyou will seeas a user withinthe context ofyour transformation.99 +//__Memory leak__// 100 +A memory leak when using gen 3 metrics has been fixed. 110 110 111 -//__Event Streaming Graphs - view thirty days back__// 112 -Just like the other views, we now also provide the user with a default thirty-day window to analyze relevant statistics related to event streaming further. 113 - 114 -//__Improved helptext__// 115 -We have improved various help texts across the portal to indicate better what should be filled in for specific fields. 116 - 117 117 == **Fancy Forum Answers** == 118 118 119 119 As always, this is a gentle reminder to ask questions via the Q&A forum. The Q&A forum is available in the eMagiz iPaaS portal, so we can all benefit from the knowledge within the community. For some inspiration, take a look at these forum answers: 120 120 121 -* [[XSD is only partially imported into eMagiz (xmlStat.xsd)>>https://my.emagiz.com/p/question/172825635703773349||target="blank"]] 106 +* [[JSON Web Tokens (JWT authentication)>>https://my.emagiz.com/p/question/172825635703606919||target="blank"]] 107 +* [[Determining container sizes & reading architecture pages>>https://my.emagiz.com/p/question/172825635703594204||target="blank"]] 108 +* [[SFTP connectivity - supported algorithms>>https://my.emagiz.com/p/question/172825635703607141||target="blank"]] 109 +* [[Deploy property release results in missing flows in runtime>>https://my.emagiz.com/p/question/172825635703607354||target="blank"]] 110 +* [[MessageDeliveryException: Dispatcher has no subscribers>>https://my.emagiz.com/p/question/172825635703619797||target="blank"]] 122 122 123 -== **Key Takeaways** == 124 124 113 +== **Key takeaways** == 114 + 125 125 Thanks to all who helped build and those who tested and gave feedback to improve the product. To end this post, here are some key takeaways for you: 126 126 127 127 * If you have questions surrounding our Program Increment Planning, please get in touch with [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] ... ... @@ -131,6 +131,7 @@ 131 131 * Check out the release notes [here] 132 132 * Start thinking about how the license tracker can aid your development 133 133 * Start thinking about major, minor, and patch 124 +* Upgrade to the latest build number 134 134 * Keep making great integrations 135 135 136 136 Let's stay in touch and till next time! ... ... @@ -138,11 +138,6 @@ 138 138 {{info}} 139 139 ~* Indicates a Beta feature. If you would like to get access to this beta feature, please contact [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] 140 140 141 -{{/info}} 142 -))) 143 - 144 -((( 145 -{{toc/}} 146 -))) 132 +~*~* Indicates a next-generation-architecture only feature. 133 +{{/info}})))((({{toc/}}))){{/container}} 147 147 {{/container}} 148 -{{/container}}