Changes for page 207 - Aligned State
Last modified by Carlijn Kokkeler on 2024/04/18 13:10
From version 113.1
edited by Erik Bakker
on 2023/05/09 12:59
on 2023/05/09 12:59
Change comment:
There is no comment for this version
To version 185.1
edited by Carlijn Kokkeler
on 2023/10/23 14:44
on 2023/10/23 14:44
Change comment:
There is no comment for this version
Summary
-
Page properties (3 modified, 0 added, 0 removed)
Details
- Page properties
-
- Title
-
... ... @@ -1,1 +1,1 @@ 1 - 197 -PayAttention1 +207 - Aligned State - Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. ebakker1 +XWiki.CarlijnKokkeler - Content
-
... ... @@ -2,63 +2,100 @@ 2 2 {{container layoutStyle="columns"}}((( 3 3 [[image:Main.Images.Release Blog.WebHome@release-blog-intro.png]] 4 4 5 -**Hi there, eMagiz developers!** Inthelast fewweeks,wehaveworkhardon improvingournextgenerationarchitectureandintroduced alertingfunctionality ontopofur eventstreamingpatternbasedonuserfeedback. Furthermore thereareseveralsmallerfeedbackitems and bugsthat have beenresolvedwiththisrelease.So withoutfurtherado letusdiveinto allwehaveto offer.5 +**Hi there, eMagiz developers!** We have done much work for state generation, so that you can derive more information from your data! Examples are enrichment, aggregation, change detection and duplicate detection. State generation functionality is only accessible for models with an add-on state generation license. Next to state generation, several improvements regarding the alignment of components have been made. Moreover, performance improvements and bug fixes have been implemented. Lastly, a change in the metrics storage duration has been performed. 6 6 7 -== ** Eventstreamingalerting** ==7 +== **State Generation** == 8 8 9 -With this release we expand our alerting functionality into the event streaming pattern. As of now one new "static" alert is introduced for all clients (using event streaming) and two "dynamic" alerts are introduced that you can configure yourself if there is need for it. 9 +//__New components__// 10 +The following components have been added: 11 +* Aggregator: reverse of the splitter, used to combine multiple messages into a single one. 12 +* Infinispan metadata outbound channel adapter: Used to (temporarily) store metadata, which can be used to enrich messages, or make decisions in filters or scripts. 13 +* Content enricher: used to add properties to the payload of messages, similar to what the header enricher can do for headers. 14 +* Duplicate detector: Support object used to detect duplicate messages for a certain key on an inbound channel of a flow component. Duplicates can be marked or discarded. 15 +* Infinispan support objects, supporting the aggregator, metadata outbound channel adapter and content enricher. 10 10 11 -The "static" alert we have added raises an alert (and a subsequent email) when the actual topic size crosses the threshold of 80% of the configured maximum retention size on a topic. This alert provides insights whether messages on it are deleted due to a size or time constraint. In cases where data is deleted becomes the topic was too full way before the messages should have been removed as a result of the retention hours constraint this alert can be seen as an indication that messages might be deleted before consumer groups had the option to consume the messages. 17 +//__SpEL functions & JSON__// 18 +Added SpEL functions for: 19 +* Encoding & decoding Base64, Hex and hmac 20 +* Date retrieval (currentDateTime, currentEpochMilli, currentEpochSecond) 21 +* Date conversion (DateTime to Epoch, Epoch to DateTime, DateTime formatter and DateTime parser) 22 +* Added support for SpEL property accessors for XML and JSON, meaning that you can read message payloads in SpEL expressions easily. For example, to retrieve the value for 'id' in the following JSON String: `{"id":"123"}`, this SpEL expression suffices: `payload.id`. 23 +* Added support for `#JsonPath` usage in SpEL expressions 12 12 13 -The two "dynamic" alerts we have added mimic the alerting on queue level we already offer to the community. 14 14 15 -[[image:Main.Images.Release Blog.WebHome@197-release-blog--new-alerting-options.png]] 26 +== **Metrics Storage Duration** == 27 + 28 + 29 + 16 16 17 - Thefirst new "dynamic" alert allows you to raise an alert once the total number of messages on one (or more topics) is less than a certain number perdefined time unit. So for example you can configure an alert once the number of message placedon atopic called "Exception" is less than 15messageswithin 5 minutes.31 +== **Feedback Items** == 18 18 19 -[[image:Main.Images.Release Blog.WebHome@196-release-blog--alert-config-example.png]] 33 +//__Alerting manual pause__// 34 +A few releases ago we changed the behavior of alerting in the deployment plan. Now each time when a deployment plan is executed the alerting will be automatically re-enabled when the deployer closes the deployment plan or closes the web browser. The majority of the users are happy with the new behavior, but there are some use cases that you do not want start the alerting immediately. With this release, if alerting has been paused manually, this will not be activated automatically after a release deployment. 20 20 21 -The second new "dynamic" alert allows you to raise an alert once one (or more) consumer groups is more than X number of messages behind on one or more topics. The configuration of this is comparable as we saw before. 36 +//__Ordering of graphs in Manage__// 37 +The graphs in Manage are now ordered according to importance. This means that runtime statistics are sorted by "Process CPU usage" (highest first), queue statistics are sorted by "Messages in queue" (highest first), and HTTP statistics are sorted by "Unsuccessful requests" (highest first). 22 22 23 -For more information on the generic way of working surrounding alerting please check out this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Crash Course.Crash Course Platform.crashcourse-platform-manage-alerting-gen3||target="blank"]] and this [[microlearning>>doc:Main.eMagiz Academy.Microlearnings.Novice.Alerting.novice-alerting-dynamic-alerting.WebHome||target="blank"]]. 39 +//__UTC times in Grafana panels__// 40 +All Grafana panels now show UTC times, which are normally used in eMagiz, instead of local (browser) time zones. This way, it is easier to match graphs with logging events or alerts. 24 24 25 -== **3rd generation improvements** == 42 +//__Update flow designer version__// 43 +The framework used in the flow designer has been updated, improving performance. 26 26 27 -//__ Increasedgraceperiodforshutdown__//28 - Inthisrelease,wehaveincreasedthegrace period a containergets toshutdownbeforeit is forcefullyshutdown.Thisshouldduce the chanceof unwantedfailoverbehavior topop-up withinyourmodel.45 +//__Carwash track TLS versions in logging__// 46 +A new logging feature will be released, enabling us to make better choices in deprecating old encryption standards. 29 29 30 -//__ Updateat once ornot__//31 - Thisrelease fixesre-introducesthe option to executeyour actionson theeMagizper zoneor allat oncewhenrunning inaouble laneDockersetup.48 +//__Moving channels in the flow designer__// 49 +Moving already attached channels in the flow designer has been made sligthly easier. 32 32 33 -//__ Improveduserfeedback whileexecuting a deploymentplan__//34 - Thisreleaseintroducesadditionalfeedbacktotheuserwhen thedeploymentlanis executed.Thissnoticeablewhenastepannotbe executed properly. Therelevantinformation ofwhy this cannot be executedis shown to theuser.Thisaytheycantake this informationand actuponitnsteadofassumingeverythingwent well.51 +//__Topic sizes description change__// 52 +In the change description (and History) when altering the topic size of a topic the new and old value were switched around creating confusion, this has been resolved. 35 35 36 -//__ Improvedauto-healingwhenrunninginahybrid situation__//37 - Insituationswhere youruninahybridsituation(i.e. partly next-genand partly thecurrentgeneration)we haveimprovedtheauto-healingfunctionalityincasean"out ofmemory"appearson a runtimerunningin thecurrent generationbuton a nextgenerationarchitecture.54 +//__Password change notification__// 55 +When an account password change request is made, even when this fails, a mail is sent to the account owner to inform the owner about the action. 38 38 39 -== **Feedback items ** == 57 +//__Password comparison__// 58 +When changing a password, it is compared to a list of known database breaches for security. A warning is shown when the password corresponds with a password in the database. 40 40 41 -//__ Make surethemessageformatcan beviewed without "Startediting"__//42 - Withthisrelease,we haveensuredthat when younavigateoDesign-> Systemmessageyou canseethe message format(i.e. XML, JSON or EDI)withoutentering the"StartEditing" mode.60 +//__Inactive user alerting__// 61 +Inactivated users are now removed from all alert settings (included “disabled“ settings) to avoid undesirable notifications. 43 43 44 -//__ Variousstylingimprovementsin theflow testingfunctionality__//45 -Vari ous smallerstylingimprovementshavebeen addedto theflow testingfunctionality to improvethe overall userexperience.Foracomplete listandmoredetailspleasecheckouttherelease notes.63 +//__Alphabetical sorting on user level in HTTP statistics__// 64 +Variables in the 3rd generation runtimes HTTP statistics detail pages are now sorted case insensitive. 46 46 66 + 67 +== **Bug Fixes** == 68 + 69 +//__Flow designer styling__// 70 +The styling of the flow designer's left component panel has been restructured, solving a rare bug which would break the styling of certain functionalities. 71 + 72 +//__Partial search for messages__// 73 +It is now possible to search on messages partially in Manage Monitoring. For example, a search for Uptime can be done by searching for "up" "time" "ptim". 74 + 75 +//__Disk usage after cloud template update__// 76 +In the last cloud template update there was an issue with disk performance. This has been resolved in this release. You can manually upgrade your cloud template, or rely on automatic updates. 77 + 78 +//__Error handling migration__// 79 +If there is no custom error handling, when migrating to Gen3, the error channel to “errorChannel” is only created for the first inbound in an entry flow. This has been fixed by adding a migration step, where we set the error channel of all inbounds in a flow to “errorChannel” if the custom error handling is set to false. 80 + 47 47 == **Fancy Forum Answers** == 48 48 49 49 As always, this is a gentle reminder to ask questions via the Q&A forum. The Q&A forum is available in the eMagiz iPaaS portal, so we can all benefit from the knowledge within the community. For some inspiration, take a look at these forum answers: 50 50 51 -* [[jsonPath in SpEL expressions>>https://my.emagiz.com/p/question/172825635703415034||target="blank"]] 52 -* [[Connecting to Azure SQL>>https://my.emagiz.com/p/question/172825635703415110||target="blank"]] 53 -* [[Changes to JSON api keep breaking my model validation, although they are irrelevant to me>>https://my.emagiz.com/p/question/172825635703415225||target="blank"]] 85 +* [[JSON Web Tokens (JWT authentication)>>https://my.emagiz.com/p/question/172825635703606919||target="blank"]] 86 +* [[Determining container sizes & reading architecture pages>>https://my.emagiz.com/p/question/172825635703594204||target="blank"]] 87 +* [[SFTP connectivity - supported algorithms>>https://my.emagiz.com/p/question/172825635703607141||target="blank"]] 88 +* [[Deploy property release results in missing flows in runtime>>https://my.emagiz.com/p/question/172825635703607354||target="blank"]] 89 +* [[MessageDeliveryException: Dispatcher has no subscribers>>https://my.emagiz.com/p/question/172825635703619797||target="blank"]] 54 54 91 + 55 55 == **Key takeaways** == 56 56 57 -Thanks to all thathelped build and those who tested and gave feedback to improve the product. To end this post, here are some key takeaways for you:94 +Thanks to all who helped build and those who tested and gave feedback to improve the product. To end this post, here are some key takeaways for you: 58 58 59 59 * If you have questions surrounding our Program Increment Planning, please get in touch with [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] 60 60 * If you have feedback or ideas for us, talk to the Platypus 61 -* Please inform us of new additions to the store ([[productmanagement@emagiz.com>>mailto:academy@emagiz.com]]) so we can all benefit from these. 98 +* Please inform us of new additions to the store ([[productmanagement@emagiz.com>>mailto:academy@emagiz.com]]) so we can all benefit from these. 62 62 * Clear your browser cache (Ctrl + Shift + Del) 63 63 * Check out the release notes [here] 64 64 * Start thinking about how the license tracker can aid your development ... ... @@ -71,6 +71,6 @@ 71 71 {{info}} 72 72 ~* Indicates a Beta feature. If you would like to get access to this beta feature, please contact [[productmanagement@emagiz.com>>mailto:academy@emagiz.com]] 73 73 74 -~*~* Indicates a GEN3-only feature.111 +~*~* Indicates a next-generation-architecture only feature. 75 75 {{/info}})))((({{toc/}}))){{/container}} 76 76 {{/container}}