Changes for page Processing a File per Line
Last modified by Erik Bakker on 2024/08/26 12:29
From version 36.1
edited by Carlijn Kokkeler
on 2024/08/23 14:17
on 2024/08/23 14:17
Change comment:
There is no comment for this version
To version 33.1
edited by Erik Bakker
on 2023/01/23 08:25
on 2023/01/23 08:25
Change comment:
There is no comment for this version
Summary
-
Page properties (2 modified, 0 added, 0 removed)
Details
- Page properties
-
- Author
-
... ... @@ -1,1 +1,1 @@ 1 -XWiki. CarlijnKokkeler1 +XWiki.ebakker - Content
-
... ... @@ -1,5 +1,5 @@ 1 1 {{container}}{{container layoutStyle="columns"}}((( 2 -In thismicrolearning,we’ll explorehow toprocess files onaper-line basis in eMagiz. This approachinvolvesbreakingdowna largeinput fileinto individual lines,eachtreated asa separatemessage.We’ll guideyouthroughconfiguringyour flowto read andhandleeachlineficiently,usingminimalmemory.Whetheryou're working withflatfiles orXML, this method allowsforflexible, line-by-lineprocessingtailoredto specific needs. By the end, you'll beequipped tosetupthis process effectively withinMagiz.2 +In some cases, you want to treat each unique part of your input file as its message instead of processing the complete file as its message. In this microlearning, we will learn how you can process a (large) file on a per-line basis. 3 3 4 4 Should you have any questions, please contact [[academy@emagiz.com>>mailto:academy@emagiz.com]]. 5 5 ... ... @@ -76,20 +76,26 @@ 76 76 77 77 After finishing all these configuration steps we can press Save to save our work and ensure that we can process the input file on a per-line basis. 78 78 79 -== 4. Keytakeaways==79 +== 4. Assignment == 80 80 81 +Configure an entry in which you define the component and configuration needed to process a file on a per-line basis. 82 +This assignment can be completed with the help of the (Academy) project that you have created/used in the previous assignment. 83 + 84 +== 5. Key takeaways == 85 + 81 81 * Easy way of reading a file line by line and sending it to eMagiz (Low on memory) 82 82 * Ability to process each line based on distinctive logic that is relevant on line level 83 83 * Can be used for flat file as well as XML input files 84 84 * Try to avoid complex transformations within the entry 85 85 86 -== 5. Suggested Additional Readings ==91 +== 6. Suggested Additional Readings == 87 87 88 -* [[Use Cases (Menu)>>doc:Main.eMagiz Academy.Use Cases.WebHome||target="blank"]] 89 -** [[File based Connectivity (Navigation)>>doc:Main.eMagiz Academy.Use Cases.File based Connectivity.WebHome||target="blank"]] 90 -* [[Intermediate (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.WebHome||target="blank"]] 91 -** [[File based Connectivity (Navigation)>>doc:Main.eMagiz Academy.Microlearnings.Intermediate Level.File based connectivity.WebHome||target="blank"]] 92 -* [[Advanced (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.WebHome||target="blank"]] 93 -** [[File based Connectivity (Menu)>>doc:Main.eMagiz Academy.Microlearnings.Advanced Level.File based connectivity.WebHome||target="blank"]] 93 +There are no suggested additional readings on this topic 94 94 95 +== 7. Silent demonstration video == 96 + 97 +This video demonstrates how you could have handled the assignment and gives you some context on what you have just learned. 98 + 99 +{{video attachment="novice-file-based-connectivity-processing-a-file-per-line.mp4" reference="Main.Videos.Microlearning.WebHome"/}} 100 + 95 95 )))((({{toc/}}))){{/container}}{{/container}}