Departition components combine multiple flow partitions of data records into a single flow. There are four departition components.
Concatenate
Concatenate appends multiple flow partitions of data records one after another.
Example : If the requirement is to generate and output file containing header, body and trailer part ( all parts are from different flow)
[please find the picture as example]
The concatenate component merges all the three flows one by one ( not round robin or arbitrary fashion).
Interleave
Interleave combines blocks of data records from multiple flow partitions in round-robin fashion.
The block of record is mentioned in blocksize parameter.
In the above Picture the blocksize is 12. I t suggests 1st form the top most flow 12 records will go for output , then form middle flow 12 records will be appended to output and then from last flow another 12 records will be appended to output again from top flow and so on.
Merge
Merge combines data records from multiple flow partitions that have been sorted according to the same key specifier ( for reference see yellow mark in parameter box), and maintains the sort order ( if the records are already sorted).
Gather
Gather combines data records from multiple flow partitions (mfs) or multiple flows arbitrarily and make the flow serial and collect from different serial flow of same type (of same dml) to make it single flow.
[
There are some basic difference of concatenate, gather and merge which are mentioned as below
1. Concatenate: Append different flows of same types ( same dml) in order in a single flow.
In the example, concatenate will always take header record, then detail and then
trailer.
2. Gather: Collect different flow arbitrarily.
3. Merge: Collect different flows and maintain the sorted order.
But the gather will do this arbitrarily
4. Interleave : collect different flow in round robin fashion as per blocksize mentioned.
]
Concatenate
Concatenate appends multiple flow partitions of data records one after another.
Example : If the requirement is to generate and output file containing header, body and trailer part ( all parts are from different flow)
[please find the picture as example]
The concatenate component merges all the three flows one by one ( not round robin or arbitrary fashion).
Interleave
Interleave combines blocks of data records from multiple flow partitions in round-robin fashion.
The block of record is mentioned in blocksize parameter.
In the above Picture the blocksize is 12. I t suggests 1st form the top most flow 12 records will go for output , then form middle flow 12 records will be appended to output and then from last flow another 12 records will be appended to output again from top flow and so on.
Merge
Merge combines data records from multiple flow partitions that have been sorted according to the same key specifier ( for reference see yellow mark in parameter box), and maintains the sort order ( if the records are already sorted).
Gather
Gather combines data records from multiple flow partitions (mfs) or multiple flows arbitrarily and make the flow serial and collect from different serial flow of same type (of same dml) to make it single flow.
[
There are some basic difference of concatenate, gather and merge which are mentioned as below
1. Concatenate: Append different flows of same types ( same dml) in order in a single flow.
In the example, concatenate will always take header record, then detail and then
trailer.
2. Gather: Collect different flow arbitrarily.
3. Merge: Collect different flows and maintain the sorted order.
But the gather will do this arbitrarily
4. Interleave : collect different flow in round robin fashion as per blocksize mentioned.
]
