Ab-initio can process data in a parallel runtime environment
There are three forms of parallelism
1. Component parallelism
2. Pipeline parallelism
3. Data parallelism
Component Parallelism
An application with multiple processes running on separate data uses component-level parallelism.
Data parallelism
An application that deals with data divided into segments and operates on each segment simultaneously uses data parallelism. Nearly all commercial data processing tasks can use data parallelism.
Pipeline Parallelism
An application with multiple components running simultaneously on the same data uses pipeline parallelism.
Each component in the pipeline continuously reads from upstream components, processes data, and writes to downstream components. Since a downstream component can process records previously written by an upstream component, both components can operate in parallel.
There are three forms of parallelism
1. Component parallelism
2. Pipeline parallelism
3. Data parallelism
Component Parallelism
An application with multiple processes running on separate data uses component-level parallelism.
Data parallelism
An application that deals with data divided into segments and operates on each segment simultaneously uses data parallelism. Nearly all commercial data processing tasks can use data parallelism.
Pipeline Parallelism
An application with multiple components running simultaneously on the same data uses pipeline parallelism.
Each component in the pipeline continuously reads from upstream components, processes data, and writes to downstream components. Since a downstream component can process records previously written by an upstream component, both components can operate in parallel.
