Technology

How Bodo Works Behind the Scenes

How Does Bodo Work?

Bodo is a new approach to HPC-style parallel computing, but with the simplicity of native Python. Our compiler technology infers the parallel structure of application code, including Pandas, NumPy and others, and generates true parallel execution code - with speed and linear scalability beyond 10,000 cores.

Bodo Platform: Simplicity Plus Performance

Data processing frameworks have historically presented a trade-off between simplicity of high-level languages like Python and performance of HPC paradigms likeMPI/C++. Bodo achieves both simultaneously using the first automatic-parallelization and optimization compiler technology.

BENCHMARKS

Bodo’s Just-in-Time (JIT) Compiler Technology

Bodo engine incorporates the first inferential compiler – it can infer the structure of the application to optimize and parallelize it automatically. This is as if an HPC expert rewrote the code in a low-level paradigm, but it happens transparently and in real-time.

INPUT

Compiler Engine

ETL / Analytics Engine

Auto Parallelism

OUTPUT

Automatically:

Optimized

Parallelized

Vectorized

TOOLS

OPEN SOURCE LIBRARIES

HPC ARCHITECTURE

True Parallel Architecture

Bodo is the first engine that provides the full parallelism and theoretically unlimited scalability of Single Program Multiple Data (SPMD) architecture. Previous engines approximate parallelism using master-executor libraries, which incur significant task overheads and sequential bottlenecks.