What is "All-to-all" communication?

A well-proven parallel computing communication technique used within MPI established in the 1980s whereby processes exchange information in an optimal way without introducing extra overhead and opportunities for failures. Per Wikipedia, "a collective operation, where each processor sends an individual message to every other processor."

All-to-all contrasts with the approach that distributed computing takes, using a driver/executor model which requires tiny tasks to create and manage shuffle files for intermediate management of task results for other dependent tasks.

Since Bodo uses all-to-all communication which is much more efficient, Bodo is more efficient than traditional approaches using shuffle files and tiny tasks.