eng
episciences.org
Logical Methods in Computer Science
1860-5974
2022-05-05
Volume 18, Issue 2
10.46298/lmcs-18(2:6)2022
6944
journal article
A Near-Optimal Parallel Algorithm for Joining Binary Relations
Bas Ketsman
https://orcid.org/0000-0002-4032-0709
Dan Suciu
Yufei Tao
https://orcid.org/0000-0003-3883-5452
We present a constant-round algorithm in the massively parallel computation
(MPC) model for evaluating a natural join where every input relation has two
attributes. Our algorithm achieves a load of $\tilde{O}(m/p^{1/\rho})$ where
$m$ is the total size of the input relations, $p$ is the number of machines,
$\rho$ is the join's fractional edge covering number, and $\tilde{O}(.)$ hides
a polylogarithmic factor. The load matches a known lower bound up to a
polylogarithmic factor. At the core of the proposed algorithm is a new theorem
(which we name the "isolated cartesian product theorem") that provides fresh
insight into the problem's mathematical structure. Our result implies that the
subgraph enumeration problem, where the goal is to report all the occurrences
of a constant-sized subgraph pattern, can be settled optimally (up to a
polylogarithmic factor) in the MPC model.
https://lmcs.episciences.org/6944/pdf
Computer Science - Databases