The collision service should be able to accelerate using some kind of spatial data structure. We already calculate a BVH of spheres s using that would be the obvious choice.

Perhaps adding in hierarchical information to the QBoundingVolume would be enough to solve this.

It may still be an option to later use other spatial data structures such as octrees, bsps etc.