When trying to interact with multiple TapHandlers using different points at the same time will cause the first to not be active when tapping the second.

In the example given, if you press on the left rectangle and then on the right with a different finger while keeping the first pressed down, the first one will no longer be active.

As the taphandlers can have their own points, it should be possible for both to stay active in this case.