Disable attention-set modification notification emails

I recently learned that Gerrit will "helpfully" send out notification emails when a person toggles their attention-set status for a patch:

Subject: qtdeclarative[dev]: Shortcut: Fix nativeText and portableText when using sequences
Attention is currently required from: Dennis Oberst, Fabian Kosmale, Mitch Curtis, Shawn Rutledge.
Tor Arne Vestbø removed themselves from the attention set of this change.
The reason is: Removed by Tor Arne Vestbø <tor.arne.vestbo@qt.io> using the hovercard menu.

Is there a way to disable this feature, even with a custom patch/plugin to Gerrit, and can we please do so?

Managing review queues and "tasks" in Gerrit is cumbersome, and there should be a way to privately juggle my tasks without spamming every other person on a change. And no, doing that though my e-mail inbox does not scale