Switching between single-abi to multi-abi, fails with remaining a single-abi output

How to reproduce:

1. Open a qtquickview example in Android Studio
2. Add qtKitDir (pointing to a Qt4A kit) to QtBuild{} in build.gradle of the app
3. Build the project -> The output APK, now has jnilibs of the qtKitDir
4. Comment/Remove the qtKitDir line from QtBuild{}
5. Build the project 

Expected result:

The output APK should now have the multi-abi jni libs

Actual result:

QtGP still builds the single-abi version, so the APK lacks libs from other ABIs.

Note1: I checked the app/build/qt_generated and the AAR file is single ABI although it should be multi-abi. 

Note2: Android Studio rebuild, creates multi-abi APK.
Note3: Removing qt_generated & Build, also creates multi-abi APK.