After searching a bit, I found this option to add compiler flags to configure.
../configure – -DCMAKE_CXX_FLAGS_RELEASE=-march=skylake
But the configure overview still says:
"Building for: linux-g++ (x86_64, CPU features: mmx sse sse2)"
Which means Qt isn't aware the cpu feature is enabled unconditionally (or the output is wrong).