Automated test coverage for Windows on ARM64

At the moment we do not have any automatic test coverage for Windows on ARM. We have to come up with a solution for this. The 2 possible approaches I see are:

CI

In order to get Windows on ARM into CI, we would need to have ARM hardware in our CI system. There is no Windows on ARM emulation for x64 available as far as I know. If we had the needed hardware in our CI infrastructure we would need provisioning but could run all the auto tests on a "real" machine and had the best test coverage. In addition to that, these CI machines could be used to build "native" Qt installers and packages (Windows on ARM is only offered as a cross compiled package at the moment).

Requirements:

• ARM64 hardware in CI
• new/changed configs inside CI
• provisioning scripts
• Probably some changes to our auto tests would be needed (not as major as for winrt or Android though, because by default applications are not sandboxed or sth like that)

RTA

Another approach would be RTA testing. Not every change would need to pass all the tests but we would at least catch major breakages before the release.

The big challenge here is remote deployment. At the moment debugging/running applications on remote Windows systems from Creator is not supported. So we would either need Creator support, use Visual Studio for building and running the applications or cook up our another solution to deploy and run applications remotely for RTA.

As far as I know RTA uses Squish to check the results of these tests. Is Squish on Windows for ARM ready for this? Can it handle processes that are run remotely or report the results in some way?

Requirements:

• Either
  • deployment/debugging support for Remote Windows machines in Qt Creator
  • Usage of Visual Studio for building, deployment, debugging/running of test applications on the remote machine
  • Coming up with another approach of deployment and running of applications on remote Windows machines
• Squish support for Windows on ARM?