Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-2094

Windows 10 VMs are super slow

    XMLWordPrintable

Details

    Description

      Windows 10 VMs are very slow. This can be seen by taking VNC connection to a slow VM. In integrations there are two symptoms:

      1. Booting takes so long that Coin gives up. This can be seen with "Coin failed to acquire a virtual machine, re-staging is unlikely to help, please contact the admins: 'Failed repeatedly to launch build/test agent'"
      2. Booting passes but VM is slow and build step stucks. After 45 minutes it times out and following is seen in the log:
      agent:2018/06/20 19:37:39 build.go:116: Virtual Memory Total: 27916746752, Free:0, UsedPercent:9.000000%
agent:2018/06/20 19:37:39 build.go:123: |             Process|                                    Name|    Status|     CPU-%|
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:39 build.go:136: Error while reading process status not implemented yet
...
agent:2018/06/20 19:37:49 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:49 build.go:136: Error while reading process status not implemented yet
agent:2018/06/20 19:37:49 build.go:232: Killed process after timeout (step took too long)
agent:2018/06/20 19:37:49 build.go:422: Executing scheduled instruction 1 of 1 - Upload all core dumps if there are some
agent:2018/06/20 19:37:49 build.go:424: 
agent:2018/06/20 19:37:49 agent.go:198: Build failed
agent:2018/06/20 19:37:49 agent.go:94: ERROR building: Timeout after 45m0s: No output receive

      Although the initial print looks like it runs out of memory, it really is about the build step hanging and timing out after 45mins.

      Edit: After https://codereview.qt-project.org/232951 is in production the log will only show the 45min timeout.

      Some sample integrations:

       

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-68848 tst_QQmlDebugJS fails too often in CI

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              tosaraja Tony Sarajärvi
              sanurmen Sami Nurmenniemi
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes