Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-29941

[autotests] tst_qsslsocket fails too often in CI

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P1: Critical
    • None
    • 5.0.1
    • Network: SSL
    • 678320788ee781e36d2586a0d7586106034bcfdf (qtbase#release)

    Description

      EDIT July 2019: the tests are being skipped currently, as seen by grep'ing for QTBUG-29941

       

       

      Update:
      The tst_qsslsocket autotest has failed 9 times in CI between April 9. to April 29., 2013

      See more info in the test results:
      FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
      FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00795/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::sslErrors(WithSocks5Proxy:qt-test-server) Compared lists have different sizes.
      FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
      FAIL! : tst_QSslSocket::protocol(WithHttpProxyBasicAuth) 'socket->waitForEncrypted()' returned FALSE. ()
      FAIL! : tst_QSslSocket::peerVerifyError(WithSocks5Proxy) '!peerVerifyErrorSpy.isEmpty()' returned FALSE. ()
      FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5Proxy:allErrorsInExpectedList2) Compared values are not the same
      http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00806/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::sslErrors(WithSocks5Proxy:qt-test-server) Compared lists have different sizes.
      FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
      FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5Proxy:allErrorsInExpectedList2) Compared values are not the same
      FAIL! : tst_QSslSocket::sslErrors(WithSocks5ProxyAuth:qt-test-server) Compared lists have different sizes.
      FAIL! : tst_QSslSocket::waitForEncrypted(WithHttpProxy) 'socket->waitForEncrypted(10000)' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00907/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz

      FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
      FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00817/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::disconnectFromHostWhenConnecting(WithSocks5ProxyAuth) 'socket->waitForDisconnected(10000)' returned FALSE. ()
      FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithHttpProxyBasicAuth:allErrorsInExpectedList2) Compared values are not the same
      FAIL! : tst_QSslSocket::protocol(WithSocks5Proxy) 'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
      http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00934/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
      FAIL! : tst_QSslSocket::waitForEncrypted(WithHttpProxy) 'socket->waitForEncrypted(10000)' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00937/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::sessionCipher(WithSocks5ProxyAuth) 'socket->waitForConnected(10000)' returned FALSE. ()
      FAIL! : tst_QSslSocket::disconnectFromHostWhenConnecting(WithSocks5ProxyAuth) 'socket->waitForDisconnected(10000)' returned FALSE. ()
      FAIL! : tst_QSslSocket::ignoreSslErrorsList(WithHttpProxy:allErrorsInExpectedList1) Compared values are not the same
      FAIL! : tst_QSslSocket::readFromClosedSocket(WithSocks5ProxyAuth) 'socket->state() == QAbstractSocket::ConnectedState' returned FALSE. ()
      FAIL! : tst_QSslSocket::privateKeyOpaque(WithSocks5ProxyAuth) 'socket->waitForEncrypted(10000)' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00825/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::connectToHostEncrypted(WithoutProxy) 'socket->waitForDisconnected()' returned FALSE. ()
      FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5ProxyAuth:allErrorsInExpectedList2) Compared values are not the same
      FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithHttpProxy:allErrorsInExpectedList2) Compared values are not the same
      FAIL! : tst_QSslSocket::writeBigChunk(WithSocks5ProxyAuth) 'socket->waitForEncrypted(10000)' returned FALSE. ()
      FAIL! : tst_QSslSocket::peerVerifyError(WithHttpProxyBasicAuth) '!peerVerifyErrorSpy.isEmpty()' returned FALSE. ()
      http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00954/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz

      FAIL! : tst_QSslSocket::disconnectFromHostWhenConnected(WithHttpProxy) 'socket->waitForEncrypted(5000)' returned FALSE. ()
      FAIL! : tst_QSslSocket::sslErrors(WithHttpProxyBasicAuth:qt-test-server) Compared lists have different sizes.
      http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00828/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz

      — Previous info ----
      The autotest tst_qsslsocket has failed 29 times in CI between 18.1.2013 and 25.2.2013, and is currently the most failing test.

      Example of failure: http://lists.qt-project.org/pipermail/ci-reports/2013-January/002698.html

      Updated info from March 13-18: tst_qsslsocket failed 13 times.

      Most common failure: tst_QSslSocket::setReadBufferSize_task_250027(WithoutProxy)

      More details here:

      Attachments

        Issue Links

          For Gerrit Dashboard: QTBUG-29941
          # Subject Branch Project Status CR V

          Activity

            People

              cnn Qt Core & Network
              hlinaae Hanne Linaae (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes