Details
-
Bug
-
Resolution: Unresolved
-
P1: Critical
-
None
-
5.0.1
-
678320788ee781e36d2586a0d7586106034bcfdf (qtbase#release)
Description
EDIT July 2019: the tests are being skipped currently, as seen by grep'ing for QTBUG-29941
Update:
The tst_qsslsocket autotest has failed 9 times in CI between April 9. to April 29., 2013
See more info in the test results:
FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00795/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::sslErrors(WithSocks5Proxy:qt-test-server) Compared lists have different sizes.
FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
FAIL! : tst_QSslSocket::protocol(WithHttpProxyBasicAuth) 'socket->waitForEncrypted()' returned FALSE. ()
FAIL! : tst_QSslSocket::peerVerifyError(WithSocks5Proxy) '!peerVerifyErrorSpy.isEmpty()' returned FALSE. ()
FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5Proxy:allErrorsInExpectedList2) Compared values are not the same
http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00806/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::sslErrors(WithSocks5Proxy:qt-test-server) Compared lists have different sizes.
FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5Proxy:allErrorsInExpectedList2) Compared values are not the same
FAIL! : tst_QSslSocket::sslErrors(WithSocks5ProxyAuth:qt-test-server) Compared lists have different sizes.
FAIL! : tst_QSslSocket::waitForEncrypted(WithHttpProxy) 'socket->waitForEncrypted(10000)' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00907/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
FAIL! : tst_QSslSocket::writeBigChunk(WithoutProxy) 'errorBefore == errorAfter' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00817/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::disconnectFromHostWhenConnecting(WithSocks5ProxyAuth) 'socket->waitForDisconnected(10000)' returned FALSE. ()
FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithHttpProxyBasicAuth:allErrorsInExpectedList2) Compared values are not the same
FAIL! : tst_QSslSocket::protocol(WithSocks5Proxy) 'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00934/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::protocol(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. ()
FAIL! : tst_QSslSocket::waitForEncrypted(WithHttpProxy) 'socket->waitForEncrypted(10000)' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00937/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::sessionCipher(WithSocks5ProxyAuth) 'socket->waitForConnected(10000)' returned FALSE. ()
FAIL! : tst_QSslSocket::disconnectFromHostWhenConnecting(WithSocks5ProxyAuth) 'socket->waitForDisconnected(10000)' returned FALSE. ()
FAIL! : tst_QSslSocket::ignoreSslErrorsList(WithHttpProxy:allErrorsInExpectedList1) Compared values are not the same
FAIL! : tst_QSslSocket::readFromClosedSocket(WithSocks5ProxyAuth) 'socket->state() == QAbstractSocket::ConnectedState' returned FALSE. ()
FAIL! : tst_QSslSocket::privateKeyOpaque(WithSocks5ProxyAuth) 'socket->waitForEncrypted(10000)' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00825/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::connectToHostEncrypted(WithoutProxy) 'socket->waitForDisconnected()' returned FALSE. ()
FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithSocks5ProxyAuth:allErrorsInExpectedList2) Compared values are not the same
FAIL! : tst_QSslSocket::ignoreSslErrorsListWithSlot(WithHttpProxy:allErrorsInExpectedList2) Compared values are not the same
FAIL! : tst_QSslSocket::writeBigChunk(WithSocks5ProxyAuth) 'socket->waitForEncrypted(10000)' returned FALSE. ()
FAIL! : tst_QSslSocket::peerVerifyError(WithHttpProxyBasicAuth) '!peerVerifyErrorSpy.isEmpty()' returned FALSE. ()
http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00954/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
FAIL! : tst_QSslSocket::disconnectFromHostWhenConnected(WithHttpProxy) 'socket->waitForEncrypted(5000)' returned FALSE. ()
FAIL! : tst_QSslSocket::sslErrors(WithHttpProxyBasicAuth:qt-test-server) Compared lists have different sizes.
http://testresults.qt-project.org/ci/QtBase_dev_Integration/build_00828/win32-mingw47_developer-build_qtlibinfix_Windows_7/log.txt.gz
— Previous info ----
The autotest tst_qsslsocket has failed 29 times in CI between 18.1.2013 and 25.2.2013, and is currently the most failing test.
Example of failure: http://lists.qt-project.org/pipermail/ci-reports/2013-January/002698.html
Updated info from March 13-18: tst_qsslsocket failed 13 times.
Most common failure: tst_QSslSocket::setReadBufferSize_task_250027(WithoutProxy)
More details here:
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00635/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00638/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00641/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00643/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00648/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00651/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00652/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00656/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
- http://testresults.qt-project.org/ci/QtBase_stable_Integration/build_00657/win64-msvc2012_developer-build_qtnamespace_Windows_8/log.txt.gz
Attachments
Issue Links
- depends on
-
QTQAINFRA-601 Instructions for setting up a network test server no longer work
- Closed
- is required for
-
QTBUG-35034 network: fix failing auto tests on new network test server
- Closed
Gerrit Reviews
For Gerrit Dashboard: QTBUG-29941 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
51522,3 | Skip unstable tst_QSslSocket test case. | release | qt/qtbase | Status: MERGED | +2 | 0 |
62482,5 | test: Skip some flaky tests, but only if they are expected to fail | stable | qt/qtbase | Status: MERGED | +2 | 0 |
62921,2 | test: Skip some more qsslsocket flaky tests | stable | qt/qtbase | Status: MERGED | +2 | 0 |
63079,1 | test: Skip some more qsslsocket flaky tests [part 2] | stable | qt/qtbase | Status: MERGED | +2 | 0 |
100731,3 | Blacklist one tst_qsslsocket test | 5.4.0 | qt/qtbase | Status: MERGED | +2 | 0 |