Details
-
Bug
-
Resolution: Done
-
P1: Critical
-
None
-
production
Description
SUMMARY:
RTA tests try to automatically upload results to the TestRail service at
https://testrail.qt.io/testrail. From physical machines this works OK as the PM IP address is opened in the firewall. When running the same tests over Coin on OpenNebula VM's, they all fail to connect/upload results to TestRail. The errors in logs are either "unknown URL type https" (windows + linux VMs) or "operation timed out" (Mac VM's).
Is there some HTTPS related component missing on VMs and is the firewall allowing connection from the VM's to TestRail host?
DETAILS:
Example slice from Windows VM log:
06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log uploading testrail results*06:42:02* Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1826\nwarnings = 0\nchecks = 1826\ntest_cases = 0\n', 'elapsed': '26.628000021s', 'status_id': 1}06:42:02 Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/295/24906:42:02 Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/295/24906:42:02 Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Warning Failed to send results to Test Rail*06:42:02* Detail: Error '' occurred. Arguments ('unknown url type: https',).
Example slice from Mac VM log:
06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log uploading testrail results*06:56:42* Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1748\nwarnings = 0\nchecks = 1748\ntest_cases = 0\n', 'elapsed': '9.34845614433s', 'status_id': 1}06:56:42 Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/307/24906:56:42 Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/307/24906:56:42 Detail: 06:57:56 Thu Dec 20 04:57:56 GMT 2018 Warning Failed to send results to Test Rail*06:57:57* Detail: Error '' occurred. Arguments (error(60, 'Operation timed out'),).
Example slice from Linux VM log:
06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log uploading testrail results*06:46:31* Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1420\nwarnings = 0\nchecks = 1420\ntest_cases = 0\n', 'elapsed': '4.00401091576s', 'status_id': 1}06:46:31 Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/309/24906:46:31 Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/309/24906:46:31 Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Warning Failed to send results to Test Rail*06:46:31* Detail: Error '' occurred. Arguments ('unknown url type: https',).
Example of same log from Linux PM where upload is success:
07:56:45 Thu Dec 20 07:56:45 EET 2018 Log uploading testrail results*07:56:45* Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1289\nwarnings = 0\nchecks = 1289\ntest_cases = 0\n', 'status_id': 1}07:56:45 Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/285/24107:56:45 Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/285/24107:56:45 Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log {u'assignedto_id': None, u'comment': u'errors = 0\nfails = 0\nfatals = 0\npasses = 1289\nwarnings = 0\nchecks = 1289\ntest_cases = 0', u'status_id': 1, u'custom_step_results': None, u'created_by': 18, u'elapsed': None, u'created_on': 1545285405, u'version': None, u'defects': None, u'custom_extra_url': None, u'test_id': 19261, u'custom_squish_reflink': None, u'id': 3504}
For reference, the code executed for upload:
Upload code slice:
test.log("request full [url:"+request.get_full_url()|url:%22+request.get_full_url()])
e = None
try:
response = urllib2.urlopen(request).read()
except urllib2.HTTPError as e:
response = e.read()
Attachments
Issue Links
- is required for
-
QTQAINFRA-2676 Pilot and integrate TestRail tool
- Closed