Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-2495

Unable to upload results to TestRail from OpenNebula VM's

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: P1: Critical
    • Resolution: Done
    • Affects Version/s: production
    • Fix Version/s: None
    • Component/s: OpenNebula, RTA
    • Labels:

      Description

      SUMMARY:

      RTA tests try to automatically upload results to the TestRail service at

      https://testrail.qt.io/testrail. From physical machines this works OK as the PM IP address is opened in the firewall. When running the same tests over Coin on OpenNebula VM's, they all fail to connect/upload results to TestRail. The errors in logs are either "unknown URL type https" (windows + linux VMs) or "operation timed out" (Mac VM's).

      Is there some HTTPS related component missing on VMs and is the firewall allowing connection from the VM's to TestRail host?

       

      DETAILS:

      Example slice from Windows VM log: 

       

      06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log uploading testrail results*06:42:02*   Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1826\nwarnings = 0\nchecks = 1826\ntest_cases = 0\n', 'elapsed': '26.628000021s', 'status_id': 1}06:42:02   Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/295/24906:42:02   Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/295/24906:42:02   Detail: 06:42:02 Thu Dec 20 04:42:01 UTC 2018 Warning Failed to send results to Test Rail*06:42:02*   Detail: Error '' occurred. Arguments ('unknown url type: https',).

       

      Example slice from Mac VM log:

       

      06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log uploading testrail results*06:56:42*   Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1748\nwarnings = 0\nchecks = 1748\ntest_cases = 0\n', 'elapsed': '9.34845614433s', 'status_id': 1}06:56:42   Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/307/24906:56:42   Detail: 06:56:42 Thu Dec 20 04:56:41 GMT 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/307/24906:56:42   Detail: 06:57:56 Thu Dec 20 04:57:56 GMT 2018 Warning Failed to send results to Test Rail*06:57:57*   Detail: Error '' occurred. Arguments (error(60, 'Operation timed out'),).

       

      Example slice from Linux VM log: 

       

      06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log uploading testrail results*06:46:31*   Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1420\nwarnings = 0\nchecks = 1420\ntest_cases = 0\n', 'elapsed': '4.00401091576s', 'status_id': 1}06:46:31   Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/309/24906:46:31   Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/309/24906:46:31   Detail: 06:46:31 Thu Dec 20 04:46:30 UTC 2018 Warning Failed to send results to Test Rail*06:46:31*   Detail: Error '' occurred. Arguments ('unknown url type: https',).

       

      Example of same log from Linux PM where upload is success:

       

      07:56:45 Thu Dec 20 07:56:45 EET 2018 Log uploading testrail results*07:56:45*   Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log request content:{'comment': 'errors = 0\nfails = 0\nfatals = 0\npasses = 1289\nwarnings = 0\nchecks = 1289\ntest_cases = 0\n', 'status_id': 1}07:56:45   Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log sending testrail results to:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/285/24107:56:45   Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log request full url:https://testrail.qt.io/testrail/index.php?/api/v2/add_result_for_case/285/24107:56:45   Detail: 07:56:45 Thu Dec 20 07:56:45 EET 2018 Log {u'assignedto_id': None, u'comment': u'errors = 0\nfails = 0\nfatals = 0\npasses = 1289\nwarnings = 0\nchecks = 1289\ntest_cases = 0', u'status_id': 1, u'custom_step_results': None, u'created_by': 18, u'elapsed': None, u'created_on': 1545285405, u'version': None, u'defects': None, u'custom_extra_url': None, u'test_id': 19261, u'custom_squish_reflink': None, u'id': 3504}

        

      For reference, the code executed for upload: 

      https://codereview.qt-project.org/gitweb?p=qtqa/tqtc-qt-rta.git;a=blob_plain;f=suites/shared/testrail/testrail.py;hb=HEAD

      Upload code slice:

              test.log("request full [url:"+request.get_full_url()|url:%22+request.get_full_url()])

               e = None

              try:

                  response = urllib2.urlopen(request).read()

              except urllib2.HTTPError as e:

                  response = e.read()

       

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

              People

              • Assignee:
                markusvar Markus Varjola
                Reporter:
                teemuk Teemu Kanstren
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes