Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-6621

Removed irrelevant/outdated manual tests

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • P4: Low
    • None
    • 6.8
    • Quality Assurance
    • None
    • All

    Description

      The goal is to remove irrelevant/outdated manual tests. The first step being to identify them and to make sure that the relevant ones are kept.

      One important criteria is that if one auto-test is testing the same thing as the manual test, it is therefore irrelevant. 

      A list of irrelevant/outdated manual tests along with the explanations as why they are considered as such follows:

       

      Repo Module Manual test name Maintainer Last time modified Proposal Comments Maintainers comments
      QtBase QWidgets delegate Richard 10-2023
      2024-only licence
      Be made as an auto test Tests QlineEdit and QComboBox in a QStyledItemDelegate.
      In tst_QComboBox exactly the opposite is tested. This manual
      test does not seem to add plus value. Seems more like a bug
      reproducer. 
       
      QtBase QWidgets Regular_widgets Richard 10-2022
      2024-only licence
        Test touch events in a QWidget. Only tests if touch events are
      happening and frames/sec. Unsure if relevant
       
      QtBase QWidgets setscreen Richard 10-2020
      2024-only licence
      To be removed Tests if the widget is shown in the chosen screen with information
      about that screen. Bugged  QTBUG-129726. Does not work
       
      QtBase   T_cursors   03-2013
      2024-only licence
      To be removed/
      Updated
      Other tests do similar things (childwindowcontainer for example).
      Tests if a cursor changes based on where it hovers the widget.
      Very flaky
       
      QtBase QWidgets task14109 Richard 03-2013
      2024-only licence
      To be removed/
      updated
      Only tests setAttributes(Qt::OpaquePaintEvent) and
      setAttributes(Qt::StaticContents) on a widget. Seems
      irrelevant/outdated
       
      QtBase   tst_manual_qdesktopservices   11-2020
      2024-only licence
      To be removed/
      Repaired
      Opens up several web pages. Broken  
      QtBase   tst_manual_qhttpnetworkconnection Mårten 01-2023
      2024-only licence
        Is an auto-test. Only check if possible to download some file from
      internet. Tests QNetworkRequest and QNetworkReply. Seems outdated
       
      QtBase   tst_manual_qsslsocket Timur 08-2023
      2024-only licence
        Is an auto-test. Tested in tst_qsslsocket. Unsure if relevant  
      QtBase QWidgets tst_manual_scrollarea Richard 03-2013
      2024-only licence
      To be removed Assign a scrollView (that can receive paint events) to a widget.
      Seems irrelevant/outdated
      Remove tst_manual_scrollarea manual test as irrelevant (605110) · Gerrit Code Review
      QtBase QWidgets tst_manual_toplevel Richard 03-2013
      2024-only licence
      To be removed Top level widget that can receive paint events.
      Seems irrelevant/outdated
       
      QtBase QWidgets tst_manual_childwidget Richard 02-2017
      2024-only licence
      To be removed Tests seems redundant as already similar test in tst_qwidget
      (tst_QWidget::setCursor()). Seems redundant
       
      QtBase   tst_inputMethodHints   03-2013
      2024-only licence
      To be made as an
      auto test
      Could be automated as an auto test for sure. Broken  
      QtBase QWidgets sizeonhide Richard 08-2012
      2024-only licence
      To be made as a
      squish test/ to be
      removed
      Only show and hide two elements from a vertical layout
      (keeping the space empty when hidden). Cannot really be
      tested automatically, could be done easily with Squish.
       
      QtBase   qtouchevent Shawn 01-2023
      2024-only licence
      To be removed/
      to be repaired
      Has many fails, could not make it work successfully even once.
      Broken. 
       
      QtBase   qtabbar   01-2020
      2024-only licence
      To be removed This one is  \qtbase\tests\manual\widgets\widgets\qtabbar\stylesheet\.
      Checks that is correctly shown when using padding and has padding. 
      Seems irrelevant
       
      QtBase   qconcatenatetablesproxymodel   09-2018
      2024-only licence
      To be made as an
      auto test
      The manual test is good, but could be an auto-test  
      QtBase   glyphshaping   07-2020
      2024-only licence
      To be removed Crashes. Is broken/unsure if relevant  
      QtBase   Qtbug-52641 Eirik 01-2023
      2024-only licence
      To be removed Open issue from 2016 (reported) not solved. Not sure if longer relevant,
      should be a reproducer and not a manual test
       
      QtBase   CustomType Thiago 09-2023
      2024-only licence
      Could be made as one with
      CustomTypeSending
      Tests Message and QVariant. Does not seem relevant to have both  
      QtBase   CustomTypeSending Thiago 09-2023
      2024-only licence
      Could be made as one with
      CustomType
      Tests same thing as CustomType while adding connect to send from
      widget to another. Does not seem relevant to have both.
       
      QtBase   event_compression Shawn 04-2011
      2024-only licence
        Tests if tablet events are received and if they are properly ignored,
      not the same as touch events. 
       
      QtBase   flicker   03-2013
      2024-only licence
        Creates a flickering effect, that can crash the app if powerful enough.
      Otherwise nothing really happens. Unsure if relevant, Do not think
      that it can be used to stress test.
       
      QtBase   tst_manual_qpermissions Lars 11-2022
      2024-only licence
      Could maybe be auto Test if QPermission of (contact,camera,microphone, etc) can be obtained.  

       

      Attachments

        For Gerrit Dashboard: QTQAINFRA-6621
        # Subject Branch Project Status CR V

        Activity

          People

            fredericl Frederic Lefebvre
            fredericl Frederic Lefebvre
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There is 1 open Gerrit change