Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-6621

Removed irrelevant/outdated manual tests

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • P4: Low
    • None
    • 6.8
    • Quality Assurance
    • None
    • All
    • d6ed1e658 (dev)

    Description

      The goal is to remove irrelevant/outdated manual tests. The first step being to identify them and to make sure that the relevant ones are kept.

      One important criteria is that if one auto-test is testing the same thing as the manual test, it is therefore irrelevant. 

      A list of irrelevant/outdated manual tests along with the explanations as why they are considered as such follows:

       

      Repo Module Manual test name Maintainer Last time modified Proposal Comments Maintainers comments
      QtBase QWidgets delegate Richard 10-2023
      2024-only licence
      Will not be removed for now Tests QlineEdit and QComboBox in a QStyledItemDelegate.
      In tst_QComboBox exactly the opposite is tested. This manual
      test does not seem to add plus value. Seems more like a bug
      reproducer. 
      Remove manual test Delegate as irrelevant (607422) · Gerrit Code Review
      QtBase QWidgets Regular_widgets Richard 10-2022
      2024-only licence
      To be kept Test touch events in a QWidget. Only tests if touch events are
      happening and frames/sec. Unsure if relevant
      Remove regular_widgets manual test as irrelevant (608880) · Gerrit Code Review
      QtBase QWidgets setscreen Richard 10-2020
      2024-only licence
      Removed Tests if the widget is shown in the chosen screen with information
      about that screen. Bugged  QTBUG-129726. Does not work
      Broken/bugged
      Remove broken/bugged manual test setScreen (606435) · Gerrit Code Review
      QtBase   T_cursors   03-2013
      2024-only licence
      Will not be removed for now Other tests do similar things (childwindowcontainer for example).
      Tests if a cursor changes based on where it hovers the widget.
      Very flaky
      Remove t_cursors manual test as irrelevant (608886) · Gerrit Code Review
      QtBase QWidgets task14109 Richard 03-2013
      2024-only licence
      Removed Only tests setAttributes(Qt::OpaquePaintEvent) and
      setAttributes(Qt::StaticContents) on a widget. Seems
      irrelevant/outdated
      Remove task14109 manual test as irrelevant (607284) · Gerrit Code Review
      QtBase   tst_manual_qdesktopservices   11-2020
      2024-only licence
      Will not be removed for now Opens up several web pages. Remove tst_manual_qdesktopservices manual test as irrelevant (614422) · Gerrit Code Review
      QtBase   tst_manual_qhttpnetworkconnection Mårten 01-2023
      2024-only licence
      Will not be removed for now Is an auto-test. Only check if possible to download some file from
      internet. Tests QNetworkRequest and QNetworkReply. Seems outdated
      WIP Remove tst_manual_qhttpnetworkconnection manual test as irrelevant (608889) · Gerrit Code Review
      QtBase   tst_manual_qsslsocket Timur 08-2023
      2024-only licence
      Removed Is an auto-test. Tested in tst_qsslsocket. Unsure if relevant Remove tst_manual_qsslsocket manual test as irrelevant (614428) · Gerrit Code Review
      QtBase QWidgets tst_manual_scrollarea Richard 03-2013
      2024-only licence
      Removed Assign a scrollView (that can receive paint events) to a widget.
      Seems irrelevant/outdated
      Remove tst_manual_scrollarea manual test as irrelevant (605110) · Gerrit Code Review
      QtBase QWidgets tst_manual_toplevel Richard 03-2013
      2024-only licence
      Removed Top level widget that can receive paint events.
      Seems irrelevant/outdated
      Remove tst_manual_toplevel manual test as irrelevant (607256) · Gerrit Code Review
      QtBase QWidgets tst_manual_childwidget Richard 02-2017
      2024-only licence
      Removed Test child widgets (one of which is native) with set cursors.
      Test seems redundant as already similar test in tst_qwidget
      (tst_QWidget::setCursor()). Seems redundant
      Remove tst_manual_childwidget manual test as irrelevant (607281) · Gerrit Code Review
      QtBase   tst_inputMethodHints   03-2013
      2024-only licence
      Removed Could be automated as an auto test for sure. Broken Remove tst_inputMethodHints manual test as broken (614474) · Gerrit Code Review
      QtBase QWidgets sizeonhide Richard 08-2012
      2024-only licence
      Removed Only show and hide two elements from a vertical layout
      (keeping the space empty when hidden). Cannot really be
      tested automatically, could be done easily with Squish.
      Remove sizeOnHide manual test as irrelevant (607286) · Gerrit Code Review
      QtBase   qtouchevent Shawn 01-2023
      2024-only licence
      Will not be removed for now Has many fails, could not make it work successfully even once.
      Broken, but seems relevant
      Remove manual test qTouchevent (607596) · Gerrit Code Review
      QtBase   qtabbar   01-2020
      2024-only licence
      Will not be removed for now This one is  \qtbase\tests\manual\widgets\widgets\qtabbar\stylesheet\.
      Checks that is correctly shown when using padding and has padding. 
      Seems irrelevant
      Remove qtabbar manual test as irrevelant (614473) · Gerrit Code Review
      QtBase   glyphshaping Eskil 07-2020
      2024-only licence
      Remove from CmakeList and pro Crashes. Is broken/unsure if relevant Broken, does NOT work with dev 
      Remove the broken manual test glyphshaping (606434) · Gerrit Code Review
      QtBase   Qtbug-52641 Eirik 01-2023
      2024-only licence
      To be removed Open issue from 2016 (reported) not solved. Not sure if longer relevant,
      should be a reproducer and not a manual test
      Remove Qtbug-52641 manual test as irrelevant (614475) · Gerrit Code Review
      QtBase   CustomType Thiago 09-2023
      2024-only licence
      Will not be removed for now Tests Message and QVariant. Does not seem relevant to have both Remove customType manual test as irrelevant (614478) · Gerrit Code Review
      QtBase   event_compression Shawn 04-2011
      2024-only licence
      Will not be removed for now Tests if tablet events are received and if they are properly ignored,
      not the same as touch events. 
      Remove event_compression manual test as irrelevant (614483) · Gerrit Code Review
      QtBase   flicker   03-2013
      2024-only licence
      Will not be removed for now Creates a flickering effect, that can crash the app if powerful enough.
      Otherwise nothing really happens. Unsure if relevant, Do not think
      that it can be used to stress test.
      Remove flicker manual test as irrelevant (614485) · Gerrit Code Review
      QtBase   tst_manual_qpermissions Lars 11-2022
      2024-only licence
      Will not be removed for now Test if QPermission of (contact,camera,microphone, etc) can be obtained. Remove tst_manual_permissions manual test as irrelevant (614488) · Gerrit Code Review

       

      Attachments

        For Gerrit Dashboard: QTQAINFRA-6621
        # Subject Branch Project Status CR V

        Activity

          People

            fredericl Frederic Lefebvre
            fredericl Frederic Lefebvre
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes