Flakiness update 2022

From Qt Wiki
Jump to navigation Jump to search

Fixed flaky tests in July 2022

Flaky tests that caused failures in August

index project branch testCase testFunction failed_count flaky_count target os version target architecture Link to grafana dash
0 qt/qtremoteobjects dev tst_external_IODevice testRun 7 183 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now
0 qt/qtremoteobjects dev tst_external_IODevice testRun 7 183 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now
1 qt/qtbase dev tst_qsocketnotifier unexpectedDisconnection 6 97 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qsocketnotifier&var-testFunction=unexpectedDisconnection&from=now-90d&to=now
2 qt/qtwebengine dev tst_inspectorserver openRemoteDebuggingSession 6 2 QEMU ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_inspectorserver&var-testFunction=openRemoteDebuggingSession&from=now-90d&to=now
3 qt/qtbase dev tst_qmutex moreStress 5 2 MacOS_10_15 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmutex&var-testFunction=moreStress&from=now-90d&to=now
4 qt/qtdeclarative dev tst_qquickfiledialogimpl goUpIntoLargeFolder 3 185 Ubuntu_20_04 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickfiledialogimpl&var-testFunction=goUpIntoLargeFolder&from=now-90d&to=now
5 qt/qtbase dev tst_qhttpsocketengine downloadBigFile 2 70 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qhttpsocketengine&var-testFunction=downloadBigFile&from=now-90d&to=now
6 qt/qtbase dev tst_networkselftest ftpProxyServer 2 44 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
7 qt/qtdeclarative dev tst_qquicklistview QTBUG_61269_appendDuringScrollDown 2 37 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=QTBUG_61269_appendDuringScrollDown&from=now-90d&to=now
8 qt/qtbase dev tst_networkselftest ftpProxyServer 2 25 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
9 qt/qtdeclarative dev tst_qquicklistview keyNavigationEnabled 2 14 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=keyNavigationEnabled&from=now-90d&to=now
10 qt/qtdeclarative dev tst_qquicklistview setPositionOnLayout 2 14 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=setPositionOnLayout&from=now-90d&to=now
11 qt/qtdeclarative dev tst_qquicklistview flickBothDirections 2 13 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=flickBothDirections&from=now-90d&to=now
12 qt/qtdeclarative dev tst_qquicklistview enforceRange_withoutHighlight 2 7 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=enforceRange_withoutHighlight&from=now-90d&to=now
13 qt/qtbase dev tst_qlistview taskQTBUG_39902_mutualScrollBars 2 1 Android_ANY X86 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qlistview&var-testFunction=taskQTBUG_39902_mutualScrollBars&from=now-90d&to=now
14 qt/qtwayland dev tst_surface createSubsurface 2 1 QEMU ARMv7 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_surface&var-testFunction=createSubsurface&from=now-90d&to=now
15 qt/qtbase dev tst_networkselftest ftpProxyServer 1 74 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
16 qt/qtwebengine dev tst_qwebenginepage backgroundColor 1 54 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qwebenginepage&var-testFunction=backgroundColor&from=now-90d&to=now
17 qt/qtdeclarative dev tst_qquickfiledialogimpl itemsDisabledWhenNecessary 1 48 Ubuntu_20_04 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickfiledialogimpl&var-testFunction=itemsDisabledWhenNecessary&from=now-90d&to=now
18 qt/qtbase dev tst_qmutex try_lock_until_non_recursive 1 20 QNX_710 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmutex&var-testFunction=try_lock_until_non_recursive&from=now-90d&to=now
19 qt/qtwebengine dev tst_qmltests UserScripts::test_bigScript 1 14 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmltests&var-testFunction=UserScripts::test_bigScript&from=now-90d&to=now
20 qt/qtlocation dev tst_declarative_ui MapFlick::test_flick_up_with_filtering 1 5 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapFlick::test_flick_up_with_filtering&from=now-90d&to=now
21 qt/qtlocation dev tst_declarative_ui MapFlick::test_flick_up 1 4 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapFlick::test_flick_up&from=now-90d&to=now
22 qt/qtlocation dev tst_declarative_ui MapKeepGrabAndPreventSteal::test_flick 1 3 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapKeepGrabAndPreventSteal::test_flick&from=now-90d&to=now
23 qt/qtwebengine dev tst_qmltests NewWindowRequest::test_loadNewWindowRequest 1 2 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmltests&var-testFunction=NewWindowRequest::test_loadNewWindowRequest&from=now-90d&to=now
24 qt/qtbase dev tst_qdialog snapToDefaultButton 1 1 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qdialog&var-testFunction=snapToDefaultButton&from=now-90d&to=now
25 qt/qtbase dev tst_qnetworkreply closeClientSideConnectionEagerlyQtbug20726 1 1 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qnetworkreply&var-testFunction=closeClientSideConnectionEagerlyQtbug20726&from=now-90d&to=now
26 qt/qtdeclarative dev tst_qquickdraghandler mouseDrag 1 1 MacOS_11_00 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickdraghandler&var-testFunction=mouseDrag&from=now-90d&to=now
27 qt/qtdeclarative dev tst_qquickdraghandler mouseDrag 1 1 MacOS_12 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickdraghandler&var-testFunction=mouseDrag&from=now-90d&to=now