Flakiness update 2022: Difference between revisions

From Qt Wiki
Jump to navigation Jump to search
(Created page with "{| class="wikitable sortable" |- ! index !! project !! branch !! testCase !! testFunction !! failed_count !! flaky_count !! target os version !! target architecture !! Link to...")
 
No edit summary
 
Line 1: Line 1:
[[Fixed flaky tests in July 2022]]
[[Flaky tests that caused failures in August]]
{| class="wikitable sortable"
{| class="wikitable sortable"
|-
|-
! index !! project !! branch !! testCase !! testFunction !! failed_count !! flaky_count !! target os version !! target architecture !! Link to grafana dash
!index!!project!!branch!!testCase!!testFunction!!failed_count!!flaky_count!!target os version!!target architecture!!Link to grafana dash
|-
|-
|0||qt/qtremoteobjects||dev||tst_external_IODevice||testRun||7||183||MacOS_12||ARM64||https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now
|0||qt/qtremoteobjects||dev||tst_external_IODevice||testRun||7||183||MacOS_12||ARM64||https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now

Latest revision as of 15:34, 29 August 2022

Fixed flaky tests in July 2022

Flaky tests that caused failures in August

index project branch testCase testFunction failed_count flaky_count target os version target architecture Link to grafana dash
0 qt/qtremoteobjects dev tst_external_IODevice testRun 7 183 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now
0 qt/qtremoteobjects dev tst_external_IODevice testRun 7 183 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_external_IODevice&var-testFunction=testRun&from=now-90d&to=now
1 qt/qtbase dev tst_qsocketnotifier unexpectedDisconnection 6 97 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qsocketnotifier&var-testFunction=unexpectedDisconnection&from=now-90d&to=now
2 qt/qtwebengine dev tst_inspectorserver openRemoteDebuggingSession 6 2 QEMU ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_inspectorserver&var-testFunction=openRemoteDebuggingSession&from=now-90d&to=now
3 qt/qtbase dev tst_qmutex moreStress 5 2 MacOS_10_15 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmutex&var-testFunction=moreStress&from=now-90d&to=now
4 qt/qtdeclarative dev tst_qquickfiledialogimpl goUpIntoLargeFolder 3 185 Ubuntu_20_04 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickfiledialogimpl&var-testFunction=goUpIntoLargeFolder&from=now-90d&to=now
5 qt/qtbase dev tst_qhttpsocketengine downloadBigFile 2 70 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qhttpsocketengine&var-testFunction=downloadBigFile&from=now-90d&to=now
6 qt/qtbase dev tst_networkselftest ftpProxyServer 2 44 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
7 qt/qtdeclarative dev tst_qquicklistview QTBUG_61269_appendDuringScrollDown 2 37 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=QTBUG_61269_appendDuringScrollDown&from=now-90d&to=now
8 qt/qtbase dev tst_networkselftest ftpProxyServer 2 25 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
9 qt/qtdeclarative dev tst_qquicklistview keyNavigationEnabled 2 14 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=keyNavigationEnabled&from=now-90d&to=now
10 qt/qtdeclarative dev tst_qquicklistview setPositionOnLayout 2 14 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=setPositionOnLayout&from=now-90d&to=now
11 qt/qtdeclarative dev tst_qquicklistview flickBothDirections 2 13 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=flickBothDirections&from=now-90d&to=now
12 qt/qtdeclarative dev tst_qquicklistview enforceRange_withoutHighlight 2 7 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquicklistview&var-testFunction=enforceRange_withoutHighlight&from=now-90d&to=now
13 qt/qtbase dev tst_qlistview taskQTBUG_39902_mutualScrollBars 2 1 Android_ANY X86 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qlistview&var-testFunction=taskQTBUG_39902_mutualScrollBars&from=now-90d&to=now
14 qt/qtwayland dev tst_surface createSubsurface 2 1 QEMU ARMv7 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_surface&var-testFunction=createSubsurface&from=now-90d&to=now
15 qt/qtbase dev tst_networkselftest ftpProxyServer 1 74 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_networkselftest&var-testFunction=ftpProxyServer&from=now-90d&to=now
16 qt/qtwebengine dev tst_qwebenginepage backgroundColor 1 54 MacOS_10_14 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qwebenginepage&var-testFunction=backgroundColor&from=now-90d&to=now
17 qt/qtdeclarative dev tst_qquickfiledialogimpl itemsDisabledWhenNecessary 1 48 Ubuntu_20_04 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickfiledialogimpl&var-testFunction=itemsDisabledWhenNecessary&from=now-90d&to=now
18 qt/qtbase dev tst_qmutex try_lock_until_non_recursive 1 20 QNX_710 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmutex&var-testFunction=try_lock_until_non_recursive&from=now-90d&to=now
19 qt/qtwebengine dev tst_qmltests UserScripts::test_bigScript 1 14 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmltests&var-testFunction=UserScripts::test_bigScript&from=now-90d&to=now
20 qt/qtlocation dev tst_declarative_ui MapFlick::test_flick_up_with_filtering 1 5 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapFlick::test_flick_up_with_filtering&from=now-90d&to=now
21 qt/qtlocation dev tst_declarative_ui MapFlick::test_flick_up 1 4 MacOS_12 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapFlick::test_flick_up&from=now-90d&to=now
22 qt/qtlocation dev tst_declarative_ui MapKeepGrabAndPreventSteal::test_flick 1 3 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_declarative_ui&var-testFunction=MapKeepGrabAndPreventSteal::test_flick&from=now-90d&to=now
23 qt/qtwebengine dev tst_qmltests NewWindowRequest::test_loadNewWindowRequest 1 2 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qmltests&var-testFunction=NewWindowRequest::test_loadNewWindowRequest&from=now-90d&to=now
24 qt/qtbase dev tst_qdialog snapToDefaultButton 1 1 Windows_11_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qdialog&var-testFunction=snapToDefaultButton&from=now-90d&to=now
25 qt/qtbase dev tst_qnetworkreply closeClientSideConnectionEagerlyQtbug20726 1 1 Windows_10_21H2 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qnetworkreply&var-testFunction=closeClientSideConnectionEagerlyQtbug20726&from=now-90d&to=now
26 qt/qtdeclarative dev tst_qquickdraghandler mouseDrag 1 1 MacOS_11_00 ARM64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickdraghandler&var-testFunction=mouseDrag&from=now-90d&to=now
27 qt/qtdeclarative dev tst_qquickdraghandler mouseDrag 1 1 MacOS_12 X86_64 https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?var-testCase=tst_qquickdraghandler&var-testFunction=mouseDrag&from=now-90d&to=now