Qt5ForAndroidAutotests: Difference between revisions
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
h1. Qt 5 for Android project - Autotests | |||
The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4. | The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4. | ||
| Line 7: | Line 7: | ||
Please note that a few tests crashed and some did not build properly. These are missing from the report. | Please note that a few tests crashed and some did not build properly. These are missing from the report. | ||
==Total statistics== | == Total statistics == | ||
17262 pass<br /> 203 fail | 17262 pass<br />203 fail | ||
==tst_QRand== | == tst_QRand == | ||
2 pass<br /> 1 fail | 2 pass<br />1 fail | ||
Failures:<br /> testqrand (): fail tst_qrand.cpp(68): | Failures:<br />testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. () | ||
==tst_QDir== | == tst_QDir == | ||
185 pass<br /> 31 fail | 185 pass<br />31 fail | ||
Failures:<br /> entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 4 Expected (expected.count()): 7<br /> entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 1 Expected (expected.count()): 3<br /> entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 3 Expected (expected.count()): 4<br /> entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 1 Expected (expected.count()): 2<br /> entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 4 Expected (expected.count()): 5<br /> entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 2 Expected (expected.count()): 3<br /> entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 0 Expected (expected.count()): 1<br /> entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same Actual (actual[i]) : directory Expected (expected[i]): brokenlink.lnk<br /> entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same Actual (actual[i]) : .. Expected (expected[i]): .<br /> entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same Actual (actual.count()) : 0 Expected (expected.count()): 2<br /> entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same Actual (actual[i]) : file Expected (expected[i]): writable<br /> mkdir (data0): fail tst_qdir.cpp(302): | Failures:<br />entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 4<br /> Expected (expected.count()): 7<br />entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 1<br /> Expected (expected.count()): 3<br />entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 3<br /> Expected (expected.count()): 4<br />entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 1<br /> Expected (expected.count()): 2<br />entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 4<br /> Expected (expected.count()): 5<br />entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 2<br /> Expected (expected.count()): 3<br />entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 0<br /> Expected (expected.count()): 1<br />entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same<br /> Actual (actual[i]) : directory<br /> Expected (expected[i]): brokenlink.lnk<br />entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same<br /> Actual (actual[i]) : ..<br /> Expected (expected[i]): .<br />entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same<br /> Actual (actual.count()) : 0<br /> Expected (expected.count()): 2<br />entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same<br /> Actual (actual[i]) : file<br /> Expected (expected[i]): writable<br />mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. ()<br />mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. ()<br />rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. ()<br />rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. ()<br />equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same<br /> Actual ((dir1 == dir2)): 0<br /> Expected (expected) : 1<br />cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. ()<br />(and other identical test failures) | ||
==tst_QDirIterator== | == tst_QDirIterator == | ||
16 pass<br /> 7 fail | 16 pass<br />7 fail | ||
Failures:<br /> iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes. Actual (list) size: | Failures:<br />iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.<br /> Actual (list) size: '4'<br /> Expected (sortedEntries) size: '7'<br />iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.<br /> Actual (list) size: '3'<br /> Expected (sortedEntries) size: '6'<br />iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.<br /> Actual (list) size: '2'<br /> Expected (sortedEntries) size: '5'<br />iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.<br /> Actual (list) size: '7'<br /> Expected (sortedEntries) size: '10'<br />iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.<br /> Actual (list) size: '2'<br /> Expected (sortedEntries) size: '4'<br />(and other identical test failures) | ||
==tst_QFileInfo== | == tst_QFileInfo == | ||
150 pass<br /> 3 fail | 150 pass<br />3 fail | ||
Failures:<br /> fileTimes (simple): fail tst_qfileinfo.cpp(1085): | Failures:<br />fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. ()<br />(and other identical test failures) | ||
==tst_QFileSystemWatcher== | == tst_QFileSystemWatcher == | ||
19 pass<br /> 2 fail | 19 pass<br />2 fail | ||
Failures:<br /> addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes. Actual (watcher.addPaths(paths)) size: | Failures:<br />addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.<br /> Actual (watcher.addPaths(paths)) size: '1'<br /> Expected (QStringList()) size: '0'<br />removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.<br /> Actual (watcher.addPaths(paths)) size: '1'<br /> Expected (QStringList()) size: '0' | ||
==tst_QResourceEngine== | == tst_QResourceEngine == | ||
0 pass<br /> 2 fail | 0 pass<br />2 fail | ||
Failures:<br /> initTestCase (): fail tst_qresourceengine.cpp(67): | Failures:<br />initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA (&quot;runtime_resource.rcc&quot;))' returned FALSE. ()<br />cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA (&quot;runtime_resource.rcc&quot;))' returned FALSE. () | ||
==tst_QMetaType== | == tst_QMetaType == | ||
580 pass<br /> 33 fail | 580 pass<br />33 fail | ||
Failures:<br /> flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same Actual (quint32(QMetaType::typeFlags(id))): 7 Expected (flags) : 0<br /> flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same Actual (quint32(QMetaType::typeFlags(id))): 3 Expected (flags) : 0<br /> saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same Actual (QMetaType::save(stream, type, value)): 1 Expected (isStreamable) : 0<br /> (and other identical test failures) | Failures:<br />flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same<br /> Actual (quint32(QMetaType::typeFlags(id))): 7<br /> Expected (flags) : 0<br />flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same<br /> Actual (quint32(QMetaType::typeFlags(id))): 3<br /> Expected (flags) : 0<br />saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same<br /> Actual (QMetaType::save(stream, type, value)): 1<br /> Expected (isStreamable) : 0<br />(and other identical test failures) | ||
==tst_QTranslator== | == tst_QTranslator == | ||
10 pass<br /> 1 fail | 10 pass<br />1 fail | ||
Failures:<br /> dependencies (): fail tst_qtranslator.cpp(250): | Failures:<br />dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. () | ||
==tst_QUuid== | == tst_QUuid == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail ../tst_quuid.cpp(108): | Failures:<br />initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to ) | ||
==tst_QThread== | == tst_QThread == | ||
10 pass<br /> 1 fail | 10 pass<br />1 fail | ||
Failures:<br /> terminate (): fail Unknown file | Failures:<br />terminate (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error. | ||
==tst_QThread== | == tst_QThread == | ||
10 pass<br /> 1 fail | 10 pass<br />1 fail | ||
Failures:<br /> terminate (): fail Unknown file | Failures:<br />terminate (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error. | ||
==tst_QThread== | == tst_QThread == | ||
10 pass<br /> 1 fail | 10 pass<br />1 fail | ||
Failures:<br /> terminate (): fail Unknown file | Failures:<br />terminate (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error. | ||
==tst_QImageWriter== | == tst_QImageWriter == | ||
81 pass<br /> 14 fail | 81 pass<br />14 fail | ||
Failures:<br /> writeImage ( | Failures:<br />writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. ()<br />saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable)<br />(and other identical test failures) | ||
==tst_QEventDispatcher== | == tst_QEventDispatcher == | ||
3 pass<br /> 2 fail | 3 pass<br />2 fail | ||
Failures:<br /> registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same Actual (receivedEventType) : | Failures:<br />registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same<br /> Actual (receivedEventType) : –1<br /> Expected (int(QEvent::Timer)): 1<br />sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same<br /> Actual (receivedEventType): 1<br /> Expected (int(QEvent::User)): 1000 | ||
==tst_QTouchEvent== | == tst_QTouchEvent == | ||
4 pass<br /> 8 fail | 4 pass<br />8 fail | ||
Failures:<br /> touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): | Failures:<br />touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. ()<br />touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. ()<br />touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. ()<br />basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. ()<br />multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. ()<br />multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. ()<br />deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. ()<br />deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. () | ||
==tst_QCssParser== | == tst_QCssParser == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> scanner (): fail Unknown file | Failures:<br />scanner (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error. | ||
==tst_QFont== | == tst_QFont == | ||
11 pass<br /> 5 fail | 11 pass<br />5 fail | ||
Failures:<br /> defaultFamily (serif): fail tst_qfont.cpp(679): | Failures:<br />defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. ()<br />(and other identical test failures) | ||
==tst_QFontCache== | == tst_QFontCache == | ||
2 pass<br /> 1 fail | 2 pass<br />1 fail | ||
Failures:<br /> clear (): fail tst_qfontcache.cpp(107): | Failures:<br />clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. () | ||
==tst_QFontDatabase== | == tst_QFontDatabase == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qfontdatabase.cpp(97): | Failures:<br />initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. () | ||
==tst_QFontMetrics== | == tst_QFontMetrics == | ||
12 pass<br /> 2 fail | 12 pass<br />2 fail | ||
Failures:<br /> elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)): Expected (text1_el) : s…<br /> (and other identical test failures) | Failures:<br />elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same<br /> Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)):<br /> Expected (text1_el) : s…<br />(and other identical test failures) | ||
==tst_QGlyphRun== | == tst_QGlyphRun == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qglyphrun.cpp(98): | Failures:<br />initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. () | ||
==tst_QRawFont== | == tst_QRawFont == | ||
1257 pass<br /> 1 fail | 1257 pass<br />1 fail | ||
Failures:<br /> advances (Full hinting): fail tst_qrawfont.cpp(325): | Failures:<br />advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. () | ||
==tst_QStaticText== | == tst_QStaticText == | ||
25 pass<br /> 2 fail | 25 pass<br />2 fail | ||
Failures:<br /> rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same<br /> transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same | Failures:<br />rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same<br />transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same | ||
==tst_QTextLayout== | == tst_QTextLayout == | ||
121 pass<br /> 1 fail | 121 pass<br />1 fail | ||
Failures:<br /> columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): | Failures:<br />columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. () | ||
==tst_QTextScriptEngine== | == tst_QTextScriptEngine == | ||
8 pass<br /> 1 fail | 8 pass<br />1 fail | ||
Failures:<br /> thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same Expected (ushort(1)) : 1 | Failures:<br />thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same<br /> Actual (logClusters[17]): 0<br /> Expected (ushort(1)) : 1 | ||
==tst_QFtp== | == tst_QFtp == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qftp.cpp(212): | Failures:<br />initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QHttpNetworkConnection== | == tst_QHttpNetworkConnection == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): | Failures:<br />initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QNetworkCookieJar== | == tst_QNetworkCookieJar == | ||
113 pass<br /> 2 fail | 113 pass<br />2 fail | ||
Failures:<br /> rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): | Failures:<br />rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. ()<br />rfc6265 (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error. | ||
==tst_QNetworkSession== | == tst_QNetworkSession == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qnetworksession.cpp(128): | Failures:<br />initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.) | ||
==tst_QDnsLookup== | == tst_QDnsLookup == | ||
18 pass<br /> 62 fail | 18 pass<br />62 fail | ||
Failures:<br /> lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): | Failures:<br />lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android)<br />lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same<br /> Actual (int(lookup.error())) : 1<br /> Expected (int(QDnsLookup::NoError)): 0<br />lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same<br /> Actual (int(lookup.error())) : 1<br /> Expected (int(QDnsLookup::NoError)): 0<br />(and other identical test failures) | ||
==tst_QHostInfo== | == tst_QHostInfo == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qhostinfo.cpp(191): | Failures:<br />initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_PlatformSocketEngine== | == tst_PlatformSocketEngine == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_platformsocketengine.cpp(110): | Failures:<br />initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QHttpSocketEngine== | == tst_QHttpSocketEngine == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qhttpsocketengine.cpp(152): | Failures:<br />initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QLocalSocket== | == tst_QLocalSocket == | ||
52 pass<br /> 5 fail | 52 pass<br />5 fail | ||
Failures:<br /> fullPath (): fail ../tst_qlocalsocket.cpp(645): | Failures:<br />fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error)<br />processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. ()<br />(and other identical test failures) | ||
==tst_QSocks5SocketEngine== | == tst_QSocks5SocketEngine == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qsocks5socketengine.cpp(181): | Failures:<br />initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QSslSocket== | == tst_QSslSocket == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qsslsocket.cpp(272): | Failures:<br />initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QSslSocket_onDemandCertificates_member== | == tst_QSslSocket_onDemandCertificates_member == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): | Failures:<br />initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
==tst_QSslSocket_onDemandCertificates_static== | == tst_QSslSocket_onDemandCertificates_static == | ||
1 pass<br /> 1 fail | 1 pass<br />1 fail | ||
Failures:<br /> initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): | Failures:<br />initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. () | ||
Revision as of 09:54, 24 February 2015
h1. Qt 5 for Android project - Autotests
The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4.
The following patches were applied:
https://codereview.qt.io/#change,62497
https://codereview.qt.io/#change,62455
Please note that a few tests crashed and some did not build properly. These are missing from the report.
Total statistics
17262 pass
203 fail
tst_QRand
2 pass
1 fail
Failures:
testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. ()
tst_QDir
185 pass
31 fail
Failures:
entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4
Expected (expected.count()): 7
entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1
Expected (expected.count()): 3
entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 3
Expected (expected.count()): 4
entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1
Expected (expected.count()): 2
entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4
Expected (expected.count()): 5
entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 2
Expected (expected.count()): 3
entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0
Expected (expected.count()): 1
entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : directory
Expected (expected[i]): brokenlink.lnk
entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : ..
Expected (expected[i]): .
entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0
Expected (expected.count()): 2
entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : file
Expected (expected[i]): writable
mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. ()
mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. ()
rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. ()
rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. ()
equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same
Actual ((dir1 == dir2)): 0
Expected (expected) : 1
cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. ()
(and other identical test failures)
tst_QDirIterator
16 pass
7 fail
Failures:
iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '4'
Expected (sortedEntries) size: '7'
iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '3'
Expected (sortedEntries) size: '6'
iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2'
Expected (sortedEntries) size: '5'
iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '7'
Expected (sortedEntries) size: '10'
iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2'
Expected (sortedEntries) size: '4'
(and other identical test failures)
tst_QFileInfo
150 pass
3 fail
Failures:
fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. ()
(and other identical test failures)
tst_QFileSystemWatcher
19 pass
2 fail
Failures:
addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'
removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'
tst_QResourceEngine
0 pass
2 fail
Failures:
initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()
cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()
tst_QMetaType
580 pass
33 fail
Failures:
flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 7
Expected (flags) : 0
flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 3
Expected (flags) : 0
saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same
Actual (QMetaType::save(stream, type, value)): 1
Expected (isStreamable) : 0
(and other identical test failures)
tst_QTranslator
10 pass
1 fail
Failures:
dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. ()
tst_QUuid
1 pass
1 fail
Failures:
initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to )
tst_QThread
10 pass
1 fail
Failures:
terminate (): fail Unknown file&#40;0&#41;: Received a fatal error.
tst_QThread
10 pass
1 fail
Failures:
terminate (): fail Unknown file&#40;0&#41;: Received a fatal error.
tst_QThread
10 pass
1 fail
Failures:
terminate (): fail Unknown file&#40;0&#41;: Received a fatal error.
tst_QImageWriter
81 pass
14 fail
Failures:
writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. ()
saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable)
(and other identical test failures)
tst_QEventDispatcher
3 pass
2 fail
Failures:
registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same
Actual (receivedEventType) : –1
Expected (int(QEvent::Timer)): 1
sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same
Actual (receivedEventType): 1
Expected (int(QEvent::User)): 1000
tst_QTouchEvent
4 pass
8 fail
Failures:
touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. ()
touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. ()
touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. ()
basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. ()
multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. ()
multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. ()
deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. ()
deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. ()
tst_QCssParser
1 pass
1 fail
Failures:
scanner (): fail Unknown file&#40;0&#41;: Received a fatal error.
tst_QFont
11 pass
5 fail
Failures:
defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. ()
(and other identical test failures)
tst_QFontCache
2 pass
1 fail
Failures:
clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. ()
tst_QFontDatabase
1 pass
1 fail
Failures:
initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. ()
tst_QFontMetrics
12 pass
2 fail
Failures:
elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same
Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)):
Expected (text1_el) : s…
(and other identical test failures)
tst_QGlyphRun
1 pass
1 fail
Failures:
initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. ()
tst_QRawFont
1257 pass
1 fail
Failures:
advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. ()
tst_QStaticText
25 pass
2 fail
Failures:
rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same
transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same
tst_QTextLayout
121 pass
1 fail
Failures:
columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. ()
tst_QTextScriptEngine
8 pass
1 fail
Failures:
thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same
Actual (logClusters[17]): 0
Expected (ushort(1)) : 1
tst_QFtp
1 pass
1 fail
Failures:
initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QHttpNetworkConnection
1 pass
1 fail
Failures:
initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QNetworkCookieJar
113 pass
2 fail
Failures:
rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. ()
rfc6265 (): fail Unknown file&#40;0&#41;: Received a fatal error.
tst_QNetworkSession
1 pass
1 fail
Failures:
initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.)
tst_QDnsLookup
18 pass
62 fail
Failures:
lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android)
lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same
Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0
lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same
Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0
(and other identical test failures)
tst_QHostInfo
1 pass
1 fail
Failures:
initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_PlatformSocketEngine
1 pass
1 fail
Failures:
initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QHttpSocketEngine
1 pass
1 fail
Failures:
initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QLocalSocket
52 pass
5 fail
Failures:
fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error)
processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. ()
(and other identical test failures)
tst_QSocks5SocketEngine
1 pass
1 fail
Failures:
initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket
1 pass
1 fail
Failures:
initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket_onDemandCertificates_member
1 pass
1 fail
Failures:
initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket_onDemandCertificates_static
1 pass
1 fail
Failures:
initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()