Qt5ForAndroidAutotests
h1. Qt 5 for Android project - Autotests
The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4.
The following patches were applied: https://codereview.qt.io/#change,62497 https://codereview.qt.io/#change,62455
Please note that a few tests crashed and some did not build properly. These are missing from the report.
Total statistics
17262 pass 203 fail
tst_QRand
2 pass 1 fail
Failures: testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. ()
tst_QDir
185 pass 31 fail
Failures: entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4 Expected (expected.count()): 7
entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1 Expected (expected.count()): 3
entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 3 Expected (expected.count()): 4
entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1 Expected (expected.count()): 2
entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4 Expected (expected.count()): 5
entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 2 Expected (expected.count()): 3
entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0 Expected (expected.count()): 1
entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : directory Expected (expected[i]): brokenlink.lnk
entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : .. Expected (expected[i]): .
entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0 Expected (expected.count()): 2
entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : file Expected (expected[i]): writable
mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. () mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. () rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. () rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. () equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same
Actual ((dir1 == dir2)): 0 Expected (expected) : 1
cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. () (and other identical test failures)
tst_QDirIterator
16 pass 7 fail
Failures: iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '4' Expected (sortedEntries) size: '7'
iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '3' Expected (sortedEntries) size: '6'
iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2' Expected (sortedEntries) size: '5'
iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '7' Expected (sortedEntries) size: '10'
iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2' Expected (sortedEntries) size: '4'
(and other identical test failures)
tst_QFileInfo
150 pass 3 fail
Failures: fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. () (and other identical test failures)
tst_QFileSystemWatcher
19 pass 2 fail
Failures: addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1' Expected (QStringList()) size: '0'
removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1' Expected (QStringList()) size: '0'
tst_QResourceEngine
0 pass 2 fail
Failures: initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. () cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()
tst_QMetaType
580 pass 33 fail
Failures: flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 7 Expected (flags) : 0
flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 3 Expected (flags) : 0
saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same
Actual (QMetaType::save(stream, type, value)): 1 Expected (isStreamable) : 0
(and other identical test failures)
tst_QTranslator
10 pass 1 fail
Failures: dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. ()
tst_QUuid
1 pass 1 fail
Failures: initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to )
tst_QThread
10 pass 1 fail
Failures: terminate (): fail Unknown file(0): Received a fatal error.
tst_QThread
10 pass 1 fail
Failures: terminate (): fail Unknown file(0): Received a fatal error.
tst_QThread
10 pass 1 fail
Failures: terminate (): fail Unknown file(0): Received a fatal error.
tst_QImageWriter
81 pass 14 fail
Failures: writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. () saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable) (and other identical test failures)
tst_QEventDispatcher
3 pass 2 fail
Failures: registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same
Actual (receivedEventType) : –1 Expected (int(QEvent::Timer)): 1
sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same
Actual (receivedEventType): 1 Expected (int(QEvent::User)): 1000
tst_QTouchEvent
4 pass 8 fail
Failures: touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. () touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. () touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. () basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. () deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. () deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. ()
tst_QCssParser
1 pass 1 fail
Failures: scanner (): fail Unknown file(0): Received a fatal error.
tst_QFont
11 pass 5 fail
Failures: defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. () (and other identical test failures)
tst_QFontCache
2 pass 1 fail
Failures: clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. ()
tst_QFontDatabase
1 pass 1 fail
Failures: initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. ()
tst_QFontMetrics
12 pass 2 fail
Failures: elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same
Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)): Expected (text1_el) : s…
(and other identical test failures)
tst_QGlyphRun
1 pass 1 fail
Failures: initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. ()
tst_QRawFont
1257 pass 1 fail
Failures: advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. ()
tst_QStaticText
25 pass 2 fail
Failures: rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same
tst_QTextLayout
121 pass 1 fail
Failures: columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. ()
tst_QTextScriptEngine
8 pass 1 fail
Failures: thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same
Actual (logClusters[17]): 0 Expected (ushort(1)) : 1
tst_QFtp
1 pass 1 fail
Failures: initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QHttpNetworkConnection
1 pass 1 fail
Failures: initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QNetworkCookieJar
113 pass 2 fail
Failures: rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. () rfc6265 (): fail Unknown file(0): Received a fatal error.
tst_QNetworkSession
1 pass 1 fail
Failures: initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.)
tst_QDnsLookup
18 pass 62 fail
Failures: lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android) lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same
Actual (int(lookup.error())) : 1 Expected (int(QDnsLookup::NoError)): 0
lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same
Actual (int(lookup.error())) : 1 Expected (int(QDnsLookup::NoError)): 0
(and other identical test failures)
tst_QHostInfo
1 pass 1 fail
Failures: initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_PlatformSocketEngine
1 pass 1 fail
Failures: initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QHttpSocketEngine
1 pass 1 fail
Failures: initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QLocalSocket
52 pass 5 fail
Failures: fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error) processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. () (and other identical test failures)
tst_QSocks5SocketEngine
1 pass 1 fail
Failures: initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket
1 pass 1 fail
Failures: initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket_onDemandCertificates_member
1 pass 1 fail
Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()
tst_QSslSocket_onDemandCertificates_static
1 pass 1 fail
Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()