Qt5ForAndroidAutotests

h1. Qt 5 for Android project - Autotests

The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4.

The following patches were applied:
https://codereview.qt.io/#change,62497
https://codereview.qt.io/#change,62455

Please note that a few tests crashed and some did not build properly. These are missing from the report.

Total statistics

17262 pass
203 fail

tst_QRand

2 pass
1 fail

Failures:
testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. ()

tst_QDir

185 pass
31 fail

Failures:
entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4
Expected (expected.count()): 7
entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1
Expected (expected.count()): 3
entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 3
Expected (expected.count()): 4
entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 1
Expected (expected.count()): 2
entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 4
Expected (expected.count()): 5
entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 2
Expected (expected.count()): 3
entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0
Expected (expected.count()): 1
entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : directory
Expected (expected[i]): brokenlink.lnk
entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : ..
Expected (expected[i]): .
entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same
Actual (actual.count()) : 0
Expected (expected.count()): 2
entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same
Actual (actual[i]) : file
Expected (expected[i]): writable
mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. ()
mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. ()
rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. ()
rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. ()
equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same
Actual ((dir1 == dir2)): 0
Expected (expected) : 1
cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. ()
(and other identical test failures)

tst_QDirIterator

16 pass
7 fail

Failures:
iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '4'
Expected (sortedEntries) size: '7'
iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '3'
Expected (sortedEntries) size: '6'
iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2'
Expected (sortedEntries) size: '5'
iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '7'
Expected (sortedEntries) size: '10'
iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.
Actual (list) size: '2'
Expected (sortedEntries) size: '4'
(and other identical test failures)

tst_QFileInfo

150 pass
3 fail

Failures:
fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. ()
(and other identical test failures)

tst_QFileSystemWatcher

19 pass
2 fail

Failures:
addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'
removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.
Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'

tst_QResourceEngine

0 pass
2 fail

Failures:
initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()
cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()

tst_QMetaType

580 pass
33 fail

Failures:
flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 7
Expected (flags) : 0
flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same
Actual (quint32(QMetaType::typeFlags(id))): 3
Expected (flags) : 0
saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same
Actual (QMetaType::save(stream, type, value)): 1
Expected (isStreamable) : 0
(and other identical test failures)

tst_QTranslator

10 pass
1 fail

Failures:
dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. ()

tst_QUuid

1 pass
1 fail

Failures:
initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to )

tst_QThread

10 pass
1 fail

Failures:
terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass
1 fail

Failures:
terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass
1 fail

Failures:
terminate (): fail Unknown file(0): Received a fatal error.

tst_QImageWriter

81 pass
14 fail

Failures:
writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. ()
saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable)
(and other identical test failures)

tst_QEventDispatcher

3 pass
2 fail

Failures:
registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same
Actual (receivedEventType) : –1
Expected (int(QEvent::Timer)): 1
sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same
Actual (receivedEventType): 1
Expected (int(QEvent::User)): 1000

tst_QTouchEvent

4 pass
8 fail

Failures:
touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. ()
touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. ()
touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. ()
basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. ()
multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. ()
multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. ()
deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. ()
deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. ()

tst_QCssParser

1 pass
1 fail

Failures:
scanner (): fail Unknown file(0): Received a fatal error.

tst_QFont

11 pass
5 fail

Failures:
defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. ()
(and other identical test failures)

tst_QFontCache

2 pass
1 fail

Failures:
clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. ()

tst_QFontDatabase

1 pass
1 fail

Failures:
initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. ()

tst_QFontMetrics

12 pass
2 fail

Failures:
elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same
Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)):
Expected (text1_el) : s…
(and other identical test failures)

tst_QGlyphRun

1 pass
1 fail

Failures:
initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. ()

tst_QRawFont

1257 pass
1 fail

Failures:
advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. ()

tst_QStaticText

25 pass
2 fail

Failures:
rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same
transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same

tst_QTextLayout

121 pass
1 fail

Failures:
columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. ()

tst_QTextScriptEngine

8 pass
1 fail

Failures:
thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same
Actual (logClusters[17]): 0
Expected (ushort(1)) : 1

tst_QFtp

1 pass
1 fail

Failures:
initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpNetworkConnection

1 pass
1 fail

Failures:
initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QNetworkCookieJar

113 pass
2 fail

Failures:
rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. ()
rfc6265 (): fail Unknown file&amp;#40;0&amp;#41;: Received a fatal error.

tst_QNetworkSession

1 pass
1 fail

Failures:
initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.)

tst_QDnsLookup

18 pass
62 fail

Failures:
lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android)
lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same
Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0
lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same
Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0
(and other identical test failures)

tst_QHostInfo

1 pass
1 fail

Failures:
initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_PlatformSocketEngine

1 pass
1 fail

Failures:
initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpSocketEngine

1 pass
1 fail

Failures:
initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QLocalSocket

52 pass
5 fail

Failures:
fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error)
processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. ()
(and other identical test failures)

tst_QSocks5SocketEngine

1 pass
1 fail

Failures:
initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket

1 pass
1 fail

Failures:
initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_member

1 pass
1 fail

Failures:
initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_static

1 pass
1 fail

Failures:
initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()