Qt5ForAndroidAutotests

From Qt Wiki
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.
This article may require cleanup to meet the Qt Wiki's quality standards. Reason: Auto-imported from ExpressionEngine.
Please improve this article if you can. Remove the {{cleanup}} tag and add this page to Updated pages list after it's clean.

Qt 5 for Android project - Autotests

The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4.

The following patches were applied: https://codereview.qt.io/#change,62497 https://codereview.qt.io/#change,62455

Please note that a few tests crashed and some did not build properly. These are missing from the report.

Total statistics

17262 pass 203 fail

tst_QRand

2 pass 1 fail

Failures: testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. ()

tst_QDir

185 pass 31 fail

Failures: entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 4
Expected (expected.count()): 7

entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 1
Expected (expected.count()): 3

entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 3
Expected (expected.count()): 4

entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 1
Expected (expected.count()): 2

entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 4
Expected (expected.count()): 5

entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 2
Expected (expected.count()): 3

entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 0
Expected (expected.count()): 1

entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : directory
Expected (expected[i]): brokenlink.lnk

entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : ..
Expected (expected[i]): .

entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 0
Expected (expected.count()): 2

entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : file
Expected (expected[i]): writable

mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. () mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. () rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. () rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. () equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same

Actual ((dir1 == dir2)): 0
Expected (expected) : 1

cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. () (and other identical test failures)

tst_QDirIterator

16 pass 7 fail

Failures: iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '4'
Expected (sortedEntries) size: '7'

iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '3'
Expected (sortedEntries) size: '6'

iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '2'
Expected (sortedEntries) size: '5'

iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '7'
Expected (sortedEntries) size: '10'

iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '2'
Expected (sortedEntries) size: '4'

(and other identical test failures)

tst_QFileInfo

150 pass 3 fail

Failures: fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. () (and other identical test failures)

tst_QFileSystemWatcher

19 pass 2 fail

Failures: addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.

Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'

removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.

Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'

tst_QResourceEngine

0 pass 2 fail

Failures: initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. () cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()

tst_QMetaType

580 pass 33 fail

Failures: flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same

Actual (quint32(QMetaType::typeFlags(id))): 7
Expected (flags) : 0

flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same

Actual (quint32(QMetaType::typeFlags(id))): 3
Expected (flags) : 0

saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same

Actual (QMetaType::save(stream, type, value)): 1
Expected (isStreamable) : 0

(and other identical test failures)

tst_QTranslator

10 pass 1 fail

Failures: dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. ()

tst_QUuid

1 pass 1 fail

Failures: initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to )

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QImageWriter

81 pass 14 fail

Failures: writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. () saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable) (and other identical test failures)

tst_QEventDispatcher

3 pass 2 fail

Failures: registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same

Actual (receivedEventType) : –1
Expected (int(QEvent::Timer)): 1

sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same

Actual (receivedEventType): 1
Expected (int(QEvent::User)): 1000

tst_QTouchEvent

4 pass 8 fail

Failures: touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. () touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. () touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. () basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. () deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. () deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. ()

tst_QCssParser

1 pass 1 fail

Failures: scanner (): fail Unknown file(0): Received a fatal error.

tst_QFont

11 pass 5 fail

Failures: defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. () (and other identical test failures)

tst_QFontCache

2 pass 1 fail

Failures: clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. ()

tst_QFontDatabase

1 pass 1 fail

Failures: initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. ()

tst_QFontMetrics

12 pass 2 fail

Failures: elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same

Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)):
Expected (text1_el) : s…

(and other identical test failures)

tst_QGlyphRun

1 pass 1 fail

Failures: initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. ()

tst_QRawFont

1257 pass 1 fail

Failures: advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. ()

tst_QStaticText

25 pass 2 fail

Failures: rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same

tst_QTextLayout

121 pass 1 fail

Failures: columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. ()

tst_QTextScriptEngine

8 pass 1 fail

Failures: thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same

Actual (logClusters[17]): 0
Expected (ushort(1)) : 1

tst_QFtp

1 pass 1 fail

Failures: initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpNetworkConnection

1 pass 1 fail

Failures: initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QNetworkCookieJar

113 pass 2 fail

Failures: rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. () rfc6265 (): fail Unknown file(0): Received a fatal error.

tst_QNetworkSession

1 pass 1 fail

Failures: initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.)

tst_QDnsLookup

18 pass 62 fail

Failures: lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android) lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same

Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0

lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same

Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0

(and other identical test failures)

tst_QHostInfo

1 pass 1 fail

Failures: initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_PlatformSocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpSocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QLocalSocket

52 pass 5 fail

Failures: fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error) processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. () (and other identical test failures)

tst_QSocks5SocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_member

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_static

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()