QDoc Regression Testing: Difference between revisions

From Qt Wiki
Jump to navigation Jump to search
No edit summary
(It's about documentation)
 
(7 intermediate revisions by 4 users not shown)
Line 1: Line 1:
h1.QDoc Regression Testing
[[Category:Developing Qt::Documentation]]
 
{{LangSwitch}}
This page outlines a list of pages and functionalities that must be tested<br />for every commit to QDoc. Not all of the items in the list applies and it is<br />up to the commit author and reviewer to decide which test is relevant.
This page outlines a list of pages and functionalities that must be tested
for every commit to QDoc. Not all of the items in the list applies and it is
up to the commit author and reviewer to decide which test is relevant.


== Essential Testing Strategy ==
== Essential Testing Strategy ==
Line 7: Line 9:
This is a list of tests. Testing these pages should be enough to cover most cases.
This is a list of tests. Testing these pages should be enough to cover most cases.


1. Compile Code<br />2. Look at index.html<br />3. Look at the Modules page for links to all essentials and add-ons<br />4. Look at All Classes<br />5. Look at All QML Types<br />6. Look at qtdoc-&gt;qtdoc links<br />7. Look at qtbase-&gt;qtbase links<br />8. Look at new module-&gt;new module links (qtsensors to qtsensors, for example)<br />9. Look at the &quot;5.2&amp;quot; navigation bar<br />10. Look at Creator docs or another non-Qt 5 docs<br />11. More pages which show obscure edge cases
# Compile Code
# Look at index.html
# Look at the Modules page for links to all essentials and add-ons
# Look at All Classes
# Look at All QML Types
# Look at qtdoc->qtdoc links
# Look at qtbase->qtbase links
# Look at new module->new module links (qtsensors to qtsensors, for example)
# Look at the "5.2" navigation bar
# Look at Creator docs or another non-Qt 5 docs
# More pages which show obscure edge cases
 
QML Cases:
 
* Item (C++ page, QML type)
* Button (QML page, QML type)
* Audio, Sensor, Positioning, other QML types that is outside of qtdeclarative.
* also possible to test Charts, B2Qt, and Enterprise Controls
There is a separate C++ and QML parser, so these need special attention


QML Cases:<br />a)Item (C++ page, QML type)<br />b)Button (QML page, QML type)<br />c)Audio, Sensor, Positioning, other QML types that is outside of qtdeclarative.<br />d)also possible to test Charts, B2Qt, and Enterprise Controls<br />There is a separate C++ and QML parser, so these need special attention
C++ Cases:


C++ Cases:<br />a)QObject (the inheritance)<br />b)another class in qtbase (Qt SQL and Qt Network are stable and easy to check)<br />c)qtdeclarative<br />d)new module C++ classes<br />Check the Properties, Functions, grouped properties, inheritance tree. Lots of regression in these areas (missing info, wrong links, and so on).
* QObject (the inheritance)
* another class in qtbase (Qt SQL and Qt Network are stable and easy to check)
* qtdeclarative
* new module C++ classes
Check the Properties, Functions, grouped properties, inheritance tree. Lots of regression in these areas (missing info, wrong links, and so on).


These cover most of the cases. All do-able for within minutes of clicking around.<br />Check for past regressions (though not all the time).
These cover most of the cases. All do-able for within minutes of clicking around.
Check for past regressions (though not all the time).


== Specific pages: ==
== Specific pages: ==
Line 19: Line 44:
=== index.html (Qt 5 main page) ===
=== index.html (Qt 5 main page) ===


1. check for the &quot;Qt Creator&amp;quot; link (link)<br />2. check for the &quot;Multimedia&amp;quot; link (qtdoc-&gt;qtmultimedia link)<br />3. check the list of overviews<br />4. check title and the navigation bar and build version
# check for the "Qt Creator" link (link)
 
# check for the "Multimedia" link (qtdoc->qtmultimedia link)
=== &quot;All Classes&amp;quot; - classes.html ===
# check the list of overviews
# check title and the navigation bar and build version


1.check for new classes such as:<br />'''''' QGeoCoordinate (5.2)<br />'''''' QSerialPort (5.1)
=== "All Classes" - classes.html ===


2. check for older or special classes:<br />'''''' QString (sanity check)<br />'''''' QQuickWindow (instantiated by a QML type)
# check for new classes such as:
#* QGeoCoordinate (5.2)
#* QSerialPort (5.1)
# check for older or special classes:
#* QString (sanity check)
#* QQuickWindow (instantiated by a QML type)
# check that A...Z list at the top is correct


3. check that A…Z list at the top is correct
=== "All Modules" - qtmodules.html ===


=== &quot;All Modules&amp;quot; - qtmodules.html ===
# check for special modules:
#* ActiveQt (Windows-only but should be built)
#* Qt WebKit (many previous build problems)
#* Qt Bluetooth (new Add-On)
# links to the modules should be active


1. check for special modules:<br />'''''' ActiveQt (Windows-only but should be built)<br />'''''' Qt WebKit (many previous build problems)<br />'''''' Qt Bluetooth (new Add-On)
=== "All QML Types" - qmltypes.html ===


2. links to the modules should be active
# check for new types such as:
#* Position (5.2)
#* JumpList (5.2)
# check for older types such as:
#* Item or Window
#* Button
# check that the A...Z list at the top is correct


=== &quot;All QML Types&amp;quot; - qmltypes.html ===
=== "All QML APIs by Module" - modules-qml.html ===


1. check for new types such as:<br />'''''' Position (5.2)<br />'''''' JumpList (5.2)
# check that the list is correct
#* most modules should be there
#* brief and annotated information
#* title


2. check for older types such as:<br />'''''' Item or Window<br />'''''' Button
=== "All Classes by Module" - modules-cpp.html ===


3. check that the A…Z list at the top is correct
# check that the list is correct
#* most modules should be there
#* brief and annotated information
#* title


=== &quot;All QML APIs by Module&amp;quot; - modules-qml.html ===
=== "Item" - qml-qtquick-item.html ===


1. check that the list is correct<br />'''''' most modules should be there<br />'''''' brief and annotated information<br />'''''' title
# HTML filename should be qml-<qmlmodule>-<type>.html
# check required information:
#* import statement (same as )
#* instantiates (QQuickItem)
#* inherits: (QtObject)
#* inherited-by: should be reasonably populated
#* clicking on the inherited, instantiated, and other links should work
# check Properties section
#* "anchors" is a group and has the members in a sub-list
#* clicking on a property works
# check Methods section
#* should look okay
#* "Detailed Description" should look okay:
#* snippets and images look okay
#* "See also" is okay
#* general markup is okay
#* property and method signatures look okay
#* readable and links to the basic type
#* should follow writing guidelines (not necessary for regression testing)


=== &quot;All Classes by Module&amp;quot; - modules-cpp.html ===
=== "Button"- qml-qtquick-controls-button.html ===


1. check that the list is correct<br />'''''' most modules should be there<br />'''''' brief and annotated information<br />'''''' title
# HTML filename should be correct
# check required information:
#* (see "Item")
#* clicking on inherited-by and inherits should go to the type
# check the "List of All Members" page
#* doesn't list private classes and private types


=== &quot;Item&amp;quot; - qml-qtquick-item.html ===
=== "QSensor Class" - qsensor.html ===


1. HTML filename should be qml-&lt;qmlmodule&amp;gt;<s>&lt;type&amp;gt;.html<br />2. check required information:<br />'''''' import statement (same as )<br />'''''' instantiates (QQuickItem)<br />'''''' inherits: (QtObject)<br />'''''' inherited-by: should be reasonably populated<br />'''''' clicking on the inherited, instantiated, and other links should work
# HTML filename should be correct <classname>.html
<br />3. check Properties section<br />'''''' &quot;anchors&amp;quot; is a group and has the members in a sub-list<br />'''''' clicking on a property works
# check required information:
<br />4. check Methods section<br />'''''' should look okay<br />'''''' &quot;Detailed Description&amp;quot; should look okay:<br />'''''' snippets and images look okay<br />'''''' &quot;See also&amp;quot; is okay<br />'''''' general markup is okay<br />'''''' property and method signatures look okay<br />'''''' readable and links to the basic type<br />'''''' should follow writing guidelines (not necessary for regression testing)
#* QObject link should work (qtsensors->qtcore link)
<br />h3. &quot;Button&amp;quot;</s> qml-qtquick-controls-button.html
#* links to the inherited-by should work (qtsensors->qtsensors link)
#* the fields look okay
# check Public Types, Properties, functions, and so on.
#* links should go to the same page
#* return types should be a working link
# check the "List of All Members for QSensor" page
#* should look okay


1. HTML filename should be correct<br />2. check required information:<br />'''''' (see &quot;Item&amp;quot;)<br />'''''' clicking on inherited-by and inherits should go to the type
=== "Qt Positioning QML Types" - qtpositioning-qmlmodule.html ===


3. check the &quot;List of All Members&amp;quot; page<br />'''''' doesn't list private classes and private types
# check that the module page lists the QML types
#* title and HTML filename are okay
#* it has QML basic types
#* QML basic type documentation is broken at the moment


=== &quot;QSensor Class&amp;quot; - qsensor.html ===
=== "Qt Core C++ Classes" - qtcore-module.html ===


1. HTML filename should be correct &lt;classname&amp;gt;.html<br />2. check required information:<br />'''''' QObject link should work (qtsensors-&gt;qtcore link)<br />'''''' links to the inherited-by should work (qtsensors-&gt;qtsensors link)<br />'''''' the fields look okay
# check that the module page
#* lists the C++ classes and namespace
#* title and HTML filename are correct


3. check Public Types, Properties, functions, and so on.<br />'''''' links should go to the same page<br />'''''' return types should be a working link
=== "Bluetooth Tennis Example" - qtbluetooth-bttennis-example.html ===


4. check the &quot;List of All Members for QSensor&amp;quot; page<br />'''''' should look okay
# any other example page is okay too
 
# check that the files are listed
=== &quot;Qt Positioning QML Types&amp;quot; - qtpositioning-qmlmodule.html ===
#* title and HTML filename are okay
 
1. check that the module page lists the QML types<br />'''''' title and HTML filename are okay<br />'''''' it has QML basic types<br />'''''' QML basic type documentation is broken at the moment
 
=== &quot;Qt Core C++ Classes&amp;quot; - qtcore-module.html ===
 
1. check that the module page<br />'''''' lists the C++ classes and namespace<br />'''''' title and HTML filename are correct
 
=== &quot;Bluetooth Tennis Example&amp;quot; - qtbluetooth-bttennis-example.html ===
 
'''''' any other example page is okay too<br />1. check that the files are listed<br />'''''' title and HTML filename are okay


=== Miscellaneous Pages and Tests ===
=== Miscellaneous Pages and Tests ===


1. check for basic style issues:<br />'''''' footer and header(should be in every page)<br />'''''' HTML title should be correct (QSensors Class | QtSensors 5.2 - Mozilla Firefox)
# check for basic style issues:
 
#* footer and header(should be in every page)
1. check &quot;Synchronizing Threads&amp;quot; (threads-synchronizing.html) page for the &quot;next&amp;quot; and &quot;previous&amp;quot; links
#* HTML title should be correct (QSensors Class | QtSensors 5.2 - Mozilla Firefox)
# check "Synchronizing Threads" (threads-synchronizing.html) page for the "next" and "previous" links
#* or check Qt Creator Manual

Latest revision as of 16:10, 25 November 2016

En Ar Bg De El Es Fa Fi Fr Hi Hu It Ja Kn Ko Ms Nl Pl Pt Ru Sq Th Tr Uk Zh

This page outlines a list of pages and functionalities that must be tested for every commit to QDoc. Not all of the items in the list applies and it is up to the commit author and reviewer to decide which test is relevant.

Essential Testing Strategy

This is a list of tests. Testing these pages should be enough to cover most cases.

  1. Compile Code
  2. Look at index.html
  3. Look at the Modules page for links to all essentials and add-ons
  4. Look at All Classes
  5. Look at All QML Types
  6. Look at qtdoc->qtdoc links
  7. Look at qtbase->qtbase links
  8. Look at new module->new module links (qtsensors to qtsensors, for example)
  9. Look at the "5.2" navigation bar
  10. Look at Creator docs or another non-Qt 5 docs
  11. More pages which show obscure edge cases

QML Cases:

  • Item (C++ page, QML type)
  • Button (QML page, QML type)
  • Audio, Sensor, Positioning, other QML types that is outside of qtdeclarative.
  • also possible to test Charts, B2Qt, and Enterprise Controls

There is a separate C++ and QML parser, so these need special attention

C++ Cases:

  • QObject (the inheritance)
  • another class in qtbase (Qt SQL and Qt Network are stable and easy to check)
  • qtdeclarative
  • new module C++ classes

Check the Properties, Functions, grouped properties, inheritance tree. Lots of regression in these areas (missing info, wrong links, and so on).

These cover most of the cases. All do-able for within minutes of clicking around. Check for past regressions (though not all the time).

Specific pages:

index.html (Qt 5 main page)

  1. check for the "Qt Creator" link (link)
  2. check for the "Multimedia" link (qtdoc->qtmultimedia link)
  3. check the list of overviews
  4. check title and the navigation bar and build version

"All Classes" - classes.html

  1. check for new classes such as:
    • QGeoCoordinate (5.2)
    • QSerialPort (5.1)
  2. check for older or special classes:
    • QString (sanity check)
    • QQuickWindow (instantiated by a QML type)
  3. check that A...Z list at the top is correct

"All Modules" - qtmodules.html

  1. check for special modules:
    • ActiveQt (Windows-only but should be built)
    • Qt WebKit (many previous build problems)
    • Qt Bluetooth (new Add-On)
  2. links to the modules should be active

"All QML Types" - qmltypes.html

  1. check for new types such as:
    • Position (5.2)
    • JumpList (5.2)
  2. check for older types such as:
    • Item or Window
    • Button
  3. check that the A...Z list at the top is correct

"All QML APIs by Module" - modules-qml.html

  1. check that the list is correct
    • most modules should be there
    • brief and annotated information
    • title

"All Classes by Module" - modules-cpp.html

  1. check that the list is correct
    • most modules should be there
    • brief and annotated information
    • title

"Item" - qml-qtquick-item.html

  1. HTML filename should be qml-<qmlmodule>-<type>.html
  2. check required information:
    • import statement (same as )
    • instantiates (QQuickItem)
    • inherits: (QtObject)
    • inherited-by: should be reasonably populated
    • clicking on the inherited, instantiated, and other links should work
  3. check Properties section
    • "anchors" is a group and has the members in a sub-list
    • clicking on a property works
  4. check Methods section
    • should look okay
    • "Detailed Description" should look okay:
    • snippets and images look okay
    • "See also" is okay
    • general markup is okay
    • property and method signatures look okay
    • readable and links to the basic type
    • should follow writing guidelines (not necessary for regression testing)

"Button"- qml-qtquick-controls-button.html

  1. HTML filename should be correct
  2. check required information:
    • (see "Item")
    • clicking on inherited-by and inherits should go to the type
  3. check the "List of All Members" page
    • doesn't list private classes and private types

"QSensor Class" - qsensor.html

  1. HTML filename should be correct <classname>.html
  2. check required information:
    • QObject link should work (qtsensors->qtcore link)
    • links to the inherited-by should work (qtsensors->qtsensors link)
    • the fields look okay
  3. check Public Types, Properties, functions, and so on.
    • links should go to the same page
    • return types should be a working link
  4. check the "List of All Members for QSensor" page
    • should look okay

"Qt Positioning QML Types" - qtpositioning-qmlmodule.html

  1. check that the module page lists the QML types
    • title and HTML filename are okay
    • it has QML basic types
    • QML basic type documentation is broken at the moment

"Qt Core C++ Classes" - qtcore-module.html

  1. check that the module page
    • lists the C++ classes and namespace
    • title and HTML filename are correct

"Bluetooth Tennis Example" - qtbluetooth-bttennis-example.html

  1. any other example page is okay too
  2. check that the files are listed
    • title and HTML filename are okay

Miscellaneous Pages and Tests

  1. check for basic style issues:
    • footer and header(should be in every page)
    • HTML title should be correct (QSensors Class | QtSensors 5.2 - Mozilla Firefox)
  2. check "Synchronizing Threads" (threads-synchronizing.html) page for the "next" and "previous" links
    • or check Qt Creator Manual