Qt Creator ManualTests ToolsIntegration: Difference between revisions

From Qt Wiki
Jump to navigation Jump to search
No edit summary
 
(Add test using the fuzzing artifacts)
 
(13 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=Qt Creator Manual Tests: Tools Integration=
[[Category:Tools::QtCreator::QualityAssurance]]


{| class="infotable line"
{| class="wikitable"
|- style="background: #009900"
|+ Widget Designer
! Widget Designer
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Create a form class
| Create a form class
|
|
|
|
|-
|+
| Add a control like a button and do “Go to slot”
| Add a control like a button and do "Go to slot"
| automated
| automated
|
|
|-
|+
| Change an object’s name in the integration and check if autocompletion of it works
| Change an object's name in the integration and check if autocompletion of it works
| automated
| automated
|
|
|- style="background: #009900"
|}
! Help
 
{| class="wikitable"
|+ Help
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Is context sensitive help working?
| Is context sensitive help working?
|
|
|
|
|-
|+
| Title page of Qt Creator documentation shows right version information?
| Title page of Qt Creator documentation shows right version information?
|
|
|
|
|-
|+
| Are screenshots up to date? Check some of them.
| Are screenshots up to date? Check some of them.
|
|
|
|
|- style="background: #009900"
|}
! Version Control (<span class="caps">CVS</span>/SVN/p4/git if installed)
 
{| class="wikitable"
|+ Version Control (CVS/SVN/p4/git if installed)
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Try checkout wizards
| Try checkout wizards
| git automated
| git automated
|
|
|-
|+
| Can display project status/logs
| Can display project status/logs
|
|
|
|
|-
|+
| Can display diffs, doubleclick in diff jumps to code
| Can display diffs, doubleclick in diff jumps to code
|
|
|
|
|-
|+
| When showing a diff, make sure that keyboard shortcuts can’t change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down).
| When showing a diff, make sure that keyboard shortcuts can't change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down).
|
|
|
|
|-
|+
| Can revert unstaged/uncommitted changes
| Can revert unstaged/uncommitted changes
|
|
|
|
|-
|+
| Can display logs, click on change number shows description
| Can display logs, click on change number shows description
| git automated
|
|
|
|+
|-
| Can display blame
| Can display blame
|
|
|
|
|-
|+
| Can submit
| Can submit
|
|
|
|
|- style="background: #009900"
|}
! Wizards
 
{| class="wikitable"
|+ Wizards
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Create various app types, play around with parameters (suffixes)
| Create various app types, play around with parameters (suffixes)
|
|
|
|
|-
|+
| Check the library/Unit test wizards
| Create an Autotest project using the wizard. Add passing and failing tests. Run those and check that Creator reports the results correctly.
|
|
|-
|
|
Check custom wizard examples (share/qtcreator/templates/wizards) by renaming the xml-file (see [https://qt.gitorious.org/qt-creator/qt-creator/source/share/qtcreator/templates/wizards/README.txt <span class="caps">README</span>.txt] ''[qt.gitorious.org]''
|
|
|
|+
|-
| Add classes, form classes check compilation
| Add classes, form classes check compilation
|
|
|
|
|- style="background: #009900"
|}
! Codepaster
 
{| class="wikitable"
|+ Codepaster
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Check protocol PasteBin.com, especially ‘list’ functionality as that parses <span class="caps">HTML</span>
| Check protocol PasteBin.com, especially 'list' functionality as that parses HTML
| automated
|automated
|
|
|- style="background: #009900"
|}
! External Tools
 
{| class="wikitable"
|+ External Tools
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Try Tools &amp;dash;&gt; External &amp;dash;&gt; Edit with vi/Notepad
| Try Tools -> External -> Text -> Edit with vi/Notepad
|
|
|
|
|-
|+
| Try Tools &amp;dash;&gt; External &amp;dash;&gt; Sort Selection
| Try Edit -> Advanced -> Sort Selected Lines
| automated
| automated
|
|
|-
|+
| Set up a new External Tool for use in Creator and check if it works correctly
| Set up a new External Tool for use in Creator and check if it works correctly
|
|
|
|
|-
|+
| Drag a file from an external file manager and drop in into Creator. Creator should correclty display the file’s contents.
| Drag a file from an external file manager and drop in into Creator. Creator should correctly display the file's contents.
|
|
|
|
|- style="background: #009900"
|}
! Analyzing
 
{| class="wikitable"
|+ Analyzing
! Test
! Result
! Result
! Annotation
! Annotation
|-
|+
| Try profiling C++, <span class="caps">QML</span> and analyzing Code. If you don’t know how, that’s part of the test. Check the docs. <span class="smiley">:-)</span>
| Try profiling C++, QML and analyzing Code. If you don’t know how, that’s part of the test. Check the docs. :-)
|
|
|
|
|}
|}


===Categories:===
{| class="wikitable"
 
|+ Error Handling
* [[:Category:Tools|Tools]]
! Test
** [[:Category:Tools::QtCreator|QtCreator]]
! Result
* [[:Category:Tools::QtCreator::QualityAssurance|QualityAssurance]]
! Annotation
|+
| Try opening a couple of files from https://code.qt.io/cgit/qt/qtqa.git/tree/fuzzing/testcases in Qt Creator.
Most of those files are invalid, so error messages and controlled failures are acceptable. Crashes, freezes and similar losses of control are unacceptable.
|
|
|}

Latest revision as of 18:39, 9 June 2022


Widget Designer
Test Result Annotation
Create a form class
Add a control like a button and do "Go to slot" automated
Change an object's name in the integration and check if autocompletion of it works automated
Help
Test Result Annotation
Is context sensitive help working?
Title page of Qt Creator documentation shows right version information?
Are screenshots up to date? Check some of them.
Version Control (CVS/SVN/p4/git if installed)
Test Result Annotation
Try checkout wizards git automated
Can display project status/logs
Can display diffs, doubleclick in diff jumps to code
When showing a diff, make sure that keyboard shortcuts can't change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down).
Can revert unstaged/uncommitted changes
Can display logs, click on change number shows description git automated
Can display blame
Can submit
Wizards
Test Result Annotation
Create various app types, play around with parameters (suffixes)
Create an Autotest project using the wizard. Add passing and failing tests. Run those and check that Creator reports the results correctly.
Add classes, form classes check compilation
Codepaster
Test Result Annotation
Check protocol PasteBin.com, especially 'list' functionality as that parses HTML automated
External Tools
Test Result Annotation
Try Tools -> External -> Text -> Edit with vi/Notepad
Try Edit -> Advanced -> Sort Selected Lines automated
Set up a new External Tool for use in Creator and check if it works correctly
Drag a file from an external file manager and drop in into Creator. Creator should correctly display the file's contents.
Analyzing
Test Result Annotation
Try profiling C++, QML and analyzing Code. If you don’t know how, that’s part of the test. Check the docs. :-)
Error Handling
Test Result Annotation
Try opening a couple of files from https://code.qt.io/cgit/qt/qtqa.git/tree/fuzzing/testcases in Qt Creator.

Most of those files are invalid, so error messages and controlled failures are acceptable. Crashes, freezes and similar losses of control are unacceptable.

Retrieved from "https://wiki.qt.io/index.php?title=Qt_Creator_ManualTests_ToolsIntegration&oldid=39517"