Qt Creator ManualTests ToolsIntegration: Difference between revisions

From Qt Wiki
Jump to navigation Jump to search
No edit summary
(Add test using the fuzzing artifacts)
 
(11 intermediate revisions by 4 users not shown)
Line 1: Line 1:
[[Category:Tools::QtCreator::QualityAssurance]]
[[Category:Tools::QtCreator::QualityAssurance]]


= Qt Creator Manual Tests: Tools Integration =
{| class="wikitable"
|+ Widget Designer
! Test
! Result
! Annotation
|+
| Create a form class
|
|
|+
| Add a control like a button and do "Go to slot"
| automated
|
|+
| Change an object's name in the integration and check if autocompletion of it works
| automated
|
|}


{background:#009900}. |''. Widget Designer |''. Result |''. Annotation |<br />| Create a form class | | |<br />| Add a control like a button and do "Go to slot" | automated | |<br />| Change an object's name in the integration and check if autocompletion of it works | automated | |<br />{background:#009900}. |''. Help |''. Result |''. Annotation |<br />| Is context sensitive help working? | | |<br />| Title page of Qt Creator documentation shows right version information? | | |<br />| Are screenshots up to date? Check some of them. | | |<br />{background:#009900}. |''. Version Control (CVS/SVN/p4/git if installed) |''. Result |''. Annotation |<br />| Try checkout wizards | git automated | |<br />| Can display project status/logs | | |<br />| Can display diffs, doubleclick in diff jumps to code | | |<br />| When showing a diff, make sure that keyboard shortcuts can't change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down). | | |<br />| Can revert unstaged/uncommitted changes | | |<br />| Can display logs, click on change number shows description | | |<br />| Can display blame | | |<br />| Can submit | | |<br />{background:#009900}. |''. Wizards |''. Result |''. Annotation |<br />| Create various app types, play around with parameters (suffixes) | | |<br />| Check the library/Unit test wizards | | |<br />| Check custom wizard examples (share/qtcreator/templates/wizards) by renaming the xml-file (see "README.txt":https://qt.gitorious.org/qt-creator/qt-creator/source/share/qtcreator/templates/wizards/README.txt | | |<br />| Add classes, form classes check compilation | | |<br />{background:#009900}. |''. Codepaster |''. Result |''. Annotation |<br />| Check protocol PasteBin.com, especially 'list' functionality as that parses HTML |automated | |<br />{background:#009900}. |''. External Tools |''. Result |''. Annotation |<br />| Try Tools &amp;dash;> External &amp;dash;> Edit with vi/Notepad | | |<br />| Try Tools &amp;dash;> External &amp;dash;> Sort Selection | automated | |<br />| Set up a new External Tool for use in Creator and check if it works correctly | | |<br />| Drag a file from an external file manager and drop in into Creator. Creator should correclty display the file's contents. | | |<br />{background:#009900}. |''. Analyzing |''. Result |_. Annotation |
{| class="wikitable"
|+ Help
! Test
! Result
! Annotation
|+
| Is context sensitive help working?
|
|
|+
| Title page of Qt Creator documentation shows right version information?
|
|
|+
| Are screenshots up to date? Check some of them.
|
|
|}
 
{| class="wikitable"
|+ Version Control (CVS/SVN/p4/git if installed)
! Test
! Result
! Annotation
|+
| Try checkout wizards
| git automated
|
|+
| Can display project status/logs
|
|
|+
| Can display diffs, doubleclick in diff jumps to code
|
|
|+
| When showing a diff, make sure that keyboard shortcuts can't change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down).
|
|
|+
| Can revert unstaged/uncommitted changes
|
|
|+
| Can display logs, click on change number shows description
| git automated
|
|+
| Can display blame
|
|
|+
| Can submit
|
|
|}
 
{| class="wikitable"
|+ Wizards
! Test
! Result
! Annotation
|+
| Create various app types, play around with parameters (suffixes)
|
|
|+
| Create an Autotest project using the wizard. Add passing and failing tests. Run those and check that Creator reports the results correctly.
|
|
|+
| Add classes, form classes check compilation
|
|
|}
 
{| class="wikitable"
|+ Codepaster
! Test
! Result
! Annotation
|+
| Check protocol PasteBin.com, especially 'list' functionality as that parses HTML
|automated
|
|}
 
{| class="wikitable"
|+ External Tools
! Test
! Result
! Annotation
|+
| Try Tools -> External -> Text -> Edit with vi/Notepad
|
|
|+
| Try Edit -> Advanced -> Sort Selected Lines
| automated
|
|+
| Set up a new External Tool for use in Creator and check if it works correctly
|
|
|+
| Drag a file from an external file manager and drop in into Creator. Creator should correctly display the file's contents.
|
|
|}
 
{| class="wikitable"
|+ Analyzing
! Test
! Result
! Annotation
|+
| Try profiling C++, QML and analyzing Code. If you don’t know how, that’s part of the test. Check the docs. :-)
|
|
|}
 
{| class="wikitable"
|+ Error Handling
! Test
! Result
! Annotation
|+
| Try opening a couple of files from https://code.qt.io/cgit/qt/qtqa.git/tree/fuzzing/testcases in Qt Creator.
Most of those files are invalid, so error messages and controlled failures are acceptable. Crashes, freezes and similar losses of control are unacceptable.
|
|
|}

Latest revision as of 18:39, 9 June 2022


Widget Designer
Test Result Annotation
Create a form class
Add a control like a button and do "Go to slot" automated
Change an object's name in the integration and check if autocompletion of it works automated
Help
Test Result Annotation
Is context sensitive help working?
Title page of Qt Creator documentation shows right version information?
Are screenshots up to date? Check some of them.
Version Control (CVS/SVN/p4/git if installed)
Test Result Annotation
Try checkout wizards git automated
Can display project status/logs
Can display diffs, doubleclick in diff jumps to code
When showing a diff, make sure that keyboard shortcuts can't change this diff (Ctrl+Alt+up/down, Ctrl+Shift+up/down).
Can revert unstaged/uncommitted changes
Can display logs, click on change number shows description git automated
Can display blame
Can submit
Wizards
Test Result Annotation
Create various app types, play around with parameters (suffixes)
Create an Autotest project using the wizard. Add passing and failing tests. Run those and check that Creator reports the results correctly.
Add classes, form classes check compilation
Codepaster
Test Result Annotation
Check protocol PasteBin.com, especially 'list' functionality as that parses HTML automated
External Tools
Test Result Annotation
Try Tools -> External -> Text -> Edit with vi/Notepad
Try Edit -> Advanced -> Sort Selected Lines automated
Set up a new External Tool for use in Creator and check if it works correctly
Drag a file from an external file manager and drop in into Creator. Creator should correctly display the file's contents.
Analyzing
Test Result Annotation
Try profiling C++, QML and analyzing Code. If you don’t know how, that’s part of the test. Check the docs. :-)
Error Handling
Test Result Annotation
Try opening a couple of files from https://code.qt.io/cgit/qt/qtqa.git/tree/fuzzing/testcases in Qt Creator.

Most of those files are invalid, so error messages and controlled failures are acceptable. Crashes, freezes and similar losses of control are unacceptable.

Retrieved from "https://wiki.qt.io/index.php?title=Qt_Creator_ManualTests_ToolsIntegration&oldid=39517"