This is the backlog for Qt Metrics 2 site currently under development.
In case of proposals or improvement ideas please contact Juha Sippola (report builder, database) or Tony Sarajärvi (parser).
1. Data reliability and completeness (database and parser)
| Status |
Priority |
Item
|
| in progress |
*** |
Get the actual testset parent (not the Qt5 where it was run)
|
| idle |
*** |
Change build_number (int) to build_key (string) for the new-CI
|
| idle |
** |
Get testfunctions from xml
|
| idle |
** |
Get testrows from xml
|
| idle |
** |
Database indexing (for performance)
|
| idle |
** |
OS grouping (currently platform.os has quite many values, should we group e.g. all windows platforms into one on home page)
|
| idle |
** |
Change testset_run.testcases_xxx to total_xxx (terminology change)
|
2. Pages and views
| Status |
Priority |
Item
|
| in progress |
*** |
Home page modifications (enable buttons)
|
| idle |
** |
Summary graph
|
| idle |
*** |
Overview page
|
| idle |
*** |
Project page
|
| idle |
*** |
Project page: Link to log file
|
| idle |
** |
Project page: Way to expand the range of builds, include dates to listed builds
|
| idle |
*** |
Platform page
|
| idle |
*** |
Platform page: Link to log file
|
| idle |
** |
Platform page: OS grouping
|
| idle |
** |
Platform page: Configuration flag identification
|
| idle |
* |
Platform page: Identification of configurations where insignificant or force success could be removed
|
| idle |
* |
Platform page: Filtering mechanism
|
| idle |
* |
Branch page
|
| done |
*** |
Top failing testsets page
|
| done |
*** |
Top flaky testsets page
|
| in progress |
*** |
Testset page
|
| idle |
*** |
Testset page: Link to log file
|
| idle |
*** |
Testset page: Testset flag identification
|
| idle |
** |
Testset page: Testset run times
|
| idle |
* |
Testset page: Filtering mechanism
|
| idle |
* |
Testset page: Identification of testsets where insignificant could be removed
|
| idle |
*** |
Testfunction page/information
|
| idle |
*** |
Testfunction page/information: Testfunction flag identification
|
| idle |
** |
Testfunction page/information: Identification of testfunctions where blacklisting could be removed
|
| idle |
** |
Testfunction page/information: Link to xml file
|
| idle |
* |
Testfunction page/information: Find skipped testfunctions
|
| idle |
*** |
Testrow page/information
|
| idle |
** |
Top failed testfunctions page
|
| idle |
Example |
Example
|
3. Graphs
| Status |
Priority |
Item
|
| idle |
** |
Build phases by configuration (like in the old metrics page)
|
| idle |
* |
Build phases by configuration: Tick box to select if idle times are included or not in the Build phases graph
|
| idle |
* |
Build phases by configuration: Configuration result to the Build phases graph (e.g. to conf title)
|
| idle |
* |
Build phases by configuration: Add tooltips into Build phases graph (e.g phase name and value)
|
| idle |
* |
Visualize CI performance via testset execution time (to visualize sequential and parallel runs)
|
| idle |
* |
Visualize CI performance via the trend of phase duration (one, or several if feasible) across the last 20 builds in selected Project Configuration
|
| idle |
* |
Improvement progress trend graphs, e.g. on build success rates, build execution times, Configuration and Autotest force success and insignificant flag removals.
|
4. Other features
| Status |
Priority |
Item
|
| idle |
*** |
Web security
|
| idle |
** |
Utilise Ajax for better user experience
|
| idle |
* |
Progress bar when loading page or data
|
| idle |
* |
Link(s) to other related Qt Metrics
|
| idle |
* |
Associate gerrit change ids with builds
|
| idle |
* |
Include the bug id’s for test cases. This requires first a database or other solution where to get the data.
|
| idle |
* |
Log file parsing helper (a way to find things in the last n logs)
|
| idle |
* |
Register to receive error reports to a certain module (plus unregister)
|
| idle |
* |
Report generator to create a detailed text & graph report from a view. This would be applicable for such data that takes long time to extract and format.
|
| idle |
* |
Data export to excel/pdf from a view
|
| idle |
* |
Identify which CI build machines failed most often and which CI builds take the longest time to execute
|
| idle |
* |
Add Google Analytics to get information on the portal usage
|
| idle |
* |
Support for https
|
5. Documentation
| Status |
Priority |
Item
|
| idle |
** |
Implementation solution description
|
| in progress |
** |
Database design
|
| in progress |
* |
Class documentation
|