Difference between revisions of "DeveloperWiki:releng testimages feedback"

From ArchWiki
Jump to: navigation, search
(first version of feedback app description)
 
(use https for links to archlinux.org)
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
 +
[[Category:Arch development]]
 
== Introduction to the Release Engineering testimages feedback application ==
 
== Introduction to the Release Engineering testimages feedback application ==
The Releng [http://www.archlinux.org/releng/feedback/ testimages feedback web application] allows anyone to submit feedback after attempting an installation using any of the [http://releng.archlinux.org/isos/ releng automatically generated images].
+
The Releng [https://www.archlinux.org/releng/feedback/ testimages feedback web application] allows anyone to submit feedback after attempting an installation using any of the [https://releng.archlinux.org/isos/ releng automatically generated images].
  
 
The idea is that users report successes and failures using these images, clearly mentioning the characteristics of the installation (used options, media used, etc).  By collecting all this information it is possible to generate an overview of the quality of recent images.
 
The idea is that users report successes and failures using these images, clearly mentioning the characteristics of the installation (used options, media used, etc).  By collecting all this information it is possible to generate an overview of the quality of recent images.
Line 8: Line 9:
  
 
== How to report ==
 
== How to report ==
* download an [http://releng.archlinux.org/isos/ releng automatic build].
+
* download an [https://releng.archlinux.org/isos/ releng automatic build].
 
* use it to (attempt to) perform an installation
 
* use it to (attempt to) perform an installation
* report the installation feedback on the [http://www.archlinux.org/releng/feedback/submit/ submission page], marking the options/features you used (all of them, even if some failed and some succeeded).
+
* report the installation feedback on the [https://www.archlinux.org/releng/feedback/submit/ submission page], marking the options/features you used (all of them, even if some failed and some succeeded).
* carefully inspect the resulting system to check it matches expectations. Specific pointers for things to check can appear for specific parts on the [http://www.archlinux.org/releng/feedback/submit/ feedback submission page], if anything failed during the installation, or something's wrong with the installed system, do '''not''' mark the "success" field.
+
* carefully inspect the resulting system to check it matches expectations. Specific pointers for things to check can appear for specific parts on the [https://www.archlinux.org/releng/feedback/submit/ feedback submission page], if anything failed during the installation, or something's wrong with the installed system, do '''not''' mark the "success" field.
 
* this application does not replace a bugtracker.  If you found specific bugs, search if a bug is filed already, and if not, file a new one. Don't forget to run /arch/report-issues.  you can link to the bugs in the comments field.
 
* this application does not replace a bugtracker.  If you found specific bugs, search if a bug is filed already, and if not, file a new one. Don't forget to run /arch/report-issues.  you can link to the bugs in the comments field.

Revision as of 00:37, 6 December 2012

Introduction to the Release Engineering testimages feedback application

The Releng testimages feedback web application allows anyone to submit feedback after attempting an installation using any of the releng automatically generated images.

The idea is that users report successes and failures using these images, clearly mentioning the characteristics of the installation (used options, media used, etc). By collecting all this information it is possible to generate an overview of the quality of recent images. When sufficient positive feedback is available (i.e. success reports for all options of the most recent image(s)) this is a sign for release engineers that an autobuild can be promoted to official media. By leveraging community feedback, less extra testing is needed, so it will cost less time to make new official releases and will hopefully increase the frequency of official releases. Of course, users should play nice and perform the testing and feedback steps properly, in order for this system to work properly. Either way, feedback will be reviewed and will not completely replace releng testing.

How to report

  • download an releng automatic build.
  • use it to (attempt to) perform an installation
  • report the installation feedback on the submission page, marking the options/features you used (all of them, even if some failed and some succeeded).
  • carefully inspect the resulting system to check it matches expectations. Specific pointers for things to check can appear for specific parts on the feedback submission page, if anything failed during the installation, or something's wrong with the installed system, do not mark the "success" field.
  • this application does not replace a bugtracker. If you found specific bugs, search if a bug is filed already, and if not, file a new one. Don't forget to run /arch/report-issues. you can link to the bugs in the comments field.