Status for canonical-platform-qa

This page shows the progress for a team or person towards a particular target. The burndown gives you a sense of whether they are on track to complete all of their tasks at the current rate, and the information below shows their progress against individual Topics , blueprints and workitems.

Workitem burndown

(enlarge)

"foreign" counts refer to workitems that are assigned to someone not in the team

Burndown chart
Overall completion
92% of 115

Status of Topics

Topic Completion Priority Status/Description
topic-precise-kernel-essential
100% of 13
Essential All kernel features essential for this cycle.
topic-precise-release-lts
100% of 6
High LTS lifecycle related blueprint. Criteria used for dependency selection: - Release concerns ( schedule, images to produce) - Upgrade concerns ( LTS -> LTS, running applications) - Support concerns ( release quality, making it easier to support long term) - Stable Release Updates/Maintenance improvements (since this will become the new LTS)
topic-precise-release-management
100% of 1
High Improvements to the release processes and infrastructure.
topic-precise-community-developer-outreach
0% of 3
High Continued growth of the Ubuntu Developer Community.
topic-precise-release-sru
95% of 21
High Planning to improve stable release updates (kernel and other packages) in 12.04 (Precise Pangolin).

Status by blueprint

(Click header to sort)

Blueprint todo blocked inprogress postponed done Completion Priority Status/Description
other-p-qa-kernel-sru 0 0 0 1 12 100%
Implemented
Essential
other-p-builds-smoke-testing 0 0 0 3 30 100%
Implemented
Essential
other-p-qa-boot-speed-testing 0 0 0 0 11 100%
Implemented
Essential
foundations-p-lts-upgrades 0 0 0 0 6 100%
Good progress
Essential
other-p-qa-test-case-definition 0 0 0 0 1 100%
Implemented
Essential
other-p-qa-qa-regression-testing 0 0 0 4 5 100%
Implemented
High
other-p-qa-automated-test-submissions 0 0 0 0 3 100%
Implemented
High
other-p-qa-backlog 0 0 0 1 13 100%
Implemented
High
desktop-p-unity-quality 0 0 0 0 3 100%
Implemented
High
foundations-p-iso-tracker 0 0 0 1 0 100%
Beta Available
High
other-p-qa-standard-sru-testing 0 1 0 5 2 88%
Implemented
Essential
other-p-bugsquad-mentoring 0 0 1 0 2 67%
Started
Medium
other-p-qa-labsetup 0 0 4 1 2 43%
Implemented
Undefined
community-p-making-harvest-rock 3 0 0 0 0 0%
Not started
Low

Status by assignee

(Click header to sort)

Assignee todo blocked inprogress postponed done Completion
Aaron Albright 0 0 0 2 1 100%
Alex Lourie 0 0 0 0 1 100%
Brad Figg 0 0 0 0 1 100%
canonical-platform-qa 0 0 0 0 3 100%
Colin Watson 0 0 0 0 1 100%
Gema Gomez 0 0 0 2 14 100%
C de-Avillez 3 0 1 0 10 71%
Jean-Baptiste Lallement 0 0 0 5 16 100%
Kate Stewart 0 1 0 0 0 0%
Larry E Works 0 0 4 1 2 43%
nskaggs 0 0 0 0 1 100%
Max Brustkern 0 0 0 5 9 100%
Patrick Wright 0 0 0 0 20 100%
Steve Conklin 0 0 0 1 11 100%

Work item details

Assignee Status Blueprint Priority Work item
Aaron Albright done other-p-builds-smoke-testing Essential Come up with a list of test cases that need to be added to the daily ISO smoke testing
postponed other-p-builds-smoke-testing Essential Compile a list of applications that are installed by default by the ISO installers for Desktop and propose two or three basic test cases for each that could be run post install giving us basic confidence that the ISO is good for further testing
other-p-builds-smoke-testing Essential ISO static validation, write a script that validate the ISO and integrate it into Jenkins
Alex Lourie done other-p-qa-backlog High Review and update QA wiki with all the relevant content
Brad Figg done other-p-qa-kernel-sru Essential Create a test for the ecryptfs file system tests
canonical-platform-qa done other-p-builds-smoke-testing Essential Review the Documentation for troubleshooting with Jenkins and update accordingly
other-p-builds-smoke-testing Essential Start applying the new tags to bugs https://wiki.ubuntu.com/QATeam/AutomatedTesting/TestingTypeAndBugTracking
other-p-qa-backlog High Update/Improve the existing ISO test cases to make them more comprehensive
Colin Watson done other-p-builds-smoke-testing Essential Show QA where to get CD Image logs and LiveFS logs (build logs), so that they can report on unit tests run at build time (mailed to gema.gomez 2012-01-10)
Gema Gomez done other-p-builds-smoke-testing Essential Decide on a tagging that makes sense and start using it to track ISO testing bugs and other kind of bugs going forward
other-p-builds-smoke-testing Essential Define on a wiki what a broken build is
other-p-builds-smoke-testing Essential Gema helping jibel triage ISO testing results, this has to be done in the morning so a rota with people in the US doesn't solve the problem
other-p-builds-smoke-testing Essential Improve the usage of the new tags defined in https://wiki.ubuntu.com/QATeam/AutomatedTesting/TestingTypeAndBugTracking
other-p-builds-smoke-testing Essential Investigate where the smoke testing holes are
other-p-builds-smoke-testing Essential Review ISO testing trunk and improve it
other-p-builds-smoke-testing Essential Set rotation schedule for the builds, first week to do it together to learn about the process
other-p-qa-backlog High Arrange for a new time slot and announce to the community the splitting of QA Team meeting and bug tracking. They will be two separate meetings
other-p-qa-backlog High Create a New Starters Page with links to resources and tasks
other-p-qa-backlog High Extract the most relevant topics applicable to testing Ubuntu from ISTQB testing and document them in the wiki, refer the engineering community to the glossary
other-p-qa-backlog High Gather all the relevant links from the team and create a landing page for QA-Team
other-p-qa-backlog High Make sure that qa.ubuntu.com blog is syndicated to planet ubuntu
other-p-qa-backlog High Review the improved test cases
other-p-qa-test-case-definition Essential Propose a test case definition that can be fully used by everyone developing test cases for Ubuntu. The test case format proposed was accepted by the CoP in the November meeting
postponed other-p-qa-standard-sru-testing Essential Gather the test cases that would have avoided that regression from happening
other-p-qa-standard-sru-testing Essential Start counting how many regressions happen for SRUs in the current cycle so that we have metrics for next UDS, which packages do regress (possibly add to people.canonical.com/~ubuntu-archive/pending-sru.html), new defect tagging being discuss to be able to achieve this
C de-Avillez inprogress other-p-bugsquad-mentoring Medium Coordinate with UWN Team regarding publicity for the videos and workshops
todo community-p-making-harvest-rock Low blog about using Harvest more
community-p-making-harvest-rock Low talk to Brian about sru-verification harvest data source
community-p-making-harvest-rock Low talk to LP folks about adding a blurb for hardware-specific package bugs
done other-p-bugsquad-mentoring Medium close the bugsquad-mentorshipgroup-alpha
other-p-bugsquad-mentoring Medium email to b-mg-alpha regarding closing of the group
other-p-builds-smoke-testing Essential Create a bug report to list the bugs that have been found during the daily iso testing (using current ISO bug report, after discussion with jibel)
other-p-builds-smoke-testing Essential Document how to debug ISO installations: https://wiki.ubuntu.com/QATeam/AutomatedTesting/DebuggingJenkinsISOInstallations
other-p-builds-smoke-testing Essential Document how to debug post installation problems: https://wiki.ubuntu.com/QATeam/AutomatedTesting/DebuggingJenkinsPostInstallProblems
other-p-builds-smoke-testing Essential Document how to interpret Jenkins results https://wiki.ubuntu.com/QATeam/AutomatedTesting/UnderstandingJenkinsResults
other-p-builds-smoke-testing Essential Give training to the Platform QA Team about Jenkins maintenance
other-p-builds-smoke-testing Essential Schedule and give a training session for the community on how to use Jenkins
other-p-qa-automated-test-submissions High Define submission criteria for automated tests
other-p-qa-automated-test-submissions High Define toolset and output standards for automated test suites
Jean-Baptiste Lallement done desktop-p-unity-quality High Help on this setup giving access to required machines
desktop-p-unity-quality High Publish testing results to jenkins.qa.ubuntu.com
desktop-p-unity-quality High Publish the documentation. https://wiki.ubuntu.com/QATeam/AutomatedTesting/UnityAutolandingSetup
foundations-p-lts-upgrades Essential Add test profile for universe (limit universe to applications ie packages with a .desktop file)
foundations-p-lts-upgrades Essential Add test scripts provided by the desktop team to auto-upgrade-tester
foundations-p-lts-upgrades Essential auto-upgrade-tester should be able to take a apt-clone image to create a base image
foundations-p-lts-upgrades Essential auto-upgrade-tester should collect all debconf prompts, not only configuration change prompts
foundations-p-lts-upgrades Essential provide a option to run the upgrade with "eatmydata" (for the upgrade tester)
foundations-p-lts-upgrades Essential to take over automatic upgrade testing
other-p-builds-smoke-testing Essential Add software-center tests to daily testing
other-p-builds-smoke-testing Essential Discuss with mvo to add software-center tests to daily testing
other-p-builds-smoke-testing Essential Document how to debug ISO installations when doing manual testing: https://wiki.ubuntu.com/DebuggingISOInstallation
other-p-builds-smoke-testing Essential Document how to troubleshoot upgrade testing: https://wiki.ubuntu.com/QATeam/AutomatedTesting/DebuggingJenkinsUpgradeTesting
other-p-builds-smoke-testing Essential ISO static validation, write requirement (See note [1] below)
other-p-builds-smoke-testing Essential Set up the infrastructure to keep a historic of ISOs
other-p-qa-backlog High Setup environment for desktop packages merge autolanding (idem unity autolanding https://blueprints.launchpad.net/ubuntu/+spec/desktop-p-unity-quality)
postponed foundations-p-iso-tracker High get hardware being used for testing added to ubuntu friendly
other-p-builds-smoke-testing Essential Add a test scenario to the automated testing in Jenkins to address full updated installs with Ubiquity (problems to be detected with this testing: bug 743359 and bug 897680)
other-p-qa-backlog High Deploy Wubi tests in VMs in the DC
other-p-qa-standard-sru-testing Essential Automate the run of the package's test suite when a package is published to -proposed
other-p-qa-standard-sru-testing Essential Update the pending sru report to show which packages must be tested by canonical and which one must be tested by the community
Kate Stewart blocked other-p-qa-standard-sru-testing Essential Send an announcement to ubuntu-devel about the new requirement to add a test script with the SRU whenever applicable
Larry E Works inprogress other-p-qa-labsetup Undefined Change the time of the servers to UTC and configure ntp to keep them up to date
other-p-qa-labsetup Undefined Document all available jobs and reasons for them, determine a policy regarding creating new jobs so that we only create new jobs when it makes sense. If there is a job without a reason to be, it should be removed
other-p-qa-labsetup Undefined Document the process for requesting VMs to the QA team on a wiki
other-p-qa-labsetup Undefined Figure out and document how results are pushed from the internal instance to the external one
done other-p-qa-backlog High Try Jenkins Email-ext plugin so ubuntu-testing-notifications refers to the public instance
other-p-qa-labsetup Undefined Configure the pre production VM for Jenkins and make it available to the team to use
postponed other-p-qa-labsetup Undefined Establish the workflow for creating jobs, removing jobs, modifying jobs. Make sure nobody adds new jobs to the production Jenkins without having tried it first and demonstrated it works in the pre-production environment. Use bazaar to store the jobs and jenkins configuration, people should submit to the branch and then you can catch up on the production servers for updating with the latest changes
nskaggs done other-p-qa-backlog High Rework the QATeam wiki and add information that is relevant to the testing we are going to be doing
Max Brustkern done other-p-builds-smoke-testing Essential Generate a report to track the bugs based on the new tagging
other-p-qa-boot-speed-testing Essential Improved reporting
other-p-qa-boot-speed-testing Essential Update report to fix graph congestion and group daily runs by arch
other-p-qa-qa-regression-testing High Add multiverse tag
other-p-qa-qa-regression-testing High Add source repository tag
other-p-qa-qa-regression-testing High Investigate moving to autotest
other-p-qa-qa-regression-testing High Package autotest
other-p-qa-qa-regression-testing High Setup autotest (talk to Robbie Williamson, Manoj, Andy)
other-p-qa-standard-sru-testing Essential Automate the run of the QRT when a package is published to -proposed
postponed other-p-qa-qa-regression-testing High Add architecture tag
other-p-qa-qa-regression-testing High Add isolation tag
other-p-qa-qa-regression-testing High Add tag for potentially destructive tests
other-p-qa-qa-regression-testing High Get compilation into buildd/a predictable toolchain
other-p-qa-standard-sru-testing Essential Build a report to publish the regression test results
Patrick Wright done other-p-builds-smoke-testing Essential Assess how long would it take to improve the jenkins plugin to be fit for our purpose
other-p-builds-smoke-testing Essential Create custom Dashboard Requirements
other-p-builds-smoke-testing Essential Pilot ISO job restructuring
other-p-builds-smoke-testing Essential Set up Jenkins to report ISO testing results
other-p-builds-smoke-testing Essential Set up Lucid daily testing install tests
other-p-builds-smoke-testing Essential Tie jobs to iso under test
other-p-qa-automated-test-submissions High Define test suite rejection criteria
other-p-qa-backlog High Finish Orchestra setup for kernel testing boxes in 1SS
other-p-qa-backlog High Work with DX to improve test suites and coverage
other-p-qa-boot-speed-testing Essential Announce where to find results and create a Jenkins Dashboard for boot speed testing
other-p-qa-boot-speed-testing Essential Complete benchmarking for Veriton systems
other-p-qa-boot-speed-testing Essential Discussion with Pete and Gema about where to fit improvements
other-p-qa-boot-speed-testing Essential Import Desktop images instead of Alternates
other-p-qa-boot-speed-testing Essential Now that things work locally, setup in Magners
other-p-qa-boot-speed-testing Essential Setup new systems in Magners
other-p-qa-boot-speed-testing Essential Setup tests to run 3 iterations
other-p-qa-boot-speed-testing Essential Submit RT to create a user to ssh into cranberry (same account will be the jenkins admin account)
other-p-qa-boot-speed-testing Essential Test that existing scripts will work with Orchestra and make any changes required
other-p-qa-labsetup Undefined Give Larry credentials to be able to manage the public instance of enkins
other-p-qa-standard-sru-testing Essential Setup a build environment on the QA Lab for each supported release/architecture
Steve Conklin done other-p-qa-kernel-sru Essential Compile a list of tests other than ltp which are available
other-p-qa-kernel-sru Essential Create a local sandbox using kernel team resources for test development
other-p-qa-kernel-sru Essential Create a test for ext4 file systems tests
other-p-qa-kernel-sru Essential Create a test for the Bonnie+ file system stress test on ecryptfs
other-p-qa-kernel-sru Essential Create a test for the Bonnie+ file system stress test on ext4
other-p-qa-kernel-sru Essential Create a way to track test metrics across repeated tests
other-p-qa-kernel-sru Essential Evaluate rteval and stress and other tests which may provide metrics for trending across releases
other-p-qa-kernel-sru Essential Evaluate which additional tests from autotest we should be using
other-p-qa-kernel-sru Essential Evaluate which tests outside of ltp we should be running
other-p-qa-kernel-sru Essential Provide application to log data from Fluke meters over network
other-p-qa-kernel-sru Essential get latest version of autotest into use
postponed other-p-qa-kernel-sru Essential get rteval packaged, along with anything it depends on

Development over time

Date done todo
2011-11-24 8 57
2011-11-25 8 (+0) 57 (+0)
2011-11-26 10 (+2) 55 (-2)
2011-11-27 10 (+0) 55 (+0)
2011-11-28 10 (+0) 55 (+0)
2011-11-29 13 (+3) 52 (-3)
2011-11-30 14 (+1) 57 (+5)
2011-12-01 15 (+1) 56 (-1)
2011-12-02 15 (+0) 56 (+0)
2011-12-03 15 (+0) 56 (+0)
2011-12-04 15 (+0) 56 (+0)
2011-12-05 19 (+4) 68 (+12)
2011-12-06 20 (+1) 67 (-1)
2011-12-07 20 (+0) 67 (+0)
2011-12-08 20 (+0) 67 (+0)
2011-12-09 19 (-1) 66 (-1)
2011-12-10 19 (+0) 66 (+0)
2011-12-11 19 (+0) 66 (+0)
2011-12-12 19 (+0) 66 (+0)
2011-12-13 20 (+1) 67 (+1)
2011-12-14 20 (+0) 67 (+0)
2011-12-15 22 (+2) 67 (+0)
2011-12-16 24 (+2) 65 (-2)
2011-12-17 24 (+0) 65 (+0)
2011-12-18 24 (+0) 65 (+0)
2011-12-19 24 (+0) 65 (+0)
2011-12-20 29 (+5) 64 (-1)
2011-12-21 29 (+0) 64 (+0)
2011-12-22 29 (+0) 64 (+0)
2011-12-23 29 (+0) 64 (+0)
2011-12-24 29 (+0) 64 (+0)
2011-12-25 29 (+0) 64 (+0)
2011-12-26 29 (+0) 64 (+0)
2011-12-27 29 (+0) 64 (+0)
2011-12-28 29 (+0) 64 (+0)
2011-12-29 29 (+0) 64 (+0)
2011-12-30 29 (+0) 64 (+0)
2011-12-31 29 (+0) 64 (+0)
2012-01-01 29 (+0) 64 (+0)
2012-01-02 30 (+1) 63 (-1)
2012-01-03 30 (+0) 63 (+0)
2012-01-04 31 (+1) 62 (-1)
2012-01-05 31 (+0) 62 (+0)
2012-01-06 34 (+3) 61 (-1)
2012-01-07 34 (+0) 61 (+0)
2012-01-08 34 (+0) 61 (+0)
2012-01-09 39 (+5) 56 (-5)
2012-01-10 41 (+2) 57 (+1)
2012-01-11 41 (+0) 57 (+0)
2012-01-12 41 (+0) 57 (+0)
2012-01-13 41 (+0) 51 (-6)
2012-01-14 41 (+0) 51 (+0)
2012-01-15 41 (+0) 51 (+0)
2012-01-16 41 (+0) 51 (+0)
2012-01-17 44 (+3) 53 (+2)
2012-01-18 53 (+9) 43 (-10)
2012-01-19 53 (+0) 43 (+0)
2012-01-20 51 (-2) 42 (-1)
2012-01-21 51 (+0) 42 (+0)
2012-01-22 51 (+0) 42 (+0)
2012-01-23 65 (+14) 46 (+4)
2012-01-24 67 (+2) 44 (-2)
2012-01-25 72 (+5) 39 (-5)
2012-01-26 74 (+2) 36 (-3)
2012-01-27 74 (+0) 43 (+7)
2012-01-28 74 (+0) 43 (+0)
2012-01-29 74 (+0) 43 (+0)
2012-01-30 74 (+0) 44 (+1)
2012-01-31 74 (+0) 44 (+0)
2012-02-01 76 (+2) 42 (-2)
2012-02-02 77 (+1) 41 (-1)
2012-02-03 81 (+4) 36 (-5)
2012-02-04 81 (+0) 36 (+0)
2012-02-05 81 (+0) 36 (+0)
2012-02-06 81 (+0) 36 (+0)
2012-02-07 84 (+3) 33 (-3)
2012-02-08 85 (+1) 32 (-1)
2012-02-09 85 (+0) 32 (+0)
2012-02-10 85 (+0) 32 (+0)
2012-02-11 85 (+0) 32 (+0)
2012-02-12 85 (+0) 32 (+0)
2012-02-13 85 (+0) 32 (+0)
2012-02-14 85 (+0) 32 (+0)
2012-02-15 85 (+0) 32 (+0)
2012-02-16 85 (+0) 32 (+0)
2012-02-17 88 (+3) 28 (-4)
2012-02-18 88 (+0) 28 (+0)
2012-02-19 88 (+0) 28 (+0)
2012-02-20 88 (+0) 28 (+0)
2012-02-21 88 (+0) 28 (+0)
2012-02-22 88 (+0) 28 (+0)
2012-02-23 88 (+0) 28 (+0)
2012-02-24 88 (+0) 28 (+0)
2012-02-25 88 (+0) 28 (+0)
2012-02-26 88 (+0) 28 (+0)
2012-02-27 88 (+0) 28 (+0)
2012-02-28 88 (+0) 28 (+0)
2012-02-29 88 (+0) 28 (+0)
2012-03-01 88 (+0) 28 (+0)
2012-03-02 90 (+2) 27 (-1)
2012-03-03 90 (+0) 27 (+0)
2012-03-04 90 (+0) 27 (+0)
2012-03-05 90 (+0) 27 (+0)
2012-03-06 90 (+0) 27 (+0)
2012-03-07 90 (+0) 27 (+0)
2012-03-08 92 (+2) 25 (-2)
2012-03-09 92 (+0) 24 (-1)
2012-03-10 92 (+0) 25 (+1)
2012-03-11 92 (+0) 25 (+0)
2012-03-12 92 (+0) 25 (+0)
2012-03-13 92 (+0) 25 (+0)
2012-03-14 92 (+0) 25 (+0)
2012-03-15 93 (+1) 24 (-1)
2012-03-16 93 (+0) 24 (+0)
2012-03-17 93 (+0) 24 (+0)
2012-03-18 93 (+0) 24 (+0)
2012-03-19 93 (+0) 24 (+0)
2012-03-20 93 (+0) 24 (+0)
2012-03-21 98 (+5) 17 (-7)
2012-03-22 99 (+1) 16 (-1)
2012-03-23 99 (+0) 16 (+0)
2012-03-24 99 (+0) 16 (+0)
2012-03-25 99 (+0) 16 (+0)
2012-03-26 99 (+0) 16 (+0)
2012-03-27 99 (+0) 16 (+0)
2012-03-28 28 (-71) 8 (-8)
2012-03-29 106 (+78) 8 (+0)
2012-03-30 106 (+0) 8 (+0)
2012-03-31 106 (+0) 8 (+0)
2012-04-01 106 (+0) 8 (+0)
2012-04-02 105 (-1) 8 (+0)
2012-04-03 105 (+0) 8 (+0)
2012-04-04 105 (+0) 8 (+0)
2012-04-05 105 (+0) 8 (+0)
2012-04-06 105 (+0) 8 (+0)
2012-04-07 105 (+0) 8 (+0)
2012-04-08 105 (+0) 8 (+0)
2012-04-09 105 (+0) 8 (+0)
2012-04-10 105 (+0) 8 (+0)
2012-04-11 105 (+0) 8 (+0)
2012-04-12 105 (+0) 8 (+0)
2012-04-13 105 (+0) 8 (+0)
2012-04-14 105 (+0) 8 (+0)
2012-04-15 105 (+0) 8 (+0)
2012-04-16 105 (+0) 8 (+0)
2012-04-17 105 (+0) 8 (+0)
2012-04-18 105 (+0) 8 (+0)
2012-04-19 106 (+1) 8 (+0)
2012-04-20 106 (+0) 8 (+0)
2012-04-21 106 (+0) 8 (+0)
2012-04-22 106 (+0) 8 (+0)
2012-04-23 106 (+0) 8 (+0)
2012-04-24 106 (+0) 8 (+0)
2012-04-25 106 (+0) 8 (+0)
2012-04-26 106 (+0) 8 (+0)


Last updated: Wed 06 June 2012, 07:03 UTC