Results 1 to 6 of 6

Thread: Herd 2 testing review

  1. #1
    Join Date
    Oct 2004
    Beans
    232

    Lightbulb Herd 2 testing review

    Hey I think we made a great start! By the time we get to Herd 4 we will be an ISO testing power house

    But it will take some time to learn the ropes, where to get the correct images (they can change suddenly), how to file good bug reports, etc.

    We also need better coverage on the data collation when we get more active testing going on. I've been watching the threads and copied results to the wiki, but we need better timezone coverage and more eyeballs in general for that. Please email me if you are interested in a coordination role for the next release (or for Herd 2 post-release testing). From answers I've seen given to questions in this forum section, I'm confident that we have several good potential coordinators already!


    We can learn several things from the testing project so far, mainly relating to clarity of information given to testers.
    • Information - We should provide better information on where to get ISOs, what image IDs are current and on using rsync to update.
    • Timing - An announcement should go out when the repository is frozen. In this case it was posted on Wednesday the 10th on the devel-announce list. What is the best way to notify testers in the forum that a new test cycle is about to begin? Just a sticky post, or some sort of email-notification? An announce-only mailing list perhaps?
    • Preparations - Performing efficient CD testing does require some preparation ahead of time. You need a dedicated machine, drive or VMware (at the very least). You should already have downloaded recent images of the versions you want to test so you can quickly rsync to refresh them. You may want to print out the test instructions, etc.
    • Coordination - Lots of people have volunteered for different tests, many giving several alternatives. How do we agree who does what so we get a reasonable distribution of testing. Perhaps a wiki page giving an overview.
    Please add your observations from the recent testing so we can streamline the process for future releases. Let's use this thread to tweak the testing procedures going forward.

    If you're seeing this forum after the Herd 2 release or signed up but didn't get a chance to test before release, I would encourage you to test Herd 2 now anyway to get some experience with it. And the bug reports from extra testing is of course always useful!
    Henrik Nilsen OmmaUbuntu QA Team Lead

  2. #2
    Join Date
    Oct 2005
    Location
    United Kingdom
    Beans
    4,848

    Re: Herd 2 testing review

    First off, congrats on how things are going so far!
    Quote Originally Posted by Henrik View Post
    Timing - An announcement should go out when the repository is frozen. In this case it was posted on Wednesday the 10th on the devel-announce list. What is the best way to notify testers in the forum that a new test cycle is about to begin? Just a sticky post, or some sort of email-notification? An announce-only mailing list perhaps?
    I could add announcements to this forum instead of stickies if needed?
    Every time you install Jaunty, a kitten........ wait sorry what year is this again?
    Please don't PM support questions, post a thread so that everyone can benefit
    Join us in #ubuntuforums on irc.freenode.net

  3. #3
    Join Date
    Oct 2004
    Beans
    232

    Re: Herd 2 testing review

    Sorry for my ignorance: how does that work? Can people register to get announcements?
    Henrik Nilsen OmmaUbuntu QA Team Lead

  4. #4
    Join Date
    Oct 2005
    Location
    United Kingdom
    Beans
    4,848

    Re: Herd 2 testing review

    Quote Originally Posted by Henrik View Post
    Sorry for my ignorance: how does that work? Can people register to get announcements?
    No I meant like blue bars across the head of this subforum... stand out a bit more than stickies.

    Sorry for confusion
    Every time you install Jaunty, a kitten........ wait sorry what year is this again?
    Please don't PM support questions, post a thread so that everyone can benefit
    Join us in #ubuntuforums on irc.freenode.net

  5. #5
    Join Date
    Oct 2004
    Beans
    232

    Re: Herd 2 testing review

    OK, that would help. I still think some sore of email announcement would be good though. Because testing starts with a starters gun basically, so it might be good to ping people about it somehow.

    Perhaps we can just ask people to subscribe to the the devel-announce list. It's very low traffic -- only about 10 emails a month.
    Henrik Nilsen OmmaUbuntu QA Team Lead

  6. #6
    Join Date
    Oct 2004
    Beans
    232

    Re: Herd 2 testing review

    Wow, so the response has been almost overwhelming! Way beyond what I had expected for the first test run. Lot's of people have signed up and the tests are still flowing in. Thanks folks!

    I'd esp. like to tank those who have stepped up to help others get started with testing and generally coordinate things!


    I've created a page in the wiki for the testing team so we can start to get an overview. Other ideas for adding some structure are welcome!

    One thing we already see is that there are many volunteers for i386 Ubuntu desktops and less for other platforms and flavours. We should think about how we can spread testing out as much as possible given that starting point.
    Henrik Nilsen OmmaUbuntu QA Team Lead

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •