Dear Tom, Thanks for your response, and actually I'm Adrin, not Adrian ;). I conclude from your response that many packages have test suits. Many libraries also have one, or someone can prepare one for them. And applications having GUI can be tested just by running and working with them. So I think that's good to place a link to test suit of packages (if available) on the page of each package on the Fedora Updates website (<a href="https://admin.fedoraproject.org/updates/F9/testing">https://admin.fedoraproject.org/updates/F9/testing</a>). Also I think that's good for libraries to place names of some usually used applications which depend on libraries and if possible, name facilities of those applications which use that library. In this way I think testers can test libraries much easier. About enhancement updates, I think changes to last version can be placed on the page. Again to test faster. I think there can be a check-list for each package to check when reporting the install experience. For example list of handled bugs is a part of that list. Or list of new features is another part of that list. For enhancement updates, or for packages like kernel, I think duration of testing (1 day, 1 week, 1 hour ,....) must be reported too. Another point in my mind is that, many users use updates-testing repository, but only a few of them report their experience on the site. Only if they are a BZ user, they will report a bug if they find one. So maybe it's a good idea that PackageKit collects information about updates-testing packages installed on the user's computer and request user to allow it to send the experience information for the Fedora Community. In this way information needed for the decision of pushing packages to stable will be collected much sooner. Best, Adrin. <div class="gmail_quote">On Tue, Jul 15, 2008 at 2:09 AM, Nifty Fedora Mitch <<a href="mailto:niftyfedora@niftyegg.com" target="_blank">niftyfedora@niftyegg.com</a>> wrote: <blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> Excuse the top post... I do like to reply in kind. Adrian, Many packages do have test suites. The largest I know of is under the GCC compiler suite. When they exist the patched code is commonly tested against the suite. Many applications and do not. If you reported the bug and it was fixed you did have enough info in your bug report to reproduce it perhaps simple data like: it happens once, all the time or randomly, used to work and so on. Many bug reports do have "test cases"... often, the bugs that are addresed quickly have precise tests cases to reproduce the problem. If there is no test suite write one. ;-) or part of one. To write a suite start with a list of functions in the library and craft one or more programs for each function call. Walk through the input data choices and match the output to the expected result. In practice this can be very hard. Knuth once commented on his development of the TeX program that the test cases took ten times longer than the primary code base and his expectations. Full, random combinational testing can take more time than there is in the lifetime of a star for some programs. Bottom line -- test what is important to you in any way that you can and let others do the same. Your comment on 'yum' is spot on. On Tue, Jul 08, 2008 at 12:21:40PM +0430, Adrin Jalali wrote: > Sender: <a href="mailto:fedora-test-list-bounces@redhat.com" target="_blank">fedora-test-list-bounces@redhat.com</a> <div>> > Thanks. > Another question in my mind is that, how can I test packages? I mean, I > know how to test packages such as yum, I can just try use it and update > it, and just see whether it works for me or not (having in mind that I > would be unable to check the exact bug which is fixed in the release). > But for some packages, specially lib* ones, how can they be checked? Is > there a place to see the test instructions? > Best, > Adrin. > > On Tue, Jul 8, 2008 at 10:43 AM, Rahul Sundaram </div><div>> <[1]<a href="mailto:sundaram@fedoraproject.org" target="_blank">sundaram@fedoraproject.org</a>> wrote: > > Adrin Jalali wrote: > > Hi there, > I remember there was a page in which packages in updates-testing > repo. were listed and testers could place comments on them and > people who tested them successfully could confirm those updates, but > I lost the link and can't find the link from the </div>> [2]<a href="http://fedoraproject.org" target="_blank">fedoraproject.org</a> <[3]<a href="http://fedoraproject.org" target="_blank">http://fedoraproject.org</a>> website. Would <div>> you mind sending me the link? > Best, > Adrin Jalali. > </div>> [4]<a href="https://admin.fedoraproject.org/updates/F9/testing" target="_blank">https://admin.fedoraproject.org/updates/F9/testing</a> <div>> Rahul > -- > fedora-test-list mailing list </div>> [5]<a href="mailto:fedora-test-list@redhat.com" target="_blank">fedora-test-list@redhat.com</a> > To unsubscribe: > [6]<a href="https://www.redhat.com/mailman/listinfo/fedora-test-list" target="_blank">https://www.redhat.com/mailman/listinfo/fedora-test-list</a> > > References > > 1. mailto:<a href="mailto:sundaram@fedoraproject.org" target="_blank">sundaram@fedoraproject.org</a> > 2. <a href="http://fedoraproject.org/" target="_blank">http://fedoraproject.org/</a> > 3. <a href="http://fedoraproject.org/" target="_blank">http://fedoraproject.org/</a> > 4. <a href="https://admin.fedoraproject.org/updates/F9/testing" target="_blank">https://admin.fedoraproject.org/updates/F9/testing</a> > 5. mailto:<a href="mailto:fedora-test-list@redhat.com" target="_blank">fedora-test-list@redhat.com</a> > 6. <a href="https://www.redhat.com/mailman/listinfo/fedora-test-list" target="_blank">https://www.redhat.com/mailman/listinfo/fedora-test-list</a> <div> > -- > fedora-test-list mailing list > <a href="mailto:fedora-test-list@redhat.com" target="_blank">fedora-test-list@redhat.com</a> > To unsubscribe: > <a href="https://www.redhat.com/mailman/listinfo/fedora-test-list" target="_blank">https://www.redhat.com/mailman/listinfo/fedora-test-list</a> </div>-- T o m M i t c h e l l Looking for a place to hang my hat :-( <div><div></div><div> -- fedora-test-list mailing list <a href="mailto:fedora-test-list@redhat.com" target="_blank">fedora-test-list@redhat.com</a> To unsubscribe: <a href="https://www.redhat.com/mailman/listinfo/fedora-test-list" target="_blank">https://www.redhat.com/mailman/listinfo/fedora-test-list</a> </div></div></blockquote></div>