I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests + Selenium tests) on a local machine (so new code can be regression tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Thanks,
On Fri, Dec 30, 2011 at 9:11 PM, Dan Nessett dnessett@yahoo.com wrote:
I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests + Selenium tests) on a local machine (so new code can be regression tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Jenkins is only really used to run the tests automatically when someone commits. You ran run the PHPUnit tests locally without Jenkins. Instructions on installing PHPUnit and running the tests is at https://www.mediawiki.org/wiki/Manual:PHP_unit_testing .
I don't have URLs for you offhand, but QUnit and Selenium are probably also documented on mediawiki.org .
Roan
QUnit tests (for our JavaScript modules) can be ran by opening
./tests/qunit/index.html
in your browser.
Note that this is about to change in a few days, but check https://www.mediawiki.org/wiki/Manual:JavaScript_unit_testing for the latest info.
On Fri, Dec 30, 2011 at 9:29 PM, Roan Kattouw roan.kattouw@gmail.comwrote:
On Fri, Dec 30, 2011 at 9:11 PM, Dan Nessett dnessett@yahoo.com wrote:
I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests + Selenium tests) on a local machine (so new code can be regression tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Jenkins is only really used to run the tests automatically when someone commits. You ran run the PHPUnit tests locally without Jenkins. Instructions on installing PHPUnit and running the tests is at https://www.mediawiki.org/wiki/Manual:PHP_unit_testing .
I don't have URLs for you offhand, but QUnit and Selenium are probably also documented on mediawiki.org .
Roan
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Fri, 30 Dec 2011 21:29:53 +0100, Roan Kattouw wrote:
On Fri, Dec 30, 2011 at 9:11 PM, Dan Nessett dnessett@yahoo.com wrote:
I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests
- Selenium tests) on a local machine (so new code can be regression
tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Jenkins is only really used to run the tests automatically when someone commits. You ran run the PHPUnit tests locally without Jenkins. Instructions on installing PHPUnit and running the tests is at https://www.mediawiki.org/wiki/Manual:PHP_unit_testing .
I don't have URLs for you offhand, but QUnit and Selenium are probably also documented on mediawiki.org .
Roan
OK, I downloaded latest trunk and tried to run the PHPUnit tests. I executed make safe and got the following result:
php phpunit.php --configuration /usr/local/src/mediawiki/latest_trunk/ trunk/phase3/tests/phpunit/suite.xml --exclude-group Broken,Destructive,Stub PHPUnit 3.5 or later required, you have 3.4.12
So, I upgraded PHPUnit (using pear upgrade phpunit/PHPUnit). This installed 3.4.15 (not 3.5).
I am running on Ubuntu 8.04. Anyone have an idea how to get PHPUnit 3.5 installed?
On Thu, Jan 5, 2012 at 1:34 PM, Dan Nessett dnessett@yahoo.com wrote:
So, I upgraded PHPUnit (using pear upgrade phpunit/PHPUnit). This installed 3.4.15 (not 3.5).
I am running on Ubuntu 8.04. Anyone have an idea how to get PHPUnit 3.5 installed?
uninstall the pear version and do a make install.
On Thu, 05 Jan 2012 14:03:14 -0600, OQ wrote:
On Thu, Jan 5, 2012 at 1:34 PM, Dan Nessett dnessett@yahoo.com wrote:
So, I upgraded PHPUnit (using pear upgrade phpunit/PHPUnit). This installed 3.4.15 (not 3.5).
I am running on Ubuntu 8.04. Anyone have an idea how to get PHPUnit 3.5 installed?
uninstall the pear version and do a make install.
Didn't work.
# make install ./install-phpunit.sh Installing phpunit with pear Channel "pear.phpunit.de" is already initialized Adding Channel "components.ez.no" succeeded Discovery of channel "components.ez.no" succeeded Channel "pear.symfony-project.com" is already initialized Did not download optional dependencies: pear/Image_GraphViz, pear/Log, symfony/YAML, use --alldeps to download automatically phpunit/PHPUnit can optionally use package "pear/Image_GraphViz" (version
= 1.2.1)
phpunit/PHPUnit can optionally use package "pear/Log" phpunit/PHPUnit can optionally use package "symfony/YAML" (version >= 1.0.2) downloading PHPUnit-3.4.15.tgz ... Starting to download PHPUnit-3.4.15.tgz (255,036 bytes) .....................................................done: 255,036 bytes install ok: channel://pear.phpunit.de/PHPUnit-3.4.15
On Fri, Jan 6, 2012 at 12:56 PM, Dan Nessett dnessett@yahoo.com wrote:
On Thu, 05 Jan 2012 14:03:14 -0600, OQ wrote:
uninstall the pear version and do a make install.
Didn't work.
# make install ./install-phpunit.sh Installing phpunit with pear Channel "pear.phpunit.de" is already initialized Adding Channel "components.ez.no" succeeded Discovery of channel "components.ez.no" succeeded Channel "pear.symfony-project.com" is already initialized Did not download optional dependencies: pear/Image_GraphViz, pear/Log, symfony/YAML, use --alldeps to download automatically phpunit/PHPUnit can optionally use package "pear/Image_GraphViz" (version
= 1.2.1)
phpunit/PHPUnit can optionally use package "pear/Log" phpunit/PHPUnit can optionally use package "symfony/YAML" (version >= 1.0.2) downloading PHPUnit-3.4.15.tgz ... Starting to download PHPUnit-3.4.15.tgz (255,036 bytes) .....................................................done: 255,036 bytes install ok: channel://pear.phpunit.de/PHPUnit-3.4.15
Dunno then, it installed 3.6.3 for me. Hopefully somebody here knows a bit more about pear :)
On Fri, Jan 6, 2012 at 8:06 PM, OQ overlordq@gmail.com wrote:
On Fri, Jan 6, 2012 at 12:56 PM, Dan Nessett dnessett@yahoo.com wrote:
On Thu, 05 Jan 2012 14:03:14 -0600, OQ wrote:
uninstall the pear version and do a make install.
Didn't work.
# make install ./install-phpunit.sh Installing phpunit with pear Channel "pear.phpunit.de" is already initialized Adding Channel "components.ez.no" succeeded Discovery of channel "components.ez.no" succeeded Channel "pear.symfony-project.com" is already initialized Did not download optional dependencies: pear/Image_GraphViz, pear/Log, symfony/YAML, use --alldeps to download automatically phpunit/PHPUnit can optionally use package "pear/Image_GraphViz" (version
= 1.2.1)
phpunit/PHPUnit can optionally use package "pear/Log" phpunit/PHPUnit can optionally use package "symfony/YAML" (version >= 1.0.2) downloading PHPUnit-3.4.15.tgz ... Starting to download PHPUnit-3.4.15.tgz (255,036 bytes) .....................................................done: 255,036 bytes install ok: channel://pear.phpunit.de/PHPUnit-3.4.15
Dunno then, it installed 3.6.3 for me. Hopefully somebody here knows a bit more about pear :)
I remember having a similar issue when I first installed phpunit on my Mac. Although I don't know the exact command, I remember having to update some central installer proces by PEAR ("channel" ?) to the latest version, which still had an old version in it's (local?) database.
Krinkle
On Mon, 09 Jan 2012 09:26:24 +0100, Krinkle wrote:
On Fri, Jan 6, 2012 at 8:06 PM, OQ overlordq@gmail.com wrote:
On Fri, Jan 6, 2012 at 12:56 PM, Dan Nessett dnessett@yahoo.com wrote:
On Thu, 05 Jan 2012 14:03:14 -0600, OQ wrote:
uninstall the pear version and do a make install.
Didn't work.
# make install ./install-phpunit.sh Installing phpunit with pear Channel "pear.phpunit.de" is already initialized Adding Channel "components.ez.no" succeeded Discovery of channel "components.ez.no" succeeded Channel "pear.symfony-project.com" is already initialized Did not download optional dependencies: pear/Image_GraphViz, pear/Log, symfony/YAML, use --alldeps to download automatically phpunit/PHPUnit can optionally use package "pear/Image_GraphViz" (version
= 1.2.1)
phpunit/PHPUnit can optionally use package "pear/Log" phpunit/PHPUnit can optionally use package "symfony/YAML" (version >= 1.0.2) downloading PHPUnit-3.4.15.tgz ... Starting to download PHPUnit-3.4.15.tgz (255,036 bytes) .....................................................done: 255,036 bytes install ok: channel://pear.phpunit.de/PHPUnit-3.4.15
Dunno then, it installed 3.6.3 for me. Hopefully somebody here knows a bit more about pear :)
I remember having a similar issue when I first installed phpunit on my Mac. Although I don't know the exact command, I remember having to update some central installer proces by PEAR ("channel" ?) to the latest version, which still had an old version in it's (local?) database.
Krinkle
So this thread is complete, Ubuntu 8.04 is pinned to PHP 5.2.4 through the standard distribution channels. PHPUnit 5.3 requires at least PHP 5.2.7. I looked around and could find no simple way to upgrade to PHP 5.2.x, x >= 7 on Ubuntu 8.04. I could have downloaded and tried to upgrade manually, but frankly I didn't want to handle all of the version incompatibily insanity that would entail.
For the record, here is an explanation how to update the pear channels for PHPUnit 5.3 - http://sebastian-bergmann.de/archives/897- PHPUnit-3.5.html
On Fri, 30 Dec 2011 20:11:30 +0000, Dan Nessett wrote:
I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests + Selenium tests) on a local machine (so new code can be regression tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Thanks,
I gave up on Ubuntu 8.04 and moved to Centos 5.7. After getting make safe to work, I get 27 failures and 14 incomplete tests. This is for revision 108474. Is there any way to know if this is expected? For example, are the results of nightly runs posted anywhere?
Le Tue, 10 Jan 2012 19:52:05 +0100, Dan Nessett dnessett@yahoo.com a écrit:
I gave up on Ubuntu 8.04 and moved to Centos 5.7. After getting make safe to work, I get 27 failures and 14 incomplete tests. This is for revision 108474. Is there any way to know if this is expected? For example, are the results of nightly runs posted anywhere?
Hello,
We use Jenkins to run the tests after each commit. For trunk, this is done in the MediaWiki-phpunit job :
http://integration.mediawiki.org/ci/job/MediaWiki-phpunit/
So it is mostly fine for today run. It usually does not break for more than a few hours.
Can you possibly paste the command you use to run the tests was well as the name of tests that fails? Might just be a local configuration issue.
On 10/01/12 19:52, Dan Nessett wrote:
I gave up on Ubuntu 8.04 and moved to Centos 5.7. After getting make safe to work, I get 27 failures and 14 incomplete tests. This is for revision 108474. Is there any way to know if this is expected? For example, are the results of nightly runs posted anywhere?
It's not.
Although it may be a configuration issue (eg. our script is not setting $wgEnableUploads = true, but is assuming it is)
Can you post the results?
On Tue, 10 Jan 2012 23:53:25 +0100, Platonides wrote:
On 10/01/12 19:52, Dan Nessett wrote:
I gave up on Ubuntu 8.04 and moved to Centos 5.7. After getting make safe to work, I get 27 failures and 14 incomplete tests. This is for revision 108474. Is there any way to know if this is expected? For example, are the results of nightly runs posted anywhere?
It's not.
Although it may be a configuration issue (eg. our script is not setting $wgEnableUploads = true, but is assuming it is)
Can you post the results?
Sure, I can post the results, but I don't think I should just dump them into this list (there are over 700 lines of output). How would you like me to go about it?
Le Wed, 11 Jan 2012 02:31:47 +0100, Dan Nessett dnessett@yahoo.com a écrit:
Sure, I can post the results, but I don't think I should just dump them into this list (there are over 700 lines of output). How would you like me to go about it?
You could open a bug report on https://bugzilla.wikimedia.org/ and attach the output. Or feel free to send it to Platonides and me, I can create the bug report for you.
On Wed, 11 Jan 2012 11:17:33 +0100, Antoine Musso wrote:
Le Wed, 11 Jan 2012 02:31:47 +0100, Dan Nessett dnessett@yahoo.com a écrit:
Sure, I can post the results, but I don't think I should just dump them into this list (there are over 700 lines of output). How would you like me to go about it?
You could open a bug report on https://bugzilla.wikimedia.org/ and attach the output. Or feel free to send it to Platonides and me, I can create the bug report for you.
I have created a bug report (https://bugzilla.wikimedia.org/show_bug.cgi? id=33663) and attached the output to it.
On Fri, 30 Dec 2011 20:11:30 +0000, Dan Nessett wrote:
I have poked around a bit (using Google), but have not found instructions for setting up the MW regression test framework (e.g., CruiseControl or Jenkins or whatever is now being used + PHPUnit tests + Selenium tests) on a local machine (so new code can be regression tested before submitting patches to Bugzilla). Do such instructions exist and if so, would someone provide a pointer to them?
Thanks,
The regression tests are failing badly on my local development machine. I am trying to figure out why and have proposed one possibility (https:// bugzilla.wikimedia.org/show_bug.cgi?id=33663). If anyone with the necessary understanding of the test suite would comment, that would help chasing down the problem.
wikitech-l@lists.wikimedia.org