Hello,
I am summarizing here my proposal idea for OPW MediaWiki projects.
Objective: To test MediaWiki/WikiPedia websites across different browsers. To make sure various website features are supported on different browser platforms. This is mainly functionality testing of website features. When a new feautre is implemented, regression testing to be done to make sure existing feaures work fine. Once the tests are passed, it can be confirmed that the tested feature support the particular browsers.
Scope: To do functionality testing of selected features(i.e Print/Export PDF option etc. ) of the website on selected browser(i.e IE, FF, Chrome etc.) This is nothing to do with Performance Testing, Load Testing of the website.
Plan:
* To select features which will be tested and then select the browsers on which testing to be done * To prepare test cases covering all functionality of the selected feature * To prepare multiple test scripts for each of these testcases, covering negative/postive etc. different scenario * To prepare test data to cover various sets of data i.e to cover edge conditions etc. * To execute the test scripts and analyse the results * For failed result, bug will be logged others will be marked as Passed testing * Bug lifecycle will be tracked and once the fix is available it will be retested. * Test scripts will be reused for regression testing. * Test scripts will be updated now and then to include new changes. * New Test scripts can be included to support different scenario of the bug fix. * Test report to be presented summarizing the findings, highlighting the open defects.
Tools : Test Automation testing tool to be used - Selenium suite or Cucumber. BugZilla will be used to log defects. Test Cases to be maintained in spreadsheet or any version controlled tools. Test Report to be prepared in graphical format, any open source tool can be used.
Thanks and Regards, Indrani Sen Msc Software Engineering Queen Mary, University of London London, United Kingdom
On 04/30/2013 08:25 AM, Indrani Sen wrote:
Hello,
I am summarizing here my proposal idea for OPW MediaWiki projects.
Objective: To test MediaWiki/WikiPedia websites across different browsers. To make sure various website features are supported on different browser platforms. This is mainly functionality testing of website features. When a new feautre is implemented, regression testing to be done to make sure existing feaures work fine. Once the tests are passed, it can be confirmed that the tested feature support the particular browsers.
Scope: To do functionality testing of selected features(i.e Print/Export PDF option etc. ) of the website on selected browser(i.e IE, FF, Chrome etc.) This is nothing to do with Performance Testing, Load Testing of the website.
Thank you for your proposal. I think the scope should be more specific. There are of course a vast number of MediaWiki features, including many in extensions. Some of these already have browser tests. Many do not.
Your proposal should try to give a clear idea of what tests (which extensions, which parts of MediaWiki core, etc.) you will work on.
Matt Flaschen
On Tue, Apr 30, 2013 at 11:31 AM, Matthew Flaschen mflaschen@wikimedia.orgwrote:
On 04/30/2013 08:25 AM, Indrani Sen wrote:
Scope: To do functionality testing of selected features(i.e Print/Export PDF option etc. ) of the website on selected browser(i.e IE, FF, Chrome etc.) This is nothing to do with Performance Testing, Load Testing of the website.
Thank you for your proposal. I think the scope should be more specific. There are of course a vast number of MediaWiki features, including many in extensions. Some of these already have browser tests. Many do not.
And quite a number of ongoing projects have no need of browser tests
Your proposal should try to give a clear idea of what tests (which extensions, which parts of MediaWiki core, etc.) you will work on.
Also, any constraints or obstacles that you might encounter in the course of such tests. For example, you mention exporting PDFs. This requires access not only to the browsers, but also to the underlying file system, which changes according to where the test is run (Windows, Linux, Mac, FAT, ext3, etc.). We have solved this problem for testing UploadWizard in multiple browsers, and work on exporting PDFs is already beginning.
You mention test data. Where will this test data reside? Again, we have in place a somewhat complex arrangement of shared public test environments right now. How does your proposal fit in?
Have you seen our reporting in Jenkins that we have in place already?
-Chris
Hi Indrani,
We already have an ongoing browser test automation project[1]. For a quick overview take a look at the first 14 minutes of tech talk from 28 February[2].
Other comments are inline.
On Tue, Apr 30, 2013 at 2:25 PM, Indrani Sen i.sen@se12.qmul.ac.uk wrote:
Tools : Test Automation testing tool to be used - Selenium suite or Cucumber.
We actually already use both.
Test Cases to be maintained in spreadsheet or any version controlled tools.
We would probably have to discuss what you mean by "test case" but we use Cucumber for that. Take a look at any file in features[3] folder:
Test Report to be prepared in graphical format, any open source tool can be used.
We use Jenkins. For an example take a look at browsertests-en.wikipedia.org-linux-chrome[4] job.
If you have any questions, please let me know.
Željko -- 1: https://github.com/wikimedia/qa-browsertests/ 2: http://youtu.be/3UPDzPBf4t8 3: https://github.com/wikimedia/qa-browsertests/tree/master/features 4: https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.org-linux-chrome/
On Tue, Apr 30, 2013 at 2:25 PM, Indrani Sen i.sen@se12.qmul.ac.uk wrote:
I am summarizing here my proposal idea for OPW MediaWiki projects.
I have noticed that you did not provide the link to your proposal[1]. In addition to the comments that I have posted here, I have left a few comments on the talk page[2].
Željko -- 1: http://www.mediawiki.org/wiki/User:Indranisen 2: http://www.mediawiki.org/wiki/User_talk:Indranisen
wikitech-l@lists.wikimedia.org