[QA] ULS testcases

Chris McMahon cmcmahon at wikimedia.org
Tue Sep 3 23:15:30 UTC 2013


Hi Renuka...

On Sat, Aug 31, 2013 at 6:52 PM, Renuka Alurkar <renukaalurkar at gmail.com>wrote:
>
> I did not go through all the test cases of Cirrus search. I went through
> the test cases for ULS both to understand how ULS works and to understand
> the feature files in cucumber. The testcases are easy to read and
> understand.
>

Thanks for doing that!


>
>    - I felt that the test cases could have more uniformity (if I have
>    understood them correctly, that is). For instance, in
>    uls_settings_panel.feature, we have the "input panel of language settings"
>    and in uls_ime.feature, we have a "input box"..I think we are referring to
>    the same thing here.
>
>
In this case, I believe we are talking about two different things.
 uls_ime.feature is intended to be run in the environment at
https://test2.wikipedia.org while uls_setting_panel.feature is intended to
be run against a slightly different UI available in
http://en.wikipedia.beta.wmflabs.org

I am really glad you pointed this out, though, because I discovered what I
think might be a bug because of it:
https://bugzilla.wikimedia.org/show_bug.cgi?id=53726 and in order to see
the bug in action I had to fix the test itself:
https://gerrit.wikimedia.org/r/#/c/82548/

Thanks, because of your analysis we'll be working with the Language team to
get these tests all updated and run from the proper repos, we appreciate
it.


>    - What is the interface language and what is the content language and
>    how are these preferences set?
>
> You can use ULS to change either or both the language of menus and fonts
in the wiki controls; and the language that you type into wiki interfaces.

Language of wiki content is determined in large part by the language of the
wiki itself and in some part by the language preference set in your browser
(for supported browsers)


>
>    - I executed the persistent_settings.feature manually. I did not
>    understand the Background so I did not set these preferences. Just went
>    ahead with the scenario. This scenario passes.But, when the font is changed
>    to OpenDyslexic, then apply settings. Font changes to OpenDyslexic.Now, I
>    change it back to System Font and apply settings, but it still remains
>    OpenDyslexic instead of reverting to System Font (unless I log out and log
>    back in).Is this expected behavior?
>
> I believe that is the bug I reported above, 53726.  I think you can also
reset this with a shift-reload of the page instead of logging out, is that
true?  Or are you saying that something about the OpenDyslexic font is
different than other fonts?   Let us know...


>
>
> Haven't concentrated on VisualEditor and not at all on Flow..but I will
> try/read about them. Instead of ULS, if I should focus on Cirrus search or
> Visual Editor, let me know.
>

You're doing great with ULS so far!  This kind of critical look at the
features and the tests is super important, and it has already shown me
quite a lot of work to be done, so thank you Renuka!

-Chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20130903/8f3b20a6/attachment.html>


More information about the QA mailing list