Thanks, Huji, to answer your question - this will be a short series of tests on Wikipedia that will display additional relevant search results across wikis in the same language to a selected number of users that fall into our bucketing schema. Not everyone will see the new results every time if they land on a search results listing page.
Cheers,
Deb
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
On Thu, Nov 10, 2016 at 6:11 PM, Huji Lee huji.huji@gmail.com wrote:
I think it would be best if we test it in at least one RTL wiki. I will mention this in the VP of Persian Wikipedia (FA WP).
If it is meant to only be shown for select users and has no impact for others, I am wiling to volunteer myself as a tester.
Huji
On Thu, Nov 10, 2016 at 6:03 PM, Deborah Tankersley < dtankersley@wikimedia.org> wrote:
Hello,
The Discovery Search team is looking for a few language specific Wikipedia sites that would be interested in helping with A/B testing for cross-wiki search results. These tests would evaluate if adding search results across wiki projects in the same language would be useful, relevant, and are of interest to users.
We've written up the details https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements [1], came up with a multitude of designs https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Design [2], and had many conversations on both talk pages and with our own internal Design team. We have also outlined the initial tests https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testing [3] that we'd like to run.
These planned A/B tests would run for about a week and would only be shown to a small subsection of users that visit the Wikipedia(s) that the tests are running on. The analyzed results of these tests will be posted on wiki so that everyone can see how they did in terms of usage and adoption of the test group.
We would like to know if there are any particular Wikipedias that would want to help us test these new search results across projects in their language. Interested community members might want to post something to their project's Village Pump to build consensus. Wikipedias that are related culturally or linguistically would also be of interest.
Please post on our testing talk page https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Result_Improvements/Testing [4] if there are any questions, concerns, or volunteers!
Thanks!
[1] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements [2] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Design [3] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Testing [4] https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Re sult_Improvements/Testing
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
Huji, thanks for the reminder about RTL wikis, which is always welcome.
To expand on Deb's answer, searchers are randomly chosen to see new results in our A/B tests, so you can't volunteer yourself as a user. Unlike a beta feature, where motivated and knowledgeable users opt in, the random tests give us a better idea of how average users will react to the proposed changes.
Deb (& Jan), have we looked at how the current design will work on RTL wikis? (With Arabic, Persian, and Hebrew being the three biggest by volume, according to a glance at the dashboards.) Some designs, like the result list on the side, may need extra design work to be made RTL-friendly.
—Trey
Trey Jones Software Engineer, Discovery Wikimedia Foundation
On Sat, Nov 12, 2016 at 9:04 AM, Deborah Tankersley < dtankersley@wikimedia.org> wrote:
Thanks, Huji, to answer your question - this will be a short series of tests on Wikipedia that will display additional relevant search results across wikis in the same language to a selected number of users that fall into our bucketing schema. Not everyone will see the new results every time if they land on a search results listing page.
Cheers,
Deb
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
On Thu, Nov 10, 2016 at 6:11 PM, Huji Lee huji.huji@gmail.com wrote:
I think it would be best if we test it in at least one RTL wiki. I will mention this in the VP of Persian Wikipedia (FA WP).
If it is meant to only be shown for select users and has no impact for others, I am wiling to volunteer myself as a tester.
Huji
On Thu, Nov 10, 2016 at 6:03 PM, Deborah Tankersley < dtankersley@wikimedia.org> wrote:
Hello,
The Discovery Search team is looking for a few language specific Wikipedia sites that would be interested in helping with A/B testing for cross-wiki search results. These tests would evaluate if adding search results across wiki projects in the same language would be useful, relevant, and are of interest to users.
We've written up the details https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements [1], came up with a multitude of designs https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Design [2], and had many conversations on both talk pages and with our own internal Design team. We have also outlined the initial tests https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testing [3] that we'd like to run.
These planned A/B tests would run for about a week and would only be shown to a small subsection of users that visit the Wikipedia(s) that the tests are running on. The analyzed results of these tests will be posted on wiki so that everyone can see how they did in terms of usage and adoption of the test group.
We would like to know if there are any particular Wikipedias that would want to help us test these new search results across projects in their language. Interested community members might want to post something to their project's Village Pump to build consensus. Wikipedias that are related culturally or linguistically would also be of interest.
Please post on our testing talk page https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Result_Improvements/Testing [4] if there are any questions, concerns, or volunteers!
Thanks!
[1] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements [2] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Design [3] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Testing [4] https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Re sult_Improvements/Testing
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Thanks for the comments about the RTL wikis - during prototyping and testing, we'll be paying close attention to the layout to be sure we don't have weird things happening!
Cheers,
Deb
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
On Mon, Nov 14, 2016 at 9:03 AM, Trey Jones tjones@wikimedia.org wrote:
Huji, thanks for the reminder about RTL wikis, which is always welcome.
To expand on Deb's answer, searchers are randomly chosen to see new results in our A/B tests, so you can't volunteer yourself as a user. Unlike a beta feature, where motivated and knowledgeable users opt in, the random tests give us a better idea of how average users will react to the proposed changes.
Deb (& Jan), have we looked at how the current design will work on RTL wikis? (With Arabic, Persian, and Hebrew being the three biggest by volume, according to a glance at the dashboards.) Some designs, like the result list on the side, may need extra design work to be made RTL-friendly.
—Trey
Trey Jones Software Engineer, Discovery Wikimedia Foundation
On Sat, Nov 12, 2016 at 9:04 AM, Deborah Tankersley < dtankersley@wikimedia.org> wrote:
Thanks, Huji, to answer your question - this will be a short series of tests on Wikipedia that will display additional relevant search results across wikis in the same language to a selected number of users that fall into our bucketing schema. Not everyone will see the new results every time if they land on a search results listing page.
Cheers,
Deb
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
On Thu, Nov 10, 2016 at 6:11 PM, Huji Lee huji.huji@gmail.com wrote:
I think it would be best if we test it in at least one RTL wiki. I will mention this in the VP of Persian Wikipedia (FA WP).
If it is meant to only be shown for select users and has no impact for others, I am wiling to volunteer myself as a tester.
Huji
On Thu, Nov 10, 2016 at 6:03 PM, Deborah Tankersley < dtankersley@wikimedia.org> wrote:
Hello,
The Discovery Search team is looking for a few language specific Wikipedia sites that would be interested in helping with A/B testing for cross-wiki search results. These tests would evaluate if adding search results across wiki projects in the same language would be useful, relevant, and are of interest to users.
We've written up the details https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements [1], came up with a multitude of designs https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Design [2], and had many conversations on both talk pages and with our own internal Design team. We have also outlined the initial tests https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testing [3] that we'd like to run.
These planned A/B tests would run for about a week and would only be shown to a small subsection of users that visit the Wikipedia(s) that the tests are running on. The analyzed results of these tests will be posted on wiki so that everyone can see how they did in terms of usage and adoption of the test group.
We would like to know if there are any particular Wikipedias that would want to help us test these new search results across projects in their language. Interested community members might want to post something to their project's Village Pump to build consensus. Wikipedias that are related culturally or linguistically would also be of interest.
Please post on our testing talk page https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Result_Improvements/Testing [4] if there are any questions, concerns, or volunteers!
Thanks!
[1] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements [2] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Design [3] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_ Improvements/Testing [4] https://www.mediawiki.org/wiki/Talk:Cross-wiki_Search_Re sult_Improvements/Testing
-- deb tankersley Product Manager, Discovery irc: debt Wikimedia Foundation
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
Wikitech-ambassadors mailing list Wikitech-ambassadors@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-ambassadors