Discovery

discovery@lists.wikimedia.org

1 participants
756 discussions

Search update: sister project snippets are now in production!
by Deborah Tankersley 17 Jun '17

17 Jun '17

Hello, We're happy to announce that the latest update to the search results page is now in production! We've added snippets from the Wikimedia sister projects into a sidebar display on the search results page to further discovery into even more knowledge using your search query. You can test this new functionality out using your favorite wiki and here are a few quick sample URLs to get you started: - German: https://de.wikipedia.org/w/index.php?search=Wiener+Schnitzel~&title=Special… - Italian: https://it.wikipedia.org/wiki/Special:Search?search=Ricerca&fulltext=1 - Basque: https://eu.wikipedia.org/w/index.php?search=barruti~&title=Berezi:Bilatu&go… - English: https://en.wikipedia.org/w/index.php?search=the+night+is+nigh&title=Special… We had sent an email earlier in the year, in which we described the overall search work that the Discovery team has been doing, if you'd like a refresher on our project.[1] Cheers from the Discovery Search team! [1] https://lists.wikimedia.org/pipermail/discovery/2017-April/001487.html -- deb tankersley irc: debt Product Manager, Discovery Wikimedia Foundation

3 2

Re: [discovery] [Wikitech-l] Search update: sister project snippets are now in production!
by Stas Malyshev 16 Jun '17

16 Jun '17

Hi! > But, no results for Wikidata, the site that covers more topics than all out > other sites? Wikidata search is think right now may not be ready for this yet. It's way more complicated than regular wiki search because it's a) multilingual and b) data and not text. We're working on it though :) -- Stas Malyshev smalyshev(a)wikimedia.org

1 0

Re: [discovery] [MediaWiki-l] Search feature / Change in behaviour
by Pine W 15 Jun '17

15 Jun '17

Cross-posting this to the Discovery mailing list with hopes that someone from WMF Discovery can shed some light on this situation. Pine On Mon, May 15, 2017 at 2:08 PM, Tom <tom(a)hutch4.us> wrote: > I actually think there is a drop in page content results too. Searching > for example, pages using a tag <FooBar>text</FooBar> would report content > found in x pages. Now search <FooBar> no content in pages found. Search > <FooBar no > found on 3 pages but expect 50. > > I do want to do more testing. Rebuilding the index seems to be super fast > unlike before which would take up to a few minutes to complete. > > Tom > > > On May 15, 2017, at 10:02 AM, [[kgh]] <mediawiki(a)kghoffmeyer.de> wrote: > > > > Heiya, > > > > it's me again. :) Does somebody at least see the issue. Probably a bug > > that should be reported? > > > > Thanks and cheers > > > > Karsten > > > > > >> Am 09.05.2017 um 16:32 schrieb [[kgh]]: > >> Heiya, > >> > >> I have upgraded from 1.23 to 1.27 which was now possible since the > >> latest release. > >> > >> After the process I observe a changed behavior regarding the rudimentary > >> full-text search MediaWiki provides out of the box, i.e. I am not > >> talking about the Cirrus/Elastica duo available as an extra. > >> > >> When adding a search term to the search field on MW 1.27 like e.g. > >> "Lorem ipsum" (note: including the ") than only the page names for the > >> findings are shown and not the page names and some text extract wrapping > >> the searched term as MW 1.23 did. When adding just Lorem ipsum (note: > >> excluding the ") I get the page names and some text extract wrapping the > >> searched term as I did with 1.23. The results for Lorem ipsum however > >> are a much worse fit than for "Lorem ipsum" so that's why I am here. > >> > >> Perhaps I missed some setting I now have to make or perhaps there is > >> some script I overlooked to get things running. I'd like to get the > >> wrapping text back. Pointers highly appreciated. > >> > >> Thanks for your time > >> > >> Karsten > >> > >> > >> _______________________________________________ > >> MediaWiki-l mailing list > >> To unsubscribe, go to: > >> https://lists.wikimedia.org/mailman/listinfo/mediawiki-l > > > > > > _______________________________________________ > > MediaWiki-l mailing list > > To unsubscribe, go to: > > https://lists.wikimedia.org/mailman/listinfo/mediawiki-l > > > _______________________________________________ > MediaWiki-l mailing list > To unsubscribe, go to: > https://lists.wikimedia.org/mailman/listinfo/mediawiki-l >

5 8

Update on Discovery Projects
by Deborah Tankersley 13 Jun '17

13 Jun '17

Hi everybody, (With apologies for cross-posting...) You may have seen the recent communication [1 <https://www.mediawiki.org/wiki/Wikimedia_Engineering/June_2017_changes>] about the product and tech tune-up which went live the week of June 5th, 2017. In that communication, we promised an update on the future of Discovery projects and we will talk about those in this email. The Discovery team structure has now changed, but the new teams will still work together to complete the goals as listed in the draft annual plan.[2] A summary of their anticipated work, as we finalize these changes, is below. We plan on doing a check-in at the end of the calendar year to see how our goals are progressing with the new smaller and separated team structure. Here is a list of the various projects under the Discovery umbrella, along with the goals that they will be working on: Search Backend Improve search capabilities: - Implement ‘learning to rank’ [3] and other advanced machine learning methodologies - Improve support for languages using new analyzers - Maintain and expand power user search functionality Search Frontend Improve user interface of the search results page with new functionality: - Implement explore similar [4] <https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin…> - Update the completion suggester box [5] <https://www.mediawiki.org/wiki/Extension:CirrusSearch/CompletionSuggester> - Investigate the usage of a Wiktionary widget for English Wikipedia [6] Wikidata Query Service Expand and scale: - Improve ability to support power features on-wiki for readers - Improve full text search functionality - Implement SPARQL federation support Portal Create and implement automated language statistics and translation updates for Wikipedia.org Analysis Provide in-depth analytics support: - Perform experimental design, data collection, and data analysis - Perform ad-hoc analyses of Discovery-domain data - Maintain and augment the Discovery Dashboards,[7] which allow the teams to track their KPIs and other metrics Maps Map support: - Implement new map style - Increase frequency of OSM data replication - As needed, assist with individual language Wikipedia’s implementation of mapframe [8] <https://www.mediawiki.org/wiki/Maps/how_to:_embedded_maps> Note: There is a possibility that we can do more with maps in the coming year; we are currently evaluating strategic, partnership, and resourcing options. Structured Data on Commons Extend structured data search on Commons, as part of the structured data grant [9] via: - Research and implement advanced search capabilities - Implement new elements, filters, relationships Graphs and Tabular Data on Commons We will be re-evaluating this functionality against other Commons initiatives such as the structured data grant. As with maps, we will provide updates when we know more. We are still working out all the details with the new team structure and there might be some turbulence; let us know if there are any concerns and we will do our best to answer them. Best regards, Deborah Tankersley, Product Manager, Discovery Erika Bjune, Engineering Manager, Search Platform Jon Katz, Reading Product Lead Toby Negrin, Interim Vice President of Product Victoria Coleman, Chief Technology Officer [1] https://www.mediawiki.org/wiki/Wikimedia_Engineering/June_2017_changes [2] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/… [3] https://en.wikipedia.org/wiki/Learning_to_rank [4] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin… [5] https://www.mediawiki.org/wiki/Extension:CirrusSearch/CompletionSuggester [6] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin… [7] https://discovery.wmflabs.org/ [8] https://www.mediawiki.org/wiki/Maps/how_to:_embedded_maps [9] https://commons.wikimedia.org/wiki/Commons:Structured_data

1 0

Discovery Weekly Update for the week starting 2017-06-05
by Chris Koerner 12 Jun '17

12 Jun '17

This is the weekly update for the Discovery team. == Discussions == === Search === * Upgraded kibana to elasticsearch 5.3.3 [0] === Analysis === * Fixed an issue where caching update caused stats to no longer get logged on maps dashboard [1] * Used the search event logs to find currently existing namespace combinations [2] === Portal === * Update the stats and translations on the portal [3] [0] https://phabricator.wikimedia.org/T167266 [1] https://phabricator.wikimedia.org/T167083 [2] https://phabricator.wikimedia.org/T165861 [3] https://phabricator.wikimedia.org/T128546#3329983 -- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

Discovery Weekly Update for the week starting 2017-05-29
by Chris Koerner 05 Jun '17

05 Jun '17

Here is the update from the Discovery department for the past few weeks. == Discussions == === Search === * Updated code for enwiki's display of sister project snippets, production release is scheduled for the week of June 5th, 2017, users can test it out using the self-guided testing directions on MediaWiki.org. [0] [1] === Analysis === Moved Discovery's public datasets to a better, aggregated location [2] === Interactive === * Fixed a bug where maplink wasn't working [3] === Events and News === * The Discovery team had their annual offsite a few days before the Hackathon in Vienna in mid May 2017. [0] https://phabricator.wikimedia.org/T163463 [1] https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/self-g… [2] https://phabricator.wikimedia.org/T166724 [3] https://phabricator.wikimedia.org/T166735 --- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

Fwd: [Wiki-research-l] Report/Reflection on CHI 2017
by Pine W 31 May '17

31 May '17

Some of Andrew's report may be of interest to Discovery. Pine ---------- Forwarded message ---------- From: Andrew Hall <hall1467(a)umn.edu> Date: Wed, May 31, 2017 at 7:34 AM Subject: [Wiki-research-l] Report/Reflection on CHI 2017 To: Research into Wikimedia content and communities < wiki-research-l(a)lists.wikimedia.org> Hello all, I recently attended the 2017 Conference on Human Factors in Computing Systems (CHI) and put together a small report/reflection for Aaron Halfaker regarding some of the work that was presented there that I found interesting. If you’d like to check the report out, it can be found here: https://meta.wikimedia.org/wiki/User:Hall1467/CHI_2017_Report < https://meta.wikimedia.org/wiki/User:Hall1467/CHI_2017_Report>. CHI is a yearly human-computer interaction conference and is a common venue for studies on peer production communities such as Wikipedia. Feel free to leave questions or comments in the talk page! Have a great rest of the week. Andrew _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

1 0

Discovery Weekly Update for the week starting 2017-05-08
by Chris Koerner 12 May '17

12 May '17

Here is the update from the Discovery department for the past week. Also of note, due to scheduling (our department offsite, the Vienna hackathon, and personal vacation) the weekly updates will resume in two weeks. We'll see you the week of 29 May! == Discussions == === Search === *Logstash (and the associated Elasticsearch / Kibana) have been upgraded to version 5.3.2 [0] [0] https://phabricator.wikimedia.org/T154473 --- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

Fwd: [MediaWiki-l] Search feature / Change in behaviour
by Deborah Tankersley 09 May '17

09 May '17

Apologies for the cross-posting... -- deb tankersley irc: debt Product Manager, Discovery Wikimedia Foundation ---------- Forwarded message --------- From: [[kgh]] <mediawiki(a)kghoffmeyer.de> Date: Tue, May 9, 2017 at 9:33 AM Subject: [MediaWiki-l] Search feature / Change in behaviour To: MediaWiki admin list <mediawiki-l(a)lists.wikimedia.org> Heiya, I have upgraded from 1.23 to 1.27 which was now possible since the latest release. After the process I observe a changed behavior regarding the rudimentary full-text search MediaWiki provides out of the box, i.e. I am not talking about the Cirrus/Elastica duo available as an extra. When adding a search term to the search field on MW 1.27 like e.g. "Lorem ipsum" (note: including the ") than only the page names for the findings are shown and not the page names and some text extract wrapping the searched term as MW 1.23 did. When adding just Lorem ipsum (note: excluding the ") I get the page names and some text extract wrapping the searched term as I did with 1.23. The results for Lorem ipsum however are a much worse fit than for "Lorem ipsum" so that's why I am here. Perhaps I missed some setting I now have to make or perhaps there is some script I overlooked to get things running. I'd like to get the wrapping text back. Pointers highly appreciated. Thanks for your time Karsten _______________________________________________ MediaWiki-l mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-l

1 0

Discovery Weekly Update for the week starting 2017-05-01
by Chris Koerner 08 May '17

08 May '17

Hello, Here is the weekly update for this past week. == Discussions == === Search === * Complete analysis of HebMorph Hebrew language analyzer, and a live demo with the recommended settings is available in labs. [0] [1] === Analysis === * [Chelsy] Talked about Discovery analysis team's work at R-Ladies SF event on May 2nd, focusing on building dashboard, report and testing using R. [2] [0] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/HebMorph_Analyzer_An… [1] http://he-wp-hebmorph-relforge.wmflabs.org/w/index.php?search=&title= מיוחד%3Aחיפוש [2] https://www.mediawiki.org/wiki/File:Data_Science_Workflow_at_Discovery.pdf --- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

← Newer
1
...
23
24
25
26
27
28
29
...
76
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

Discovery