Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being slowly populated with suggestions:
MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100; +-------------------------+------------------------------------------------------------------------------------------------------+ | page_title | pp_value | +-------------------------+------------------------------------------------------------------------------------------------------+ | Richard_Branson | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Tina_Fey | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jon_Stewart | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Bill_Maher | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jeff_Foxworthy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Evadne_Price | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dominic_Guard | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dilsa_Demirbag_Sten | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | J._Douglas_MacMillan | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Carol_Bowman | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Lianella_Carell | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | G._K._Reddy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Liù_Bosisio | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Matilde_Rodríguez_Cabo | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | +-------------------------+------------------------------------------------------------------------------------------------------+ 14 rows in set (0.42 sec)
Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server side in a controlled manner, but I would like to have more data on performance and memory consumption first.
== Monitoring == * Graphite: MediaWiki -> WikiGrok * Exceptions from WikiData: type:mobile in Logstash.
== Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can be disabled through the usual means, with $wmgUseWikiGrok.
== Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could use this type of fixes" and "find me a random page to fix".
---- [0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263
Congrats Max and team. Eager to see how our users interact with this.
On Mon, Nov 3, 2014 at 2:16 PM, Max Semenik maxsem.wiki@gmail.com wrote:
Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being slowly populated with suggestions:
MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100; +-------------------------+------------------------------------------------------------------------------------------------------+ | page_title | pp_value | +-------------------------+------------------------------------------------------------------------------------------------------+ | Richard_Branson | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Tina_Fey | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jon_Stewart | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Bill_Maher | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jeff_Foxworthy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Evadne_Price | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dominic_Guard | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dilsa_Demirbag_Sten | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | J._Douglas_MacMillan | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Carol_Bowman | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Lianella_Carell | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | G._K._Reddy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Liù_Bosisio | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Matilde_Rodríguez_Cabo | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | +-------------------------+------------------------------------------------------------------------------------------------------+ 14 rows in set (0.42 sec)
Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server side in a controlled manner, but I would like to have more data on performance and memory consumption first.
== Monitoring ==
- Graphite: MediaWiki -> WikiGrok
- Exceptions from WikiData: type:mobile in Logstash.
== Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can be disabled through the usual means, with $wmgUseWikiGrok.
== Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could use this type of fixes" and "find me a random page to fix".
[0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263
-- Best regards, Max Semenik ([[User:MaxSem]])
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
This is terrific- congrats to everyone. I'm a little curious how/when this is supposed to trigger- I went to a few pages with beta turned on and got nothing. :/ Under what conditions *should* we be seeing it?
Luis
On Mon, Nov 3, 2014 at 3:52 PM, Tomasz Finc tfinc@wikimedia.org wrote:
Congrats Max and team. Eager to see how our users interact with this.
On Mon, Nov 3, 2014 at 2:16 PM, Max Semenik maxsem.wiki@gmail.com wrote:
Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being
slowly
populated with suggestions:
MariaDB [enwiki_p]> select page_title, pp_value from page, page_props
where
pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
+-------------------------+------------------------------------------------------------------------------------------------------+
| page_title | pp_value |
+-------------------------+------------------------------------------------------------------------------------------------------+
| Richard_Branson |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Tina_Fey |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Jon_Stewart |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Bill_Maher |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Jeff_Foxworthy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Evadne_Price |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Dominic_Guard |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Dilsa_Demirbag_Sten |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | J._Douglas_MacMillan |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Carol_Bowman |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Lianella_Carell |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | G._K._Reddy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Liù_Bosisio |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Matilde_Rodríguez_Cabo |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
+-------------------------+------------------------------------------------------------------------------------------------------+
14 rows in set (0.42 sec)
Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server
side
in a controlled manner, but I would like to have more data on performance and memory consumption first.
== Monitoring ==
- Graphite: MediaWiki -> WikiGrok
- Exceptions from WikiData: type:mobile in Logstash.
== Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can
be
disabled through the usual means, with $wmgUseWikiGrok.
== Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could
use
this type of fixes" and "find me a random page to fix".
[0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263
-- Best regards, Max Semenik ([[User:MaxSem]])
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Hoi, I do not get it. It says, it will eventually put this information into Wikidata ... WHY NOT NOW ? Thanks, GerardM
On 3 November 2014 23:16, Max Semenik maxsem.wiki@gmail.com wrote:
Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being slowly populated with suggestions:
MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
+-------------------------+------------------------------------------------------------------------------------------------------+ | page_title | pp_value |
+-------------------------+------------------------------------------------------------------------------------------------------+ | Richard_Branson |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Tina_Fey |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jon_Stewart |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Bill_Maher |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jeff_Foxworthy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Evadne_Price |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dominic_Guard |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dilsa_Demirbag_Sten |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | J._Douglas_MacMillan |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Carol_Bowman |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Lianella_Carell |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | G._K._Reddy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Liù_Bosisio |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Matilde_Rodríguez_Cabo |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} |
+-------------------------+------------------------------------------------------------------------------------------------------+ 14 rows in set (0.42 sec)
Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server side in a controlled manner, but I would like to have more data on performance and memory consumption first.
== Monitoring ==
- Graphite: MediaWiki -> WikiGrok
- Exceptions from WikiData: type:mobile in Logstash.
== Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can be disabled through the usual means, with $wmgUseWikiGrok.
== Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could use this type of fixes" and "find me a random page to fix".
[0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263
-- Best regards, Max Semenik ([[User:MaxSem]]) _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Mon, Nov 3, 2014 at 11:26 PM, Gerard Meijssen gerard.meijssen@gmail.com wrote:
Hoi, I do not get it. It says, it will eventually put this information into Wikidata ... WHY NOT NOW ?
:)
Soon! It's just that in the early days of building this, we've been doing lots of usability testing and tech testing that would have resulted in a bunch of nonsense getting shipped to Wikidata – and we didn't want those to be the very first results from this feature ;) But we're starting on the work to send these as Wikidata contributions in our coming sprints. Stay tuned!
Thanks, GerardM
On 3 November 2014 23:16, Max Semenik maxsem.wiki@gmail.com wrote:
Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being slowly populated with suggestions:
MariaDB [enwiki_p]> select page_title, pp_value from page, page_props
where
pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
+-------------------------+------------------------------------------------------------------------------------------------------+
| page_title | pp_value |
+-------------------------+------------------------------------------------------------------------------------------------------+
| Richard_Branson |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Tina_Fey |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Jon_Stewart |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Bill_Maher |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Jeff_Foxworthy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Evadne_Price |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Dominic_Guard |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Dilsa_Demirbag_Sten |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | J._Douglas_MacMillan |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Carol_Bowman |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Lianella_Carell |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | G._K._Reddy |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Liù_Bosisio |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
| | Matilde_Rodríguez_Cabo |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
+-------------------------+------------------------------------------------------------------------------------------------------+
14 rows in set (0.42 sec)
Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server
side
in a controlled manner, but I would like to have more data on performance and memory consumption first.
== Monitoring ==
- Graphite: MediaWiki -> WikiGrok
- Exceptions from WikiData: type:mobile in Logstash.
== Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can
be
disabled through the usual means, with $wmgUseWikiGrok.
== Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could
use
this type of fixes" and "find me a random page to fix".
[0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263
-- Best regards, Max Semenik ([[User:MaxSem]]) _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
wikitech-l@lists.wikimedia.org