New subject: [WikimediaMobile] WikiGrok deployed

3 Nov 2014

Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia.
Along with it a first campaign[1] was deployed. Now database is being
slowly populated with suggestions:

MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where
pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100;
+-------------------------+------------------------------------------------------------------------------------------------------+
| page_title              | pp_value
                                                      |
+-------------------------+------------------------------------------------------------------------------------------------------+
| Richard_Branson         |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Tina_Fey                |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Jon_Stewart             |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Bill_Maher              |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Jeff_Foxworthy          |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Evadne_Price            |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Dominic_Guard           |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Dilsa_Demirbag_Sten     |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| J._Douglas_MacMillan    |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Carol_Bowman            |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Lianella_Carell         |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| G._K._Reddy             |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Liù_Bosisio             |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
| Matilde_Rodríguez_Cabo  |
a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}}
|
+-------------------------+------------------------------------------------------------------------------------------------------+
14 rows in set (0.42 sec)

Pages are getting updated when edited (null edit works, but not
action=purge). According to estimations made with WikiData Query[2], the
number of potentially affected pages is approximately 33,000. If really
needed, we could whip up a script to null-edit these pages from server side
in a controlled manner, but I would like to have more data on performance
and memory consumption first.

== Monitoring ==
* Graphite: MediaWiki -> WikiGrok
* Exceptions from WikiData: type:mobile in Logstash.

== Firefighting ==
Most of potentially performance-scary/error causing code with can be
disabled by commenting out $wgWikiGrokSlowCampaigns in
wmf-config/mobile.php. If shit hits fan really hard, whole extension can be
disabled through the usual means, with $wmgUseWikiGrok.

== Next steps ==
I'm working on DB storage for questions[3] which will allow us to avoid
abusing page_props and give features such as "find me pages that could use
this type of fixes" and "find me a random page to fix".

----
[0] https://www.mediawiki.org/wiki/Extension:WikiGrok
[1] https://gerrit.wikimedia.org/r/#/c/170453/
[2] http://wdq.wmflabs.org/
[3] https://gerrit.wikimedia.org/r/170263

-- 
Best regards,
Max Semenik ([[User:MaxSem]])