[Wikitech-l] WikiGrok deployed

Hi, WikiGrok[0] has been successfully deployed to the English Wikipedia. Along with it a first campaign[1] was deployed. Now database is being slowly populated with suggestions: MariaDB [enwiki_p]> select page_title, pp_value from page, page_props where pp_page=page_id and pp_propname='wikigrok_questions_v1' limit 100; +-------------------------+------------------------------------------------------------------------------------------------------+ | page_title | pp_value | +-------------------------+------------------------------------------------------------------------------------------------------+ | Richard_Branson | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Tina_Fey | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jon_Stewart | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Bill_Maher | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Jeff_Foxworthy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Evadne_Price | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dominic_Guard | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Dilsa_Demirbag_Sten | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | J._Douglas_MacMillan | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Carol_Bowman | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Lianella_Carell | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | G._K._Reddy | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Liù_Bosisio | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | | Matilde_Rodríguez_Cabo | a:1:{s:6:"author";a:2:{s:8:"property";s:4:"P106";s:9:"questions";a:1:{s:7:"Q482980";s:6:"author";}}} | +-------------------------+------------------------------------------------------------------------------------------------------+ 14 rows in set (0.42 sec) Pages are getting updated when edited (null edit works, but not action=purge). According to estimations made with WikiData Query[2], the number of potentially affected pages is approximately 33,000. If really needed, we could whip up a script to null-edit these pages from server side in a controlled manner, but I would like to have more data on performance and memory consumption first. == Monitoring == * Graphite: MediaWiki -> WikiGrok * Exceptions from WikiData: type:mobile in Logstash. == Firefighting == Most of potentially performance-scary/error causing code with can be disabled by commenting out $wgWikiGrokSlowCampaigns in wmf-config/mobile.php. If shit hits fan really hard, whole extension can be disabled through the usual means, with $wmgUseWikiGrok. == Next steps == I'm working on DB storage for questions[3] which will allow us to avoid abusing page_props and give features such as "find me pages that could use this type of fixes" and "find me a random page to fix". ---- [0] https://www.mediawiki.org/wiki/Extension:WikiGrok [1] https://gerrit.wikimedia.org/r/#/c/170453/ [2] http://wdq.wmflabs.org/ [3] https://gerrit.wikimedia.org/r/170263 -- Best regards, Max Semenik ([[User:MaxSem]])