wikitech.wikimedia.org will be unavailable for a short time on
Friday, beginning around 7AM San Francisco time while we apply kernel
updates and reboot[1]. Ideally the downtime will only last 5-10 minutes
but I've scheduled an hour window on the deploy calendar in case any of
the boxes have trouble reviving.
Labs instances and Toollabs services should not be affected. Some
alerts may fire during the window as we're planning to reboot one of the
monitoring hosts and the effects of that are unpredictable.
In case of emergency, the content of wikitech (minus some images)
is always available on the external backup:
https://wikitech-static.wikimedia.org/wiki/Main_Page
-Andrew
[1] For the curious (and my future reference), we're rebooting silver,
holmium, labcontrol1002, labnet1001, labmon1001
= 2015-02-03 =
== Product ==
=== Reading ===
==== Web ====
* New related pages desktop design pushed, will measure engagement
* Instrumentation in prep for language switcher change [analytics]
* new user page designs on mobile web beta going live
* Extension:Gather - PageImages showing non-free images - meeting
* scheduled to iron out API request/response format to first try in
* Related Articles on web to adjust output
==== Android ====
* New beta coming soon with improved memory usage for images and support
* for animations. Also includes A/B testing for CirrusSearch (T125393).
==== iOS ====
* Will be integrating "top articles" feature using pageviews API
* Looking forward to mobileview API change from web team to get article
* namespaces!
==== Reading Infrastructure ====
* Nothing much this week. SessionManager should be coming back into
* master once wmf.12 is verified not to break stuff.
=== Community Tech ===
* No update.
=== Editing ===
==== Collaboration ====
* '''Blocking''':
** Dry run patch for external store migration is merged. Now we need to
set External Store up on Beta, then test the dry run patch there:
https://phabricator.wikimedia.org/T119567
* '''Blocked''':
** Flow dump generation on dumps.wikimedia.org:
https://phabricator.wikimedia.org/T119511
* '''Updates''':
** We're still working on human-readable names for cross-wiki
notifications: https://phabricator.wikimedia.org/T121936
** MediaWiki presence at FOSDEM went well.
==== Language ====
* No update.
==== Multimedia ====
* '''Blocking''': none
* '''Blocked''': none
* '''Updates''':
** Work on image tweaks extension continues; may need input later.
==== Parsing ====
* '''Blocking''': none
* '''Blocked''': Need input from Collaboration, see below.
* '''Updates''':
** ruthenium updated to jessie and node 4.2 with almost everything
puppetized (thanks to ops, Marko, Ori). Tests look good. Need to run
separate memory load tests before making a decision to move production
parsoid to node 4.2
** Need input from collaboration team about
https://phabricator.wikimedia.org/T124837 (migrating Flow to talk with
RESTBase) since it will simplify support when we remove inlined data-mw
from Parsoid HTML (I consider this ticket a weak blocker)
*** Matt: Should we schedule a meeting about this? Sure .. let us do it
this week.
** Will work with services team to finalize REST API versioning policy
this week -- last chance to provide input on
https://phabricator.wikimedia.org/T124365 ... Policy will be applied
when Parsoid HTML version is changed after inlined data-mw is moved out
of Parsoid HTML
** Heads up (VE, Language, Flow): We might be able to deploy
templatedata-based serialization of transclusions next week (depends on
reviews this week).
*** https://gerrit.wikimedia.org/r/#/c/264043/ if you want to test your
respective clients against it (
https://gerrit.wikimedia.org/r/#/c/264043/16/tests/mocha/templatedata.js
and https://gerrit.wikimedia.org/r/#/c/264043/16/tests/mockAPI.js has
tests that spec behavior if you want to take a closer look)
==== VisualEditor ====
* '''Blocking''': none known
* '''Blocked''':
** https://phabricator.wikimedia.org/T58337 being worked on in review
from Krinkle for https://gerrit.wikimedia.org/r/#/c/259771/ and
https://gerrit.wikimedia.org/r/#/c/265878/ and so
https://gerrit.wikimedia.org/r/#/c/265879/
* '''Updates''':
** Released yesterday (wmf.12), editing via jQuery.IME (thanks to
Language for their support); table editing improvements (move
columns/rows; copy-paste multiple cells; make/unmake tables
sortable/wikitable; cell and table contexts)
** wmf.13 will contain a split up version of OOUI; see
https://phabricator.wikimedia.org/T113677 for work on this and some
numbers. This is not a breaking change except for non-MediaWiki users of
OOUI like VE, for whom we'll flag this.
=== Discovery ===
* Data import from analytics to ES started
* Working on integrating completion suggester for all prefix searches
* (will involve some small API changes in SearchEngine)
* TextCat is ready for inclusion in mediawiki/vendors, waiting for final
* security signoff
* Preparing for A/B test to use opening_text instead of text in morelike
* query, to improve performance
* Upgrading Wikidata Query Service to Blazegraph 2.0, so far working ok
* but some weird exceptions, investigating
* '''Blocking''': none
* '''Blocked''': security final signoff for textcat
== Technology ==
=== Analytics ===
* Dashiki: implemented limn-like layout, will end-of-life most limn
* dashboards soon
* Event Logging: problems were largely due to large tables, getting
* better as we're trimming some of those
* Wikimetrics: finished program metrics feature, deploying soon
* Jobs to count Uniques based on the Last-Access cookie are being
* productionized, will be available soon
* Bot convention thread on analytics-l concluded with us asking
* non-human user agents to include the word "Bot", for analytics
* purposes. We'll communicate that here soon:
* https://meta.wikimedia.org/wiki/User-Agent_policy
=== Performance ===
* No update.
=== Release Engineering ===
* Blocking:
** Phase out antimony.wikimedia.org,
https://phabricator.wikimedia.org/T123718
** /var/log/phd/damons.log growing on iridium,
https://phabricator.wikimedia.org/T124651
* Blocked: none
* Updates:
** 1.27.0-wmf.11 was skipped (and burned in effigy)
** 1.27.0-wmf.12 delayed by staging issues yesterday but train is
starting today
*** fun firefighting due to /srv/mediawiki-staging being wiped out
*** wmf.12 does not contain SessionManager due to an outstanding bug
that remains unreproducible
** scap 3.0 tagged and packaged! thanks ops!
** Finishing up work on puppet scap provider
=== Research ===
* No update.
=== Security ===
* No update.
=== Services ===
* Decommissioning parsoid-lb.wikimedia.org around Feb 22 --
* https://phabricator.wikimedia.org/T110474
:* use RESTBase instead
* RESTBase
:* added streaming support
:* refactor: separating out the framework part of RESTBase
:* minor tweaks and bug fixes
* EventBus
:* enabled on all wikis (module private ones)
:* final tweaks to the schemas -
https://phabricator.wikimedia.org/T124741
=== Technical Operations ===
* No update.
== Advancement ==
=== Fundraising Tech ===
* Adam Wight and Andrew Green taking the month off fr-tech to work on
* Education Program extension
* Got CI jobs running against paymentswiki branch of mediawiki (voting)
* with 1.27 non-voting (thank you releng)
* more CiviCRM enhancements
* fixes and enhancements for backup credit card processor
* prep for Latin America fundraising expansion
* investigating banner impression data outage that started yesterday
* (https://phabricator.wikimedia.org/T125676)
--
| Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E |
| identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |
Google Code-in 2015 has come to an end.
Thanks to our students for resolving 461 Wikimedia tasks. Thanks to our
35 mentors for being available, also on weekends & holidays. Thanks to
everybody on IRC for your friendliness, patience, and help provided to
new contributors.
Some more achievements, apart from those already mentioned in
https://lists.wikimedia.org/pipermail/wikitech-l/2015-December/084421.html :
* The CommonsMetadata extension parses vcards in the src field
* The MediaWiki core API exposes "actual watchers" as in "action=info"
* MediaWiki image thumbnails are interlaced whenever possible
* Kiwix is installable/moveable to the SD card, automatically opens
the virtual keyboard for "find in page", (re)starts with the last
open article
* imageinfo queries in MultimediaViewer are cached
* Twinkle's set of article maintenance tags was audited and its XFD
module has preview functionality
* The RandomRootPage extension got merged into MediaWiki core
* One can remove items from Gather collections
* A new MediaWiki maintenance script imports content from text files
* Pywikibot has action=mergehistory support implemented
* Huggle makes a tone when someone writes something
* Many i18n issues fixed and strings improved
* Namespace aliases added to MediaWiki's export dumps
* The Translate extension is compatible with PHP 7
The Grand Prize winners & finalists will be announced on February 8th.
Again congratulations everybody, and thanks for the hard work.
See you around on IRC, mailing lists, Gerrit, and Phabricator!
Cheers,
andre
--
Andre Klapper | Wikimedia Bugwrangler
http://blogs.gnome.org/aklapper/
---------- Forwarded message ----------
From: Kevin Leduc <kevin(a)wikimedia.org>
Date: Tue, Feb 2, 2016 at 4:22 PM
Subject: February 2016 Lightning Talks
To: "Staff (All)" <wmfall(a)lists.wikimedia.org>
Hi All,
The next Lightning Talks are scheduled for February 16th (two weeks from
today). We hope at least 4 people will sign up for the talks by Friday
February 12th otherwise we will postpone them another month. Lightning
Talks are an opportunity for teams @ WMF & in the Community to showcase
something they have achieved: a quarterly goal, milestone, release, or
anything of significance to the rest of the foundation and the movement as
a whole.
Each presentation will be 10 minutes or less including time for questions.
Sign up here: https://www.mediawiki.org/wiki/Lightning_Talks#February_2016
Next round of Lightning Talks:
When: Tuesday February 16, 1900 UTC
<http://www.timeanddate.com/worldclock/fixedtime.html?msg=Lightning+Talks&is…>,
11am PST (We have added this Lightning Talk to the WMF Engineering, Fun &
Learning, and Staff calendars)
Where: 5th Floor
Remotees: On-Air google hangout will be provided just before the meeting
IRC: #wikimedia-tech
YouTube stream: http://www.youtube.com/watch?v=D3fyCgBWvFc
Thanks!
Kevin Leduc, Megan Neisler, Brendan Campbell
The Winter break took longer than expected. Busy times!
You can help develop the next summary.
*Developer Relations focus*
* Wrapping up Google Code-in 2015
* Wikimedia Hackathon 2016 travel sponsorship requests
* Wikimedia Developer Summit 2016/Lessons Learned
* Developer Relations strategy and annual plan
There is a lot more at
https://www.mediawiki.org/wiki/Developer_Relations/Weekly_summary#2016-01-26
--
Quim Gil
Engineering Community Manager @ Wikimedia Foundation
http://www.mediawiki.org/wiki/User:Qgil
Cool. Forwarding this email.
Pine
On Tue, Feb 2, 2016 at 10:30 AM, Jonathan Morgan <jmorgan(a)wikimedia.org>
wrote:
> Yesterday, 2013 IEG grantee Jeph Paul started seeing 1000s of hits on his
> (grant-funded, volunteer-maintained) ReplayEdits tool which visually
> replays edit histories of Wikipedia articles.
>
> Here's why:
>
> http://www.nytimes.com/2016/02/02/us/politics/wikipedia-donald-trump-2016-e…
> (the tool <https://cosmiclattes.github.io/wikireplay/player.html> is
> linked from one of the last few paragraphs in the article)
>
> The article itself is not exceptional. It's just cool to see one of our
> locally grown research prototypes get good press.
>
> Jonathan
>
> --
> Jonathan T. Morgan
> Senior Design Researcher
> Wikimedia Foundation
> User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
>
>
> _______________________________________________
> Wiki-research-l mailing list
> Wiki-research-l(a)lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
>
>
I've been working on a little redesign project for the Main Page on
wikitech [0] and three key sub pages it points to since 2016-01-01 in
my User space. Tonight I decided that although it is far from perfect
it is better enough. I hope that some of you like it better than the
old page and that none of you hate it with a fiery passion that
compels you to revert it rather than helping me make it better.
[0]: https://wikitech.wikimedia.org/wiki/Main_Page
Bryan
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA
irc: bd808 v:415.839.6885 x6855
I am pleased to announce that Guillaume Lederrey joins WMF this week
as Operation Engineer in the Discovery team. Guillaume will work
closely with our operations team to support Elastic Search, Maps, and
WDQS along with strengthening our experience with Java based services.
Guillaume will be working remotely from Lausanne (Switzerland) where
he lives with his 4 month old son and his mother. Guillaume has
previous experience with non profits, having worked for a year in
Rwanda for an NGO. Working to make the world a better place is what
motivates him to join WMF.
For the last 5 years, Guillaume has been working for Nespresso, taking
care of all things from performance and stability of the e-commerce
and backend stacks, challenging agile practices and introducing Puppet
as the main configuration tool to managing build tools, improving
automated code quality and bringing coffee to his coworkers.
On his free time, Guillaume is the maintainer of JmxTrans [1], the
missing piece to monitor JVM based applications.
Guillaume can be found on IRC under the nickname 'gehel'.
Please join me in welcoming him!
--tomasz
[1]: https://github.com/jmxtrans/jmxtrans
Hello everyone,
The public Parsoid endpoint http://parsoid-lb.eqiad.wikimedia.org is
being decommissioned [1] once we migrate over all straggler references
to that endpoint [1] possibly as soon as 3 weeks from now.
As far as we know, there are very few requests to that endpoint right
now, but if you have been using that endpoint, please switch over to
using the RESTbase service instead. You can access Parsoid HTML for the
wikimedia wikis via their REST API endpoint. For example,
https://en.wikipedia.org/api/rest_v1/?doc is the REST API url for
English Wikipedia content.
Thanks,
Subbu.
1. https://phabricator.wikimedia.org/T110474
Hi Luigi,
On Fri, Jan 29, 2016 at 12:31 PM, Luigi Assom <itsawesome.yes(a)gmail.com> wrote:
> - how to extract _ID from ETag in headers:
> GET /page/title/{title}
the page id is indeed not directly exposed in the HTML response.
However, the revision number is exposed as part of the ETag. This can
then be used to request revision metadata including the page id at
https://en.wikipedia.org/api/rest_v1/?doc#!/Page_content/get_page_revision_….
This is admittedly not very convenient, so I created
https://phabricator.wikimedia.org/T125453 for generally improved page
id support in the REST API.
> - how to ensure
> GET /page/title/{title with different char encoding or old titles are always
> resolved to last canonical version}
The storage backing this end point is automatically kept up to date
with edits and dependency changes. Edits in particular should be
reflected within a few seconds.
>> If you refer to
>>
>> https://en.wikipedia.org/api/rest_v1/?doc#!/Page_content/get_page_graph_png…,
>> this is an end point exposing rendered graph images for
>> https://www.mediawiki.org/wiki/Extension:Graph (as linked in the end
>> point documentation).
>
>
> Oh very interesting!
> So basically html markup can be extended ?
> Would it be possible to share json objects as html5 markup and embed them in
> wiki pages?
The graph extension is using the regular MediaWiki tag extension
mechanism: https://www.mediawiki.org/wiki/Manual:Tag_extensions
Graphs are indeed defined using JSON within this tag.
> I want to avoid to update my graph just because titles changes: entities are
> always the same.
Makes sense. The current API is optimized for the common case of
access by title, but we will consider adding access by page ID as
well.
> I still don't know what parsoid is.
Parsoid is the service providing semantic HTML and a bi-directional
conversion between that & wikitext:
https://www.mediawiki.org/wiki/Parsoid
Gabriel