Hey folks!
This is the 32 - 41st weekly update from the revision scoring team that we
have sent to this mailing list. We've been busy, but our reporting fell
behind. So here I am getting us caught up! This is going to be a long
one. Bear with me.
One major thing we've done in the past few weeks is drafted and presented a
proposal to increase the resourcing for the ORES project in the 2017 Fiscal
Year. Currently, we're just one fully funded staff member (halfak) and
partially funded contractor (Amir1) working with a bunch of volunteers.
We're proposing to staff the team with fulltime engineers, a liaison and a
tech writer. See a full draft of our proposal and pitch deck here:
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Scoring_Platform_team
*New development:*
We've expanded support for our "editquality" models to more wikis and
improved the performance of some of the models.
- We scaled up the number of observations for Indonesian Wikipedia to
100k[1]
- We added language support for Romanian[2] and built the basic
"reverted" model[3]
- We trained and tested "damaging" and "goodfaith" models for Czech
Wikipedia[4]
- We implemented some params in our training utilites to control memory
usage[5]
- We deployed all of the above to Wikimedia Labs[6]. A production
deployment is coming soon.
Prompted by the 2016 community wishlist[7], we've implemented a
"draftquality" model for evaluating new page creations.
- We researched deletion reasons on English Wikipedia[8] and created a
labeled dataset using the deletion log.
- We engineered a set of features to predict the quality of new
articles[9] and built a model[10]
- We generated a set of datasets[11,12,13] to make it easier for
volunteers and external researchers to help us audit the performance of the
model.
- We deployed the model on WMFLabs[14] and announced it's presence to a
few interested patrollers in English Wikipedia
- We've started the process of deploying the model in production[15,16]
We completed a project exploring the use of advance natural-language
processing strategies to extract new signal about vandalism, article
quality and problematic new articles. Regretfully, memory issues prevent
us from trivially putting this into production[17], so we're looking into
alternative strategies[18].
- We implemented a strategy for extracting sentence from Wikitext[19]
- We built sentence banks for personal attacks[20, vandalism[21],
spam[22], and Featured Articles[23].
- We built PCFG-based models[24] and analyzed their ability to
differentiate[25]
We've been working with the Collaboration Team[26] on their Edit Review
Improvments project[27]
- We defined and implemented a set of new precision-based test
statistics that will inform thresholds used in their new user interface[28]
- But we also decided to continue to report recall-based test statistics
as well[29]
Based on advice from engineers on the Collaboration Team, we've begun the
process of converting Wiki labels[30] to a stand-alone tool in labs.
- We generalize the gadget interface so that it can handle all
langauges/wikis[31]
- We implemented a means to auto-configure wikis based on the
dbname[32,33] and that allowed us to simplify configuration[34]
- We also implemented some performance improvements with minification,
bundling[35]
*Labeling:*
In the past few weeks, we've set up labeling campaigns for a few wikis.
- We deployed an edit types campaign for Catalan Wikipedia[36]
- We deployed an edit quality campagin for Chinese[37] and Romanian[38]
Wikipedias
- We deployed a new type of campaign for English Wikipedia --
"discussion quality" asks editors to label talk posts as "toxic" or not[39]
*Maintenance and robustness:*
We've solved a large set of problems with logging issues, compatibility
with wikibase, and we've made minor improvements to performance.
- We addressed a few bugs in the ORES Review Tool[40,44]
- We quieted some errors from our logging in ORES[41,45]
- We updated our code to work with a wikibase schema change[42]
- We fixed a language fallback pattern in Wiki labels[43]
- We set up monitoring on ORES database disk sizes[46]
- We fixed some issues with scap, phabricator's diffusion and other
supporting systems so that we can continue deploying to beta labs[47]
- We split our assets repo so that we can let our WMFLabs deploy get
ahead of the Production deployment[48]
- ORES can now minify its JSON responses[49]
- We identified a bug in flask-assets and worked around it in our local
installation of Wiki labels[50]
*Communications and outreach:*
We had a big presence at the Wikimedia Developer summit, we've drafted a
resourcing proposal, and we've made some announcements about upcoming plans
for the ORES Review tool.
- We facilitated the "Artificial Intelligence to build and navigate
content" track[51]
- We ran a session for building an AI wishlist[52] and captured notes
about more than 20 new AI proposals on a new tag in phabricator[53]
- We also ran a session discussion the ethics and dangers of advanced
algorithms mediating our processes[54]
- We helped facilitate a session about where to surface current AIs in
Wikimedia Projects[55]
- We held a discussion with Legal about licensing labeled data that
comes out of Wiki labels[56] and updated the interface to state the CC0
license clearly[57]
- We worked with the Reading Infrastructure team to analyze the
consumption of "oresscores" through the MediaWiki API[58]
- We drafted a pitch for increasing the resources for our team[59]
- We worked with the Collaboration team to announce that they'll
experimenting with a new RecentChanged filtering strategy in the ORES
Review Tool[60,61]
1. https://phabricator.wikimedia.org/T147107 -- Scale up the number of
observations for idwiki to 100k
2. https://phabricator.wikimedia.org/T152482 -- Add language support for
Romanian
3. https://phabricator.wikimedia.org/T156504 -- Build reverted model for
Romanian Wikipedia
4. https://phabricator.wikimedia.org/T156492 -- Train and test
damaging/goodfaith models for Czech Wikipedia
5. https://phabricator.wikimedia.org/T156645 -- Add '--workers' param to
cv_train utility
6. https://phabricator.wikimedia.org/T154856 -- Clean up dependencies and
deploy newest ORES & Models in labs
7.
https://meta.wikimedia.org/wiki/2016_Community_Wishlist_Survey/Categories/M…
8.
https://meta.wikimedia.org/wiki/Research:Automated_classification_of_draft_…
9. https://phabricator.wikimedia.org/T148580 -- Build feature set for draft
quality model
10. https://phabricator.wikimedia.org/T148038 -- [Epic] Build draft quality
model (spam, vandalism, attack, or OK)
11. https://phabricator.wikimedia.org/T148581 -- Extract features for
deleted page (draft quality model)
12. https://phabricator.wikimedia.org/T156642 -- Generate scored dataset
for 2016-08 - 2017-01
13. https://phabricator.wikimedia.org/T156643 -- Generate extracted
features for 2016-08 - 2017-01
14. https://phabricator.wikimedia.org/T155576 -- Deploy draftquality models
to WMFLabs
15. https://phabricator.wikimedia.org/T156835 -- Create package stuff for
draftquality
16. https://phabricator.wikimedia.org/T157049 -- Create new repo:
research-ores-draftquality
17. https://phabricator.wikimedia.org/T148867#2816566 -- Memory footprint
is enormous!
18. https://phabricator.wikimedia.org/T155111 -- [Spike] Investigate use of
Apertium LTtoolbox API in labs/production
19. https://phabricator.wikimedia.org/T148867 -- Implement sentences
datascources
20. https://phabricator.wikimedia.org/T148035 -- Sentence bank for personal
attacks
21. https://phabricator.wikimedia.org/T148034 -- Sentence bank for vandalism
22. https://phabricator.wikimedia.org/T148032 -- Sentence bank for spam
23. https://phabricator.wikimedia.org/T148033 -- Sentence bank for Featured
Articles
24. https://phabricator.wikimedia.org/T148037 -- Generate PCFG sentence
models
25. https://phabricator.wikimedia.org/T151819 -- Analyze differentiation of
FA, Spam, Vandalism, and Attack models/sentences.
26. https://www.mediawiki.org/wiki/Collaboration
27. https://www.mediawiki.org/wiki/Edit_Review_Improvements
28. https://phabricator.wikimedia.org/T151970 -- Implement new
precision-based test stats for editquality models
29. https://phabricator.wikimedia.org/T156644 -- Restore
recall-threshold-based metrics for editquality models.
30. https://meta.wikimedia.org/wiki/Wiki_labels
31. https://phabricator.wikimedia.org/T151120 -- Generalize standalone
gadget interface
32. https://phabricator.wikimedia.org/T154433 -- Auto config wikilabels
using dbnames
33. https://phabricator.wikimedia.org/T155439 -- Use module loader to load
JS/CSS from wikis
34. https://phabricator.wikimedia.org/T154693 -- Remove host from
wikilabels config -- infer from request
35. https://phabricator.wikimedia.org/T154122 -- Minification and bundling
for wikilabels assets
36. https://phabricator.wikimedia.org/T152965 -- Deploy cawiki edit types
campaign
37. https://phabricator.wikimedia.org/T152561 -- Deploy zhwiki edit quality
campaign
38. https://phabricator.wikimedia.org/T156357 -- Deploy edit quality
campaign for Romanian Wikipedia
39. https://phabricator.wikimedia.org/T156303 -- Deploy "Discussion
quality" campaign in wikilabels
40. https://phabricator.wikimedia.org/T152542 -- Undefined method
ORES\Hooks::getDamagingThreshold()
41. https://phabricator.wikimedia.org/T146681 -- Quiet TimeoutError in
celery logging
42. https://phabricator.wikimedia.org/T154168 -- Quantity changes broke ORES
43. https://phabricator.wikimedia.org/T154897 -- Chinese translations are
not being loaded
44. https://phabricator.wikimedia.org/T155500 -- Fatal exception of type
"DBQueryError" on sorting ORES contributions
45. https://phabricator.wikimedia.org/T157078 -- ores logspam: Model
contains an error
46. https://phabricator.wikimedia.org/T155482 -- Set up monitoring for ORES
redis database
47. https://phabricator.wikimedia.org/T157135 -- Fix broken beta-labs deploy
48. https://phabricator.wikimedia.org/T154436 -- Split wheels repo into
Prod/WMFLabs branches and maintain independence
49. https://phabricator.wikimedia.org/T155931 -- Minify json responses
50. https://phabricator.wikimedia.org/T154865 -- assets url return empty
string
51. https://phabricator.wikimedia.org/T147708 -- Artificial Intelligence to
build and navigate content
52. https://phabricator.wikimedia.org/T147710 -- What should an AI do you
for you? Building an AI Wishlist.
53. https://phabricator.wikimedia.org/tag/artificial-intelligence/
54. https://phabricator.wikimedia.org/T147929 -- Algorithmic dangers and
transparency -- Best practices
55. https://phabricator.wikimedia.org/T148690 -- Where to surface AI in
Wikimedia Projects
56. https://phabricator.wikimedia.org/T145024 -- Licensing of labeled data
57. https://phabricator.wikimedia.org/T156052 -- Add notice of CC0 status
of Wikilabels data to UI & Docs
58. https://phabricator.wikimedia.org/T156273 -- Identify baseline api.php
Action API consumption
59. https://phabricator.wikimedia.org/T157470 -- Draft proposal/pitch for
ORES resourcing
60. https://phabricator.wikimedia.org/T150855 -- Gather assets for post
about ORES review tool including ERI filters
61. https://phabricator.wikimedia.org/T150858 -- Post about ORES review
tool including ERI filters
Sincerely,
Aaron from the Revision Scoring Scoring Platform team
The 'master' branch of MediaWiki-Vagrant will now provision and
maintain Debian Jessie based VMs. The next time you fetch
mediawiki/vagrant.git changes to your laptop or Labs VM and try to run
`vagrant up` or `vagrant provision` it will complain that your Vagrant
managed VM is not running the correct base operating system.
There are two ways to deal with this:
1) Follow the instructions given to delete and recreate your VM. This
is the most awesome long term thing to do, but may be annoying in the
short term. If you have heavily customized the wikis running in your
VM it is up to you to figure out how to backup things before you
destroy your current VM and then restore the changes after you build a
new Jessie-based VM.
2) Switch your git checkout to the 'trusty-compat' branch of
mediawiki/vagrant.git. This trades short term efficiency for long term
pain. The trusty-compat branch is not going away any time soon, but it
will drift out of sync with Puppet changes on the master branch.
See <https://phabricator.wikimedia.org/T136429> for known issues with
the Jessie conversion. The only two I'm aware of at this time are
related to fundraising (T154264) and an NFS permissions mapping
problem when installing ChangeProp on a VM with OSX as the host
operating system and NFS shares enabled for Vagrant (T158617).
Bryan
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA
irc: bd808 v:415.839.6885 x6855
Dear Wikimedians,
If you are a representative of an Affiliate, committee, or other
organized group in the Wikimedia Movement, please read this email
carefully and forward it to your peers.
I am writing you today in my role as the Movement Strategy Lead for
organized groups (Track A), and would like to encourage you to
actively participate in Wikimedia’s movement strategy process.
Together with you, we would like to find answers to the question “What
do we want to build or achieve together over the next 15 years?”
https://2030.wikimedia.org is the universal start page to the strategy
portal on Meta.
== This is our time! ==
This is the time many of us have been waiting for for years. I would
love to see each and every one of you make your voice heard and take
the chance to shape the future of our movement together.
== Timeline and process ==
The timeline up to Wikimania 2017 is organized in 3 consecutive
discussion cycles that are designed to explore, cluster and sharpen
the strategic direction and define 3-5 focus areas for the movement.
After Wikimania, we will discuss the movement structure, roles, as
well as 3-5-year goals and starting in 2018, organizations will
incorporate the findings into their strategic and annual planning.
Today, we are kicking off cycle 1 which is running until 15 April.
Organized groups will find all relevant information on the Meta page
for Track A.[1]
== Get involved! ==
Last week I reached out to all Chairs and EDs of Affiliates as well as
to active members of other organized groups and committees. While I
have heard from many, I would like to remind everyone to appoint a
discussion coordinator for your group that will act as the linker to
the strategy process.[2][3][4]
As an organized Group, you can invite all your stakeholders to join
your conversation: Board and staff members, members, external partners
and allies as well as members of your communities. Track A is closely
connected to Track B (Individual Contributors)[5], as many organized
Groups have close bonds with their local or thematic communities. We
encourage Track A and Track B coordinators to sync on their plans.
Your conversations can happen on- and offline. To host a conversation,
please read the discussion guide[6] that provides material to prepare,
conduct and document each conversation in each format. Before you and
your peers enter the conversation, please make yourself familiar with
the briefing[7] which provides a high-level overview of what we know
about the future and about our movement today.
I also look forward to seeing many of you at the Wikimedia Conference
in Berlin where we will discuss our future, generate thematic
statements, identify keywords and create thematic clusters of our
ideas. The rough outline of the program will be adjusted in the coming
days.[8]
Let’s make this happen! Please reach out to me with any question or
feedback you might have.
Sincerely,
Nicole
[1] https://meta.wikimedia.org/wiki/Special:MyLanguage/Strategy/Wikimedia_movem…
[2] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017/Toolkit/Di…
[3] Sign-up to become a Discussion Coordinator here:
https://docs.google.com/a/wikimedia.de/forms/d/e/1FAIpQLScyzOcB9FmgWWrenoe0…
[4] Overview of organized groups’ discussions
https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017/Outreach/L…
[5] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017/Track_B
[6] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017/Toolkit/Di…
[7] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017/Process/Br…
[8] https://meta.wikimedia.org/wiki/Wikimedia_Conference_2017
--
Nicole Ebber
Adviser International Relations
Movement Strategy Track Lead: Organized Groups
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.
V. Eingetragen im Vereinsregister des Amtsgerichts
Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig
anerkannt durch das Finanzamt für Körperschaften I Berlin,
Steuernummer 27/029/42207.
https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-03-15
= 2017-03-15=
contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering
== Call outs ==
* QUnit failures with Jenkins (ie https://phabricator.wikimedia.org/T153038
) is poping up time-to-time. Some more eyes are needed.
* DBAs asking for more eyes on
http://phabricator.wikimedia.org/T159319 (security
bug) clicking certain links 5 times brings down a 512GB mediawiki database
(either security, performance or mediawiki-core)
=== Technology ===
== Analytics ==
* Blocked on DBA chnages for eventlogging change, we wnat to have user
agent parsed on db but length is over column limit and it gets truncated:
https://phabricator.wikimedia.org/T160454
- Finished cluster upgrade to new cloudera, no major disruptions to
existing jobs but we had to modify our most complicated jobs, the edit
reconstruction
- Many tweaks to piwik (system we use to count pageviews to things such
us annual report) so it can sustain usage, we had to ask iOS team to lower
request count.
- Prototype for new wikistats 2.0 frontend on the works, using vue.js,
just storyboard for now, no real data:
*https://analytics-prototype.wmflabs.org/#/*
<https://analytics-prototype.wmflabs.org/#/>
- People are using* event streams* data to build cool things, blogpost
on the way:*https://sachaysl.github.io/wikimedia-challenge/*
<https://sachaysl.github.io/wikimedia-challenge/>
== Product ==
=== Reading ===
====Web====
* Last week:
** This sprint:
https://phabricator.wikimedia.org/tag/reading-web-sprint-93-%F0%9F%94%8D%F0…
** PagePreviews instrumentation for monitoring performance via statsv.
** Fixed PagePreviews IE quirks and other non-IE issues.
* Next week:
** Next sprint: https://phabricator.wikimedia.org/project/view/2622/
** Upgrade MF browser tests to work with the new version of Selenium.
** PagePreviews instrumentation and other bugfixes
** Print styles
====Android====
* Last week:
** Many UI enhancements for better offline support, especially to reading
lists
** New saved page cache implementation still in progress T156917
** Continuous integration Android SDK upgrade debugging (with releng
support!)
** Started using kanban release boards officially
* Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
** Continue improving the offline experience
** Start 2.5.x release https://phabricator.wikimedia.org/project/board/2667/
==== iOS ====
* Last Week
** 5.4 https://phabricator.wikimedia.org/project/view/2326/
*** Bux fixes and polish on Places
*** Continued work on login and 2FA (two-factor authentication)
* This week
** Continue work on 5.4
*** Places updates for iPad
*** JS consolidation w/ Android
*** Final bug fixes for release early next week
====Reading Infrastructure====
* deploying PageViewInfo this week https://phabricator.wikimedia.org/T125917
* TemplateStyles:
** trying to wrap up TemplateStyles RfC, could use more feedback:
https://phabricator.wikimedia.org/T155813
** https://gerrit.wikimedia.org/r/#/q/project:css-sanitizer
(MediaWiki-independent
CSS parser/sanitizer library) could use reviews
* ORES:
** https://gerrit.wikimedia.org/r/#/c/336963/ (hooks + data attributes for
change list items) could use reviews
* MCS: https://phabricator.wikimedia.org/project/view/2445/
** Bug fixes for T159252 (syntax error) and T159860 (reflinks with : in
title)
** More languages for TFA
====Community Tech====
* XTools rewrite going well, working Articleinfo and Top edits
http://tools.wmflabs.org/xtools-dev/articleinfo
* Improving LoginNotify https://phabricator.wikimedia.org/T160031
* More Popular Pages bot improvements
https://phabricator.wikimedia.org/T159774https://phabricator.wikimedia.org/T160201
* Still working on cookie blocks (very difficult to test)
https://phabricator.wikimedia.org/T152952
* Range Contributions scrapped from CommTech sprint, now a 10% / volunteer
project https://phabricator.wikimedia.org/T145912
=== Editing ===
==== UI Standardization ====
* This week
** Bringing WikimediaUI Base Less variable file to core
** Some additions to the style guide, both technical and content-wise
https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/
** mediawiki.UI checkboxes and radios in alignment with OOjs UI
* Updates
** OOjs UI:
*** Release of v0.20.0
**** Huge improvement on/resolving almost entirely `em` sizing based
interface issues across browsers
**** Also including 11 UI touching patches (icon deprecations, removed icon
flags, color amendments, vertical rhythm)
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
==== Parsing ====
[[ Subbu won't be around .. but update posted here ]]
* Visual diff testing and bug fixing of RemexHTML use in core as a Tidy
replacement almost complete. We are in the process of figuring out rollout
of ParserMigration extension for editors to experiment with this
replacement. Tidy will be gradually replaced as we get more experience and
feedback.
* Linter extension was deployed to testwiki last week (
https://test.wikipedia.org/wiki/Special:LintErrors ). This week, it will be
rolled out to small wikis.
* Parsoid devs, Brion, and TheDJ met up last week to fine tune audio/video
HTML spec in Parsoid and resolved some questions. Implementation moving
ahead. We expect to finish this up, test and deploy this sometime early
next quarter.
==== Language ====
* Work on OOjs UI migration for ContentTranslation continue.
==== Collaboration ====
* Blocked
* Blocking
* Updates
** RC filters:
** Backend merged.
** ORES RC filters merged
** Wikidata RC filters in progress
** Fixes and improvements continuing, release now targeted for March 28
=== Discovery ===
* No blockers
* Upgrade to ES5 started with upgrading codfw cluster. Master code now
requires ES5.
* Working on analyzing sister wiki search results (
https://phabricator.wikimedia.org/T156300)
* Working on Wikidata search (see
https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Wikidata_searchif
interested)
* Discovery Dashboards (https://discovery.wmflabs.org/) updated
== Technology ==
=== Analytics ===
* Blocked on DBA chnages for eventlogging change, we wnat to have user
agent parsed on db but length is over column limit and it gets truncated:
https://phabricator.wikimedia.org/T160454
- Finished cluster upgrade to new cloudera, no major disruptions to
existing jobs but we had to modify our most complicated jobs, the edit
reconstruction
- Many tweaks to piwik (system we use to count pageviews to things such
us annual report) so it can sustain usage, we had to ask iOS team to lower
request count.
- Prototype for new wikistats 2.0 frontend on the works, using vue.js,
just storyboard for now, no real data:
*https://analytics-prototype.wmflabs.org/#/*
<https://analytics-prototype.wmflabs.org/#/>
- People are using* event streams* data to build cool things, blogpost
on the way:*https://sachaysl.github.io/wikimedia-challenge/*
<https://sachaysl.github.io/wikimedia-challenge/>
=== Security ===
* Darian and Brian were out last week -- catching up on requests
* More security reviews are being scheduled
* Ongoing: expanding CSP (content security policy) testing
* Testing SVG improvements
* Backporting fixes for upcoming security release
=== Services ===
* Blockers: none
* Updates:
** Stabilised many RESTBase endpoints
*** Many endpoints are now officially "Stable" (
https://www.mediawiki.org/wiki/API_versioning#Stable )
** Updating to new kafka node driver as we speak
** Fixing up summary endpoint for hovercards
=== Technical operations ===
* '''Blocked'''
** http://phabricator.wikimedia.org/T159319 clicking certain links 5 times
brings down a 512GB mediawiki database (either security, performance or
mediawiki-core)
* '''Blocking'''
** None
* '''Updates
** ORES infrastructure ready for active/active in CODFW
** Precise deprecation ongoing
=== RelEng ===
* '''Blocking'''
** Will poke team about qunit test fails in callouts
* '''Blocked'''
** None
* '''Updates'''
** 1.29.0-wmf.16 this week https://phabricator.wikimedia.org/T158997
=== Fundraising Tech ===
* No external blockers
* DonationInterface
** Reducing constructor bloat and other tech debt
https://phabricator.wikimedia.org/T160385
* CentralNotice
** Banner Sequencing https://phabricator.wikimedia.org/T144453
** Reducing cache purges for https://phabricator.wikimedia.org/T154954
* CiviCRM
** Finishing up the address fixes https://phabricator.wikimedia.org/T158268
* Opsy
** https://phabricator.wikimedia.org/T159289
** Trying to get our last (and most complicated) Precise box migrated to
Jessie
** Now urgent, since PHP5.3 is gone from continuous integration (and
Precise EOLs next month)
** Casey's having trouble getting Jenkins running on Jessie
** Releng: Casey may ask for help with ^^^
** Also looking at writing wrapper scripts to use cron instead
Forwarding.
Pine
---------- Forwarded message ----------
From: Toby Negrin <tnegrin(a)wikimedia.org>
Date: Wed, Mar 15, 2017 at 7:50 AM
Subject: [Wikimedia-l] Product draft goals posted on mediawiki
To: Wikimedia Mailing List <wikimedia-l(a)lists.wikimedia.org>
Hi everyone --
I wanted to let you know that the product team has posted our draft goals
for next quarter (the fourth quarter of the Foundation's fiscal year aka
Q4) up on mediawiki:
https://www.mediawiki.org/wiki/Wikimedia_Engineering/
2016-17_Q4_Goals#Product
Please take a look and let us know your thoughts on the talk page. We'd
like to lock these goals and make a commitment to them in a week or two.
thanks,
-Toby
_______________________________________________
Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/
wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/
wiki/Wikimedia-l
New messages to: Wikimedia-l(a)lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
<mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>
https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-03-08
= 2017-03-08 =
Call outs:
* FR-Tech:Andrew Green would like some help with a couple of CentralNotice
issues
** Advice from traffic / Varnish gurus on cache purges:
https://phabricator.wikimedia.org/T154954
** Help from core team with message cache update slowness
https://phabricator.wikimedia.org/T158084
* Reading Infrastrucuture needs help with reviewing
https://gerrit.wikimedia.org/r/#/q/project:css-sanitizer and
https://gerrit.wikimedia.org/r/#/c/336963/ .
* Releng looking for some review on [
https://gerrit.wikimedia.org/r/#/c/328191/ Selenium tests ported from Ruby
→ Nodejs]
* Ops: fluorine deprecated in favour of mwlog1001
https://phabricator.wikimedia.org/T123728
== Product ==
=== Reading ===
====Android====
* Last week:
** Upgrade to new Mapbox beta merged
** New saved page cache implementation still in progress T156917
** Reading list UI improvements and several tech debt patches
* Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
** Continue improving the offline experience
====Reading Infrastructure====
* working on TemplateStyles, ORES
** about to wrap up TemplateStyles RfC:
https://phabricator.wikimedia.org/T155813
** https://gerrit.wikimedia.org/r/#/q/project:css-sanitizer
(MediaWiki-independent
CSS parser/sanitizer library) could use reviews
** https://gerrit.wikimedia.org/r/#/c/336963/ (hooks + data attributes for
change list items) is a blocker for ORES, could use reviews
* MCS: finished spike to figure out how to expand TFA and other feeds to
more languages. Adding more languages for TFA.
==== Web ====
* We've been working towards making PagePreviews available in production:
fixing bugs, improving the JS stack (T156333) and creaing a dashboard to
track the performance in real-time (T157111).
* We'll continue with the above work this week.
==== iOS ====
* Last Week
** 5.4 https://phabricator.wikimedia.org/project/view/2326/
*** VoiceOver support for Places (accessibility)
*** Continued work on login and 2FA (two-factor authentication)
*** Shipped Beta to external users
* This week
** Continue work on 5.4
*** Bug fixes and polish on Places
*** Continue work on login and 2FA (two-factor authentication)
*** Other fixes and enhancements
==== Community Tech ====
* No blockers
* Refinements to Popular Pages bot https://phabricator.wikimedia.org/T159774https://phabricator.wikimedia.org/T159776
* Almost done with cookie blocks https://phabricator.wikimedia.org/T152952https://phabricator.wikimedia.org/T152076
* Volunteer helping with a new Special:AutoblockList page
https://phabricator.wikimedia.org/T146414
* XTools Articleinfo moving along https://phabricator.wikimedia.org/T157706
* Testing LoginNotify on beta cluster
https://phabricator.wikimedia.org/T158878
* Added a CirrusSearch "source" to Massviews
https://phabricator.wikimedia.org/T159858
=== Editing ===
==== Parsing ====
* Sorry about recent absences -- between travel and vacation, couldn't show
up regularly
* Linter extension will be enabled on test wikis this week and we'll move
on from there
* <audio> / <video> support in Parsoid coming along
* Language variant support / fixes ongoing -- using visual diff tests to
identify bug not caught by parser tests and other tests.
* RemexHTML (native PHP HTML5 parser) ready; integrated with Mediawiki Core
as a Tidy replacement along with necessary Tidy-compatibility passes. Will
run visual diff tests this week before we can start thinking about
deploying this.
==== UI Standardization ====
* This week
** Work on contents of style guide
* Updates
** General
*** Incorporating the web fonts into style guide with a future-proof
technological solution, which could work as boilerplate for similar
projects https://phabricator.wikimedia.org/T155128
** OOjs UI:
*** Release of v0.19.5, among others including 6 UI related patches (new
icons, keyboard-focus improvs, OutlinedBookletDialog visual order)
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
==== Collaboration ====
* Blocked
* Blocking
* Updates
** RC Filters
*** RC Filters Beta Feature
*** More AJAX support for the RC Filters UI
*** Loading animation
*** More UX elements and bug fixes
*** Many bug fixes, including:
**** Select filter when searching and add it on 'enter'
**** Highlight improvements
** Echo bug fixes
** Maintenance: New script to init a user preference based on another
preference
** ORES: Fetch thresholds from live stats for filters
== Infrastructure ==
=== Analytics ===
* Troubleshooting the upgrade to CDH 5.10 is wrapping up, we have a
work-around for the last remaining problem with oozie/spark/hive not
working perfectly together
* Working on deploying historical pageview numbers (before May 2015) to AQS
* Working on inconsistency in how dates are handled in AQS, almost done
(T156312)
* Prototype (fake data, fake everything) for Wikistats 2.0 using Vue.js is
being worked on here: https://github.com/milimetric/wikistats-prototype,
not sure on best practices yet but enjoying Vue development.
=== Research ===
* Starting work on missing section recommendations in support of stub
expansion
** https://phabricator.wikimedia.org/T159227
=== Security ===
* Reviews:
** Timeless skin
** Extension:StopForumSpam
** On this day mobile endpoint
** Extension:FileExporter
* Darian away at IFF in Valencia, Spain March 6th-10th; available via
e-mail and Signal (971-401-8338)
* Brian away at Enterprise Mediawiki Con March 7th-10th in D.C.
=== Services ===
* Blockers: none
* Updates:
** 2 machines added to SCB in codfw: scb2005 and scb2006
*** All services deployed there, all scap configs updated, no action
required
*** Since that deploy all services do short-term DNS caching
=== RelEng ===
* '''Blocking'''
** None?
* '''Blocked'''
** [https://gerrit.wikimedia.org/r/#/c/328191/ Selenium tests ported from
Ruby → Nodejs] Could use review
** [https://phabricator.wikimedia.org/T159332 PuppetDB in beta flapping]
=== Tech Ops ===
* Blockers: none
* Blocked: none
* Updates:
** fluorine deprecated in favour of mwlog1001
** Auditing capacity in codfw before April datacenter switchover
** DNS discovery https://phabricator.wikimedia.org/T149617
** Precise deprecation work continues in prod and labs
=== Fundraising Tech ===
* No blockers
* DonationInterface
** deployed first use of new Ingenico API
https://phabricator.wikimedia.org/T128692
** fixing display of unsupported currency conversion notice:
https://phabricator.wikimedia.org/T98447
* CiviCRM
** fixing some blank address bugs: https://phabricator.wikimedia.org/T159402
** more tweaks to matching gift import:
https://phabricator.wikimedia.org/T115044
* CentralNotice:
** Need advice from traffic / Varnish folks on cache purges:
https://phabricator.wikimedia.org/T154954
** Need help from core team with message cache update slowness
https://phabricator.wikimedia.org/T158084
* Finishing up PCI compliance paperwork
=== Discovery ===
* No blockers
* ES5 upgrade process starting Monday with codfw cluster, see full plan at
https://phabricator.wikimedia.org/T157479
** This will also enable run-time indexing for completion suggester
https://phabricator.wikimedia.org/T154503
* Results from sister wiki search A/B tests being analyzed
* Working on wikidata search
== German Technical Wishlist ==
* Working with suggestions we got to make RevisionSlider touch friendly.
* Working out a plan for an actual Special:Search form extension.
== Wikidata ==
* Figuring out how to update our giant wb_terms table (T159851)
* Migrated all special pages to OOUI (T48248), working on also using OOUI
on the undo interface
* Baseline to link to Data:….map pages on Commons is done (T57549)
* Review-queue we build to fully support new entity types is pretty much
merged.
* Working out a plan for sub-entity support for Wiktionary.
Hi,
I am Shanika Ediriweera and I am a 4th year Computer Science and
Engineering undergraduate of University of Moratuwa. I worked as an intern
in an opensource software company(WSO2 Inc.) for my 3rd year Industrial
training. I have experience in programming, opensource contributing and
problem solving.
I have contributed to mediawiki as well. Profile link -
https://phabricator.wikimedia.org/p/Shanikae/
I would like to take up the project 'Single image batch upload' (
https://phabricator.wikimedia.org/T138464) for GSoC 2017.
How should I get started?
What steps do I need to follow?
Best Regards,
Shanika Ediriweera
Undergraduate
Dept. of Computer Science & Eng.
University of Moratuwa
Recent leaks suggest almost all commercial x86 processors have been
compromised by closed-source back doors which enable eavesdropping and DRM
copy protection which in turn inhibits fair use.
On Mon, Mar 13, 2017 at 4:41 PM Lodewijk <lodewijk(a)effeietsanders.org>
wrote:
> Hi Jim,
>
> Could you clarify the relationship with Wikimedia on this? I'm missing the
> link.
>
> Best,
> Lodewijk
>
> 2017-03-13 23:03 GMT+01:00 James Salsman <jsalsman(a)gmail.com>:
>
> > Please join me in asking AMD to open-source the PSP (backdoor) in
> > their chips -- a chance to regain secure x86 hardware.
> >
> > https://www.change.org/p/advanced-micro-devices-amd-
> release-the-source-code-for-the-secure-processor-psp
>
>