Hello all,
We would like to announce that we are going to upgrade both hardware and OS of the production Gerrit server.
We will be doing the maintenance on October 21th, 2019 at 12pm PST time (7pm UTC time, 8pm UK time) [1].
This brings increased resources such as CPU and RAM. We will also be doing a dist upgrade from jessie to buster.
We have outgrown our current server (cobalt) so you may notice improvements due to increased resources.
The jessie server "cobalt" will be replaced by "gerrit1001" on buster, skipping stretch.
For more details or to report issues please see the ticket [2] and topic branch gerrit1001 [3].
[1] https://wikitech.wikimedia.org/w/index.php?title=Deployments&type=revision&…
[2] https://phabricator.wikimedia.org/T222391
[3] https://gerrit.wikimedia.org/r/q/topic:%22gerrit1001%22+(status:open%20OR%2…
On behalf of Patrick, Daniel and Tyler.
(Re-send to wikitech-l, first attampt had wrong address.)
The 1.35.0-wmf.3 version of MediaWiki is blocked[0].
The new version is not deployed anywhere[1], and can proceed no
further until these issues are resolved:
* scap sync failed, database error - https://phabricator.wikimedia.org/T236166
Once these issues are resolved train can resume. If these issues are
resolved on a Friday the train will resume Monday.
Thank you for your help resolving these issues!
-- Your humble train toiler
[0]. <https://phabricator.wikimedia.org/T233851>
[1]. <https://tools.wmflabs.org/versions/>
The 1.35.0-wmf.2 version of MediaWiki is no longer blocked[0]!
Thanks to Krinkle, Mobrovac, Nikerabbit, and everyone else who worked on
unblocking the train.
We plan to deploy the new version to group2 today.
-- Your humble train toiler
[0]. <https://phabricator.wikimedia.org/T233850>
--
Jeena Huneidi
Software Engineer, Release Engineering
Wikimedia Foundation
Hey,
Today I made some phabricator helpers, I thought these might be useful for
others.
The first is a web page that gives you an overview of changes in any sprint
board in the past N days (default value of N is seven). This is useful when
you want to have a quick look of things that has been done to show them off
in SoS, weekly updates, etc. Here's an example with performance team board:
[1], The default boards are Wikidata sprint boards (like [2]) let me know
if encounter any issues, have any suggestions or if you want to add your
board to the default list. It's based on a CLI tool my colleague made a
while ago. Of course it's easily doable to query them directly in
phabricator but this combines several queires (things that are picked up,
things that are waiting for review, etc.) into one small place, the output
is slightly shorter and cleaner.
If you know what Herald [3] is, you can skip this paragraph. Herald is set
of rules in phabricator that gets automatically applied on tasks, patches,
or anything. For example, if you add a ticket and add one of sprint boards
of wikidata but you forget to add the umbrella project (#Wikidata [4]), it
happily adds the umbrella project to the ticket. If you want to add some
Herald rules to improve your workflow, let me know.
Herald, albeit being very powerful, has one limitation, it doesn't move
tasks to another column, this means if a task is being worked on (like it's
part of a sprint) Herald can't move it to "In progress" column in the
umbrella project.
You probably know my bot "Maintaince bot", It continuously spams you,
Today, I made it to handle column moving as well. So it's going to spam you
even more (sorry) for tasks being moved around. You can disable
notification for column moves in your settings in phabricator or set a
filter for archiving maintenance bot emails. But if you want to add more
rules to it (if you have been moving tasks around manually, you probably
know it's a very tedious work). Let me know the rules and the column moves,
and I add it to my bot as well.
[1]
https://tools.wmflabs.org/phabricator-reporter/sprint.php?project=&other=pe…
[2]:
https://tools.wmflabs.org/phabricator-reporter/sprint.php?project=RL+Module…
[3]: https://phabricator.wikimedia.org/herald/
[4]: https://phabricator.wikimedia.org/tag/wikidata/
Best
--
Amir Sarabadani (he/him)
Software engineer
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
https://wikimedia.de
Unsere Vision ist eine Welt, in der alle Menschen am Wissen der Menschheit
teilhaben, es nutzen und mehren können. Helfen Sie uns dabei!
https://spenden.wikimedia.de
Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.
Hello,
I have released a new version of Quibble - version 0.0.39.
It enables the MediaWiki REST API entry point (/rest.php), a feature
required for an API testing tool.
Thank you Clara Andrew-Wani for the patch.
The CI job for mediawiki/tools/api-testing has been updated, other jobs
will be progressively be updated next week.
https://doc.wikimedia.org/quibble/changelog.html
CI Docker images:
docker-registry.discovery.wmnet/releng/quibble-coverage:0.0.39
docker-registry.discovery.wmnet/releng/quibble-fresnel:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch-bundle:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch-php70:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch-php71:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch-php72:0.0.39
docker-registry.discovery.wmnet/releng/quibble-stretch-php73:0.0.39
cheers,
--
Antoine Musso
Hello,
end of last week saw releases of OOUI v0.35.0 and minor follow-up v0.35.1,
they have rolled-out on normal train this week.
The highlights were
- Using `px` where applicable over `em`s.
For most box sizing properties (min-width, min-height, margin, border,
border-radius, padding, box-shadow, outline) `px` unit is sufficient to
still provide accessible user font preference overrides to scale the text.
Additionally, this change is simplifying and speeding up building
interfaces for designers and developers. See
https://phabricator.wikimedia.org/T220671 for further details. This change
doesn't affect any current interfaces, it should result in no rendering
differences at normal environment settings.
- `infuse-by-id` feature got removed, it has been deprecated since v0.29.7
and has, to our knowledge, only been used internally any more. Use an
HTMLElement or jQuery collection instead. Please verify that you are not
using the feature any more.
You can find details on additional new features, code-level, styling and
interaction design amendments, and all
improvements since v0.34.0 in the full changelog[0].
If you have any further queries or need help dealing with breaking
changes, please let me know.
As always, interactive demos[1] and library documentation is available
on mediawiki.org[2], there is comprehensive generated code-level
documentation and interactive demos and tutorials hosted on
doc.wikimedia.org[3].
OOUI version: 0.35.0
MediaWiki version: 1.35.0-wmf.2
Date of deployment to production: Regular train, starting Tuesday 15 October
[0]-
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
<https://doc.wikimedia.org/oojs-ui/master/demos/#widgets-mediawiki-vector-ltr>
[1]-
https://doc.wikimedia.org/oojs-ui/master/demos/#widgets-mediawiki-vector-ltr
[2] - https://www.mediawiki.org/wiki/OOUI
[3] - https://doc.wikimedia.org/oojs-ui/master/
Best,
Volker
--
Senior UX Engineer
Wikimedia Foundation
volker.e(a)wikimedia.org | @Volker_E
The 1.35.0-wmf.2 version of MediaWiki is blocked[0].
The new version is deployed to group(s) 0 & 1[1], but can proceed no
further until these issues are resolved:
* Some revisions' contents are incorrect in the cache - wrong contents
shown in history & diffs - https://phabricator.wikimedia.org/T235188
Once these issues are resolved train can resume. If these issues are
resolved on a Friday the train will resume Monday.
Thank you for your help resolving these issues!
-- Your humble train toiler
[0]. <https://phabricator.wikimedia.org/T233850>
[1]. <https://tools.wmflabs.org/versions/>
--
Jeena Huneidi
Software Engineer, Release Engineering
Wikimedia Foundation
Hi,
for HTML version see
https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-10-16
Željko
--
= 2019-10-16 =
== Callouts ==
* Language team ->Core(?): Blocked on [[phab:T235188#5574342]]
* SRE DBAs
** requested read-only time for enwiki 14th Nov to switchover the primary
database master - [[phab:T234801]], already done
** s6 primary master switchover (read-only required) 19th Nov 05:00 AM UTC
* DBAs, Performance: Heads up that PI will be pinging for reviews/review
updates for the MachineVision extension later this week, as soon as the
code settles a bit (DBA review: [[phab:T227355]], Perf review:
[[phab:T230813]] )
== Product ==
=== Editing ===
* Updates:
** Catch errors during document initialization
** Enforce that some files must not use the `ve` global (task
[[phab:T228684]])
** Parse relative hrefs on image nodes like on regular links (task
[[phab:T193253]])
** Fix Vector wikitext surface padding overrides when using custom browser
font-size (task [[phab:T222217]])
=== Growth ===
* Updates:
** Initial structure for Suggested Edits module
** Do not align the bottom of the homepage columns (task [[phab:T232420]])
** StartEditing: Remove special message for add-change response (task
[[phab:T232419]])
=== iOS native app ===
* Updates:
** 6.5 in active development - [[phab:project/view/4245]]
***bug fixes
*** History & diffs feature
**** Core Platform working on Rest APIs for this
=== Android native app ===
* Updates:
** Working actively towards completion of Suggested edits V3
** Working with the PI team to update backend support for the same.
=== Product Infrastructure ===
* Updates:
** MachineVision extension work in progress, still aiming to deploy to prod
by end of month
** Still working to resolve [[phab:T229286]] ("'worker died, restarting'
mobileapps issue")
=== Structured Data ===
* Blocked by:
** Wikidata/WMDE: [[phab:T229280]] following up on [[gerrit:534536]]
** Wikidata/WMDE: [[phab:T223792]]
* Blocking:
** Search: RecentChange support for SDC: [[phab:T230862]] (actually the
higher level task on which we are blocked: [[phab:T221917]])
* Updates:
** Machine Vision, bugfixing/tidy up on WikibaseMediaInfo
=== Parsing ===
* Updates:
** Fixing bugs in Parsoid/PHP based on HTML string compasion between
Parsoid/JS & Parsoid/PHP. ~1% pages still have diffs that need
investigation / bug fixing.
** Will sync with Services (CPT) and SRE to finalize deployment plans for
initial deployment (no live client traffic) to identify any last lingering
Parsoid crashers OR performance problems in a production context.
=== Language ===
* Blocked by:
** Language->Core(?) Blocked on [[phab:T235188#5574342]]
* Updates:
** CX going out of beta in some Wikipedias next week.
=== UI Standardization ===
* Updates:
** OOUI v0.35.0 and 0.35.1 with one small revert released eo last week,
latter already on this week's train
** Design Style Guide:
*** Progressing “Components“ section
*** Change to Git lfs for large binary files. If you've cloned the dir,
throw away your current clone, re-clone it.
https://github.com/wikimedia/WikimediaUI-Style-Guide In your repo directory
type `git lfs pull`. If the lfs app is not installed follow
https://github.com/git-lfs/git-lfs/wiki/Installation
== Technology ==
=== Analytics ===
* Blocking:
** Search: [[phab:T229882]]
=== Fundraising Tech ===
* Updates:
** Refining annual summary receipt for recurring donors: [[phab:T195907]]
** Restoring data lost during manual merges: [[phab:T232636]]
** Looking into reconciliation file discrepancies from S. Amer / India
processor: [[phab:T235212]]
** Might need to add more params to CentralNotice banner hide cookies:
[[phab:T235204]]
** Refining treatment of opt in and opt out data: [[phab:T234925]]
** Looking into errors on Amazon Pay donation form: [[phab:T234538]]
== Core Platform ==
* Blocked by:
** SRE [[phab:T235478]]
* Blocking:
** Wikidata/WMDE: In the Data Bridge work (editing Wikidata items from
Wikipedia) we have encountered problems with Special:EntityData serving
stale (old) data. The problem is quite old: [[phab:T128486]]. We are
looking for a team/person with whom we could get some clarity on the
current state of the cache solutions on WMF cluster, and figure out how to
get [[phab:T128486]] unstuck.
** Scoring: Review of Jade API [[phab:T199834]] (Can we get a high level
review in the short term? We want to build on this but not dig a hole.)
** Language->Core(?) Blocked on [[phab:T235188#5574342]]
* Updates:
** history API done
** working on stretch goals
** echo notification storage
=== Engineering Productivity ===
==== Performance ====
* Blocked by:
** SRE
*** PHP7 fatal-error reports missing from type:mediawiki in Logstash. –
[[phab:T234283]]
*** mwdebug1002 might need to be reprovisioned, failing to report messages
to Logstash. – [[phab:T214734]]
==== Release Engineering ====
* Updates:
** v3 of CI arch document for new CI wants review and feedback
[[User:LarsWirzenius/NewCI]]
** Train Health
*** Last week: 1.35.0-wmf.1 - [[phab:T233849]]
*** This week: 1.35.0-wmf.2 - [[phab:T233850]]
*** Next week: 1.35.0-wmf.3 - [[phab:T233851]]
=== Scoring Platform ===
* Blocked by:
** CPT: Review of Jade API [[phab:T199834]]
* Updates:
** Cleanup for Jade API components and working through review
[[phab:T199834]]
*** Naming conflicts [[phab:T235003]]
*** Central Auth (Found CentralAuth.lookup()!)
** Jade
*** Continuing iterations on Jade designs (based on Design Review feedback)
[[phab:T212370]]
*** Reached out to Front-End Arch. WG. for recommendations for Jade UI.
We got a response from Mark Holmquist and will be going to Eric Gardner for
specific advice and reviewing SDC code (WikibaseMediaInfo)
** Completed second major review of Revscoring refactoring for Session
orientation [[phab:T231214]]
** Firmed up cross-team deliverables for Topic Modeling work.
[[phab:T235181]]
** Merged new features for Basque Language [[phab:T223788]]
** ORES celery workers struggling in Cloud VPS. Still looking into it.
[[phab:T234926]]
=== Search Platform ===
* Blocked by:
** Structured Data: RecentChange support for SDC: [[phab:T230862]]
(actually the higher level task on which we are blocked: [[phab:T221917]])
** Analytics: [[phab:T229882]]
* Updates:
** Error when searching for exact phrase on English Wikipedia:
"Precondition failed: Must have a resultset set": [[phab:T234445]]
** Deploy A/B Test for Glent Method 0 [[phab:T233211]]
** Optimize the Sanitizer to produce a single job if all elasticsearch
clusters are to be updated: [[phab:T233587]]
=== Security ===
* Updates:
* In Progress:
** GRC Tool Eval
** MachineVision extension review
** FileImporter extension review
** Data Map update submission review
=== Site Reliability Engineering ===
* Blocking:
** Performance
*** PHP7 fatal-error reports missing from type:mediawiki in Logstash. –
[[phab:T234283]]
*** mwdebug1002 might need to be reprovisioned, failing to report messages
to Logstash. – [[phab:T214734]]
** Core Platform SRE [[phab:T235478]]
* Updates:
** Started working on new goals
** Helping CPT get restrouter rate limiting working, deploying echostore
== Wikimedia DE ==
=== Wikidata ===
* Blocked by:
** Not sure who, Core Platform? Mentioned 2 weeks ago already with no
result: : In the Data Bridge work (editing Wikidata items from Wikipedia)
we have encountered problems with Special:EntityData serving stale (old)
data. The problem is quite old: [[phab:T128486]]. We are looking for a
team/person with whom we could get some clarity on the current state of the
cache solutions on WMF cluster, and figure out how to get [[phab:T128486]]
unstuck.
* Blocking:
** Structured Data: [[phab:T229280]] following up on [[gerrit:534536]]
coming up this week
** Structured Data: [[phab:T223792]] - also expect to unblock this week