Due to vandalism/spam in Phabricator [1] I've temporarily enabled the
"Require administrators to approve newly registered accounts" setting.
I'll update when we have turned it back off.
andre
[1] https://phabricator.wikimedia.org/T168142
--
Andre Klapper | Wikimedia Bugwrangler
http://blogs.gnome.org/aklapper/
Follow on to previous email chain improperly named "Setting up multiple
Parsoid servers behind load balancer".
I'm getting much slower response times in a setup with multiple app servers
behind an HAProxy load balancer, versus the same setup with just a single
app server behind the same load balancer. I've setup profiling per
recommendations from this mailing list. [1] is the call graph of a
particularly long request. [2] is a graph showing requests over many page
loads, with the better-performing yellow dots/line being the single app
server. The worst-performing color is with profiling turned on.
This gist [3] has my LocalSettings.php from both app servers and the
included Extensions.php.
Can anyone help me figure this out? Anything else I can provide or certain
things I should test?
Thanks,
James
[1]
https://gist.githubusercontent.com/jamesmontalvo3/5adf207623454c9eff98e9315…
[2]
https://gist.githubusercontent.com/jamesmontalvo3/5adf207623454c9eff98e9315…
[3] https://gist.github.com/jamesmontalvo3/5adf207623454c9eff98e93152b43108
Greetings!
I'm sure you'll like the stuff I've just found for you, here, take a look http://bit.do/dwAq9
Looking forward, Federico Urban
Sent from Mail for Windows 10
Hi everybody,
(With apologies for cross-posting...)
You may have seen the recent communication [1
<https://www.mediawiki.org/wiki/Wikimedia_Engineering/June_2017_changes>]
about the product and tech tune-up which went live the week of June 5th,
2017. In that communication, we promised an update on the future of
Discovery projects and we will talk about those in this email.
The Discovery team structure has now changed, but the new teams will still
work together to complete the goals as listed in the draft annual plan.[2]
A summary of their anticipated work, as we finalize these changes, is
below. We plan on doing a check-in at the end of the calendar year to see
how our goals are progressing with the new smaller and separated team
structure.
Here is a list of the various projects under the Discovery umbrella, along
with the goals that they will be working on:
Search Backend
Improve search capabilities:
-
Implement ‘learning to rank’ [3] and other advanced machine learning
methodologies
-
Improve support for languages using new analyzers
-
Maintain and expand power user search functionality
Search Frontend
Improve user interface of the search results page with new functionality:
-
Implement explore similar [4]
<https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin…>
-
Update the completion suggester box [5]
<https://www.mediawiki.org/wiki/Extension:CirrusSearch/CompletionSuggester>
-
Investigate the usage of a Wiktionary widget for English Wikipedia [6]
Wikidata Query Service
Expand and scale:
-
Improve ability to support power features on-wiki for readers
-
Improve full text search functionality
-
Implement SPARQL federation support
Portal
Create and implement automated language statistics and translation updates
for Wikipedia.org
Analysis
Provide in-depth analytics support:
-
Perform experimental design, data collection, and data analysis
-
Perform ad-hoc analyses of Discovery-domain data
-
Maintain and augment the Discovery Dashboards,[7] which allow the teams
to track their KPIs and other metrics
Maps
Map support:
-
Implement new map style
-
Increase frequency of OSM data replication
-
As needed, assist with individual language Wikipedia’s implementation of
mapframe [8] <https://www.mediawiki.org/wiki/Maps/how_to:_embedded_maps>
Note: There is a possibility that we can do more with maps in the coming
year; we are currently evaluating strategic, partnership, and resourcing
options.
Structured Data on Commons
Extend structured data search on Commons, as part of the structured data
grant [9] via:
-
Research and implement advanced search capabilities
-
Implement new elements, filters, relationships
Graphs and Tabular Data on Commons
We will be re-evaluating this functionality against other Commons
initiatives such as the structured data grant. As with maps, we will
provide updates when we know more.
We are still working out all the details with the new team structure and
there might be some turbulence; let us know if there are any concerns and
we will do our best to answer them.
Best regards,
Deborah Tankersley, Product Manager, Discovery
Erika Bjune, Engineering Manager, Search Platform
Jon Katz, Reading Product Lead
Toby Negrin, Interim Vice President of Product
Victoria Coleman, Chief Technology Officer
[1] https://www.mediawiki.org/wiki/Wikimedia_Engineering/June_2017_changes
[2]
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/…
[3] https://en.wikipedia.org/wiki/Learning_to_rank
[4]
https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin…
[5]
https://www.mediawiki.org/wiki/Extension:CirrusSearch/CompletionSuggester
[6]
https://www.mediawiki.org/wiki/Cross-wiki_Search_Result_Improvements/Testin…
[7] https://discovery.wmflabs.org/
[8] https://www.mediawiki.org/wiki/Maps/how_to:_embedded_maps
[9] https://commons.wikimedia.org/wiki/Commons:Structured_data
Hey,
We are currently having problem with ORES service which sends out time out
errors intermittently. More information can be found in
https://phabricator.wikimedia.org/T167819
We will let you know when the service is back to full capacity.
Best
--
Amir Sarabadani Tafreshi
Software Engineer (contractor)
-------------------------------------
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
http://wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
*Context*
We'd like to have a build script/process for an extension so that I can
perform certain commands to install dependencies and perform optimizations
on the extension sources. For example, on front-end sources.
Some examples could be:
- Installing libraries from bower or npm and bundling them into the
resources folder
- Applying post processing steps to CSS with something like post css
- Optimizing images
We are aware of other projects that have build processes for building
deployables, but not extensions.
Such projects have different ways of dealing with this. A common way is
having a repository called <Project>/deploy and in there you pull from
<Project> and run the build scripts, and that is the repository that gets
deployed.
*Current system*
The current way we usually do this (if we do) is run those build
scripts/jobs on the developers machines and commit them into the git
repository on master.
With this system, if you don't enforce anything in CI, then build processes
may be skipped (human error).
If you enforce it (by running the process and comparing with what has been
committed in CI) then patches merged to master that touch the same files
will produce merge conflicts with existing open patches, forcing a
rebase+rebuild on open patches every time one is merged on master.
*Questions*
Can we have a shared configuration/convention/system for having a build
step on mediawiki extensions?
- So that a build process is run
- on CI jobs that require production assets like the selenium jobs
- on the deployment job that deploys the extension to the beta
cluster and to production
How would it look like? Are any extensions doing a pre-deployment build
step?
Thanks.
Sure. I am logged in on hewiki. Open Wikidata. See not in account view and
central login message. Refresh does not help. I click on login, the login
screen opens, but in a second it returns to the previous page, without an
option for me to enter the password. And than I see the central notice
again and so on... It's unbreak enough? Thank you,
Igal
On Jun 14, 2017 23:55, "Dan Garry" <dgarry(a)wikimedia.org> wrote:
On 14 June 2017 at 21:51, יגאל חיטרון <khitron(a)gmail.com> wrote:
> Thanks. By the way, there is one more problem - it's impossible to login
> Wikidata. Do you think it's unbreak now too?
>
Yes. However, a lot more detail will be needed than "it's impossible to
login". I cannot reproduce this problem, myself.
Thanks,
Dan
--
Dan Garry
Lead Product Manager, Discovery
Wikimedia Foundation
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
The 2018 Wikimedia Hackathon Committee
<https://www.mediawiki.org/wiki/Hackathons/Proposing_a_hackathon#Hackathon_l…>
and
the WMF Developer Relations team are very pleased to announce that Barcelona
, Spain has been chosen for the location of the 2018 Wikimedia Hackathon.
The unconfirmed but likely dates for the hackathon are 18-20 May, 2018.
Amical Wikimedia and the WMF Technical Collaboration team will be
partnering to organize and run the hackathon.
For now, you can find more details here:
*https://phabricator.wikimedia.org/T162836
<https://phabricator.wikimedia.org/T162836>*
Eventually we will update the mediawiki page with more event information:
*https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018
<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018>*
To follow planning progress over the next year you can follow this project
on Phabricator Wikimedia Hackathon 2018 Organization
<https://phabricator.wikimedia.org/project/board/2786/>
For information on the decision process that was followed please check
here:
https://www.mediawiki.org/wiki/Hackathons/2018_Decision_Process
If you have any questions about or suggestions for changes in the decision
process please either email me or comment here
*https://phabricator.wikimedia.org/T157632
<https://phabricator.wikimedia.org/T157632>*.
Hope to see many of you in Montreal and again in Barcelona!
--
Rachel Farrand
Events Program Manager
Technical Collaboration Team
Wikimedia Foundation
