Wikitech-l October 2016

wikitech-l@lists.wikimedia.org

81 participants
86 discussions

Re: [Wikitech-l] Setting up a new Tomcat servlet in production?

by Adam Wight

Hi Shoichi, On Mon, Oct 17, 2016 at 5:25 AM, 魔法設計師 <shoichi.chou(a)gmail.com> wrote: > 1. Acutally speaking it can be launched as a self-server by lightweight > Jetty (the server is Jetty embedded) it will be launched as a nomal java > application. Why I use Tomcat now but not launched by "java -jar XXXX.jar" > ,is because on tools.wmflabs.org , as I remembered, > > I had took the way : > "webservice generic start /data/project/toolname/code/myserver.bash " > > Then, the port binding always faiedl,because the command "port" seemed > always take away parameters belongs to > the java ap owns. > > I couldn't resolve it,so I changed to Tomcat. > Great point--we can serve this using whatever Java web container is most practical! Question for wikitech-l: Which would that be? It looks like we're already running Jetty for Gerrit, is that the best choice for a new service? > 2.About Chinese variable and function names in the server code, after > forking from the upstream , I think it can be translated to English ( > Actually speaking,I have get some works done.) > I'd be happy to help with some of that, maybe we can coordinate the work at some point. Forking just for the sake of translation sounds problematic, though. Maybe I'm wrong about this being a review requirement--or maybe the upstream author would be open to switching to English variable names? Sorry again about the anglocentrism... 3. There are another way : deploying it to an independent server. For > example > > a. use the upstream server like this > <http://%E6%BC%A2%E5%AD%97.%E6%84%8F%E5%82%B3.%E5%8F%B0%E7%81%A3/%E2%BF%B1%E2%BF%B0%E7%81%AB%E7%81%AB%E2%BF%B0%E7%81%AB%E7%81%AB.png?%E5%AD%97%E9%AB%94=%E5%AE%8B%E9%AB%94> > b.use a server maintained by we, Taiwan Chapter, providing service for > C.J.K.V wiki_____ and etc. > I don't think we have the option of using a 3rd-party server, nor relying on a WMF Labs service for production use. We want to have the same uptime and security guarantees as for the wiki itself. The production configuration will probably need to look like a dedicated node or cluster for serving the IDS requests, and we would cache its PNG or SVG responses. Someone here might be able to correct me, though? Thanks again for integrating this tool for us! -Adam

7 years, 6 months

Need review on ContentHandler implementation, Newsletter extension

by Tony Thomas

Hello all, We have a patch https://gerrit.wikimedia.org/r/#/c/295670/, which had its last review almost 28 days back, and is a major blocker for the deployment of Newsletter extension in production. The shift is tracked at T138462[1]. The patch is bit lengthy, and enable the extension to use ContentHandler, which help us use a lot of in-wiki features. I had pulled the change to the labs wiki at http://newsletter-test.wmflabs.org/, which is broken as of now, tracked in T138686[2]. It would be great if you devs can take a look at both the labs instance and the contenthandler change. [1] https://phabricator.wikimedia.org/T138462 [1] https://phabricator.wikimedia.org/T138686 Thanks, Tony Thomas <https://www.mediawiki.org/wiki/User:01tonythomas> Home <http://www.thomastony.me> | Blog <http://blog.thomastony.me> | ThinkFOSS <http://www.thinkfoss.com>

7 years, 6 months

2016W42 ArchCom-RFC meeting: Surveying Cookie/Local Storage Use

by Rob Lanphier

Hi all, At this week's ArchCom Office hour, we'd like to help the WMF Legal team ensure our software development practices don't accidentally cause us to enable all sorts of creepy surveillance because a naive developer adds it. The challenge, of course, is when the royal "we" accidentally add something, and then we deploy it (because that's a pretty routine thing these days). Sometimes, no amount of begging "NO WAIT, WE DIDN'T *MEAN* TO DO THAT" (no matter how sincere) can undo the damage done. Wikimedia seems to have a pretty good reputation in the grand scheme of things, but maintaining that reputation is going to take a lot of vigilance. Zhou Zhou filed an RFC about this: <https://phabricator.wikimedia.org/T145472> <https://www.mediawiki.org/wiki/Requests_for_comment/Survey_Cookies/Local_St…> ...which seems like a good topic for our Wednesday meeting[1]. Zhou is hoping to figure out how to build the alerts necessary to understand when some new form of tracking is created. I'm guessing there's lots of automated and semi-automated monitoring that we could create to make keeping track of new cookie uses easier; let's talk about what's realistic, what WMF needs to invest in directly, and how our wider community of developers can chip in. Our meeting is at its usual time (Wednesday 21 UTC, 14 PDT, 23 CEST) and place (#wikimedia-office). Rob p.s. Obligatory reminder about ArchComStatus page[2] [1]: <https://phabricator.wikimedia.org/E316> [2]: <https://www.mediawiki.org/wiki/ArchComStatus>

7 years, 6 months

Community Tech: Status report on Wishlist progress

by Danny Horn

Hi everyone, The WMF Community Tech team is starting to wrap up our work on this year's Community Wishlist projects, as we prepare for the new Community Wishlist Survey starting in November. We've got a new Status report to share, with an update on the work that's been done this year on the Community Wishlist: https://meta.wikimedia.org/wiki/2015_Community_Wishlist_Survey/Status_repor… Here's a quick overview for the top 10 -- COMPLETED WORK on 5 wishes: * Wish #1: Migrate dead external links to archives, with volunteer dev Cyberpower678 -- currently on English Wikipedia, other languages coming * Wish #2: Improved diff comparisons, by WMF developer MaxSem, live on all wikis * Wish #5: Numerical sorting in categories, currently on English, Swedish and Macedonian Wikipedias, more languages coming soon * Wish #7: Pageview stats tool, live on all wikis * Wish #9: Improve the plagiarism detection bot, with volunteer dev Eran -- currently on English Wikipedia, other languages coming CURRENTLY WORKING on 1 wish: * Wish #4: Cross-wiki watchlist, currently in progress OTHER TEAMS ARE WORKING on 2 wishes: * Wish #3: Central repository for gadgets, templates and Lua modules, foundational work is underway by Legoktm * Wish #6: Allow categories in Commons in all languages, related work is underway by the Wikidata team DECLINED 2 wishes: * Wish #8: Global cross-wiki talk page * Wish #10: Add a user watchlist There's lots of information on the top 10, plus the work being done by WMDE's Technical Wishes team and the Technical Collaboration team, on the Status report page: https://meta.wikimedia.org/wiki/2015_Community_Wishlist_Survey/Status_repor… And we hope that everyone will come and participate in the 2nd annual Community Wishlist Survey, starting November 7th! https://meta.wikimedia.org/wiki/2016_Community_Wishlist_Survey See you soon, -- Danny DannyH (WMF) Senior Product Manager WMF Community Tech Team

7 years, 6 months

[Deadline] Outreachy-13 prospective applicants

by Sumit Asthana

Dear Outreachy applicants, The deadline to submit Outreachy-13[0] proposals at[1] is October 17 7PM UTC. Please make sure that your initial draft is submitted before that deadline. The application can be edited till sometime afterwards. If not made initial contributions yet, kindly get in touch with project mentors and make initial contributions to projects of your interest or some part of MediaWiki soon and continue to work towards the proposal. This will make you a *strong* candidate for the project and help the mentors in the selection process. To start with initial contributions, set up your dev environment[2] and read the complete beginner's guide[3]. For anything else just ask :) [0] - https://www.mediawiki.org/wiki/Outreachy/Round_13 [1] - https://outreachy.gnome.org/?q=program_home&prg=7 [2] - https://www.mediawiki.org/wiki/Gerrit/Tutorial [3] - https://www.mediawiki.org/wiki/How_to_become_a_MediaWiki_hacker -- -Thanks, Sumit <http://mediawiki.org/wiki/User:Sumit.iitp>

7 years, 6 months

Simplifying the use of update.php for wiki families

by Huji Lee

Dear all, I am working on a simple idea that would simplify how update.php can be used for wiki families. Please consider commenting on https://phabricator.wikimedia.org/T147817 Thanks, Huji

7 years, 6 months

MediaWiki postgres users could we have your help to fix postgres in mw 1.28 please

by Paladox

Hi could could any postgres developer please help with task https://phabricator.wikimedia.org/T147599 please. Postgres is currently broken in mw 1.28 and needs fixing please.

7 years, 6 months

Long summary upon reverting an IPv6 anon

by Bináris

(eltér <https://hu.wikipedia.org/w/index.php?title=%C3%9Ajrahasznos%C3%ADt%C3%A1s&c…> | történet <https://hu.wikipedia.org/w/index.php?title=%C3%9Ajrahasznos%C3%ADt%C3%A1s&c…>) . . a Újrahasznosítás <https://hu.wikipedia.org/wiki/%C3%9Ajrahasznos%C3%ADt%C3%A1s>‎; 07:59 . . (-22)‎ . . ‎Vépi <https://hu.wikipedia.org/wiki/Szerkeszt%C5%91:V%C3%A9pi> ( vitalap <https://hu.wikipedia.org/wiki/Szerkeszt%C5%91vita:V%C3%A9pi> | szerkesztései <https://hu.wikipedia.org/wiki/Speci%C3%A1lis:Szerkeszt%C5%91_k%C3%B6zrem%C5…> | blokkolás <https://hu.wikipedia.org/wiki/Speci%C3%A1lis:Blokkol%C3%A1s/V%C3%A9pi>)‎ (Visszaállítottam a lap korábbi változatát: 2A01:36D:119:A1B8:18B6:A5ED:816F:D9CB <https://hu.wikipedia.org/wiki/Speci%C3%A1lis:Szerkeszt%C5%91_k%C3%B6zrem%C5…> (vita <https://hu.wikipedia.org/w/index.php?title=Szerkeszt%C5%91vita:2A01:36D:119…>) szerkesztéséről [[User:Burumbátor|Buru…) This is the automatic summary of a simple revert as shown in recent changes. Half a sentence, and the previous aditor's name is hardly in it (would be truncated if it was a few characters longer). Should end with "[[User:Burumbátor|Burumbátor]] szerkesztésére." Is there a solution for this? Is it worth a bug ticket? -- Bináris

7 years, 6 months

CentralAuth MediaWiki-Vagrant

by Matthew Flaschen

If you use MediaWiki-Vagrant with CentralAuth, you may have noticed it stopped working. There was a recent schema change, and since CA does not use update.php, you have to do it manually (or destroy your box, but that will take a lot longer). If it's broken (huge red box and "Unknown column 'lu_local_id' in 'field list'") $ vagrant ssh $ mysql centralauth < /vagrant/mediawiki/extensions/CentralAuth/db_patches/patch-lu_local_id.sql (This could be done via Puppet, but that would require writing that and then checking at runtime whether these columns exist forever.) I hope that helps, Matt

7 years, 6 months

Discovery Weekly Update for the week starting 2016-10-10

by Chris Koerner

Greetings, This week is chock full of updates from Discovery. As always, feedback and questions are welcome. = Discussions = == Search == * Updated the search results page because the content overflows page boundaries [1] * Add accent squashing to Russian/Cyrillic analyser (with tests) [2] * Fixed Cyrillic 'Е' and 'Ё' equivalence not found by search [3] * Decided on the outcome of the recent BM25 A/B test, what our next steps on using BM25 will be [4] * Fixed issue where the search page content overflows the page boundaries on various browsers [5] * Updated where users prefer pages in their language in multilingual wikis [6] Search tickets completed this week, but awaiting next train in order to be deployed: Oct 25, 2016: * Put SITENAME in search box placeholder "searchsuggest-search" like in MobileFrontend's "mobile-fronted-placeholder [7] * Integrate "did you mean" data collection into search satisfaction schema [8] == Analysis == * Completed analysis of the results of BM25 AB test (final report) [9] [10] * Search results page: how many visitors are on mobile vs desktop [11] - Mikhail ran a hive query for the last couple of weeks and discovered: * Analyze the variance of user-agent's, country, and other useful metrics of google referred traffic with and without a search query available in referrer [12] ** this was to analyze what the difference is between the requests that have a search term in the query and those that do not, to determine if those queries could be used as a representative sample. Turns out, they're not relevant at all. * Investigate recent spike in pageviews on wikipedia.org portal page [13] ** there has been a dramatic increase in the amount of page views since middle of Sep 2016 to the portal--it turns out that this increase is due to various issues: school starting up again, increasing bot traffic, and possibly several agencies/companies that might have loaded 'golden' copies of software onto their employees phones that have wikipedia.org as the default home page of their Android phone browsers. == Portal == * Updated articles by languages [14] * Centered 'the free encyclopedia' phrase on mobile devices [15] * Fixed the language link that broke unevenly [16] * Updated the portal text to use the new, approved shade of blue (partially completed) [17] * Fixed where `.lang-list-button` doesn't feature focus state [18] Portal updates that need code review: * update logo for new branding guidelines [19] * add information for Wikipedia / Wikimedia apps availability [20] == Interactive == * Maps with geoshapes now have a link to Wikidata item or query in the bottom attribution text (i.e.: externalData should show up as data source in credits) [21] * Migrated all map usage from "href" to "service" external data (about 50 pages) [22] * Simplified (and normalized) ExternalData parsing in Kartographer [23] * Geoshapes service URL is hardcoded [24] * Refactor data loader into a separate lib, as both Kartotherian (snapshot) and Kartographer need identical functionality, for a given map, we need to provide a fully expanded (no externalData) GeoJSON [25] * Fixed where failed ExternalData requests result in all maps on page being completely broken [26] * Set "maxzoom" to 14 on osm.tm2source, based on community feedback [27] * Defined KPIs and other interesting maps statistics about how we would like to gather to track and improve maps [28] * Ensure Maps servers can be installed easily (automation + documentation) [29] * maps-test* hosts running low on space [30] * Updated to postgresql 9.4.9 on all maps servers [31] * Created a pipeline for supplying data to static map service (Here is a sample URL) [32] [33] * Error "Maximum zoom is 18" (updated logging to be an 'info' message rather than an error) [34] * Fixed where the Sparql-based externalData maps are broken [35] Interactive tickets completed this week, but awaiting next train in order to be deployed: Oct 25, 2016: * <mapframe> maximize button sometimes doesn't work [36] * buildHtml() should parse messages in parser output language [37] = Other Noteworthy Stuff = * The Search team created a new ticket to note what will be 'live' in production during the next full re-indexing: [Recurring task] CirrusSearch: what is updated during re-indexing [38] * Request for translation sent for Update CirrusSearch documentation [39] [1] https://phabricator.wikimedia.org/T138108 [2] https://phabricator.wikimedia.org/T102298 [3] https://phabricator.wikimedia.org/T124592 [4] https://phabricator.wikimedia.org/T147008 [5] https://phabricator.wikimedia.org/T138108 [6] https://phabricator.wikimedia.org/T68829 [7] https://phabricator.wikimedia.org/T144640 [8] https://phabricator.wikimedia.org/T138087 [9] https://phabricator.wikimedia.org/T143589 [10] https://wikimedia-research.github.io/Discovery-Search-Test-BM25/ [11] https://phabricator.wikimedia.org/T147513 [12] https://phabricator.wikimedia.org/T128146 [13] https://phabricator.wikimedia.org/T146214 [14] https://phabricator.wikimedia.org/T128546 [15] https://phabricator.wikimedia.org/T143241 [16] https://phabricator.wikimedia.org/T144007 [17] https://phabricator.wikimedia.org/T146231 [18] https://phabricator.wikimedia.org/T143127 [19] https://phabricator.wikimedia.org/T144834 [20] https://phabricator.wikimedia.org/T137495 [21] https://phabricator.wikimedia.org/T145109 [22] https://phabricator.wikimedia.org/T147530 [23] https://phabricator.wikimedia.org/T147128 [24] https://phabricator.wikimedia.org/T146494 [25] https://phabricator.wikimedia.org/T147078 [26] https://phabricator.wikimedia.org/T146400 [27] https://phabricator.wikimedia.org/T147698 [28] https://phabricator.wikimedia.org/T144239 [29] https://phabricator.wikimedia.org/T138501 [30] https://phabricator.wikimedia.org/T146848 [31] https://phabricator.wikimedia.org/T138276 [32] https://phabricator.wikimedia.org/T133247 [33] http://maps.wikimedia.org/img/osm-intl,1,0,0,1000x1000.png?domain=www.media… [34] https://phabricator.wikimedia.org/T146805 [35] https://phabricator.wikimedia.org/T148237 [36] https://phabricator.wikimedia.org/T147987 [37] https://phabricator.wikimedia.org/T148082 [38] https://phabricator.wikimedia.org/T147505: [39] https://phabricator.wikimedia.org/T141156 ---- The full update, and archive of past updates, can be found on Mediawiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as Easy or volunteer needed in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R -- Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

7 years, 6 months

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l October 2016