PS One thing I forgot to mention - mega thanks to WMF's Office IT for helping with ordering and imaging the USB sticks!!! On Fri, May 16, 2014 at 1:40 PM, Arthur Richards <arichards(a)wikimedia.org>wrote;wrote: > Just wanted to send out an update on the progress we made around > MW-Vagrant improvements at the Zürich Hackathon. Our primary goal was to > make some key production services available in MW-Vagrant in order to make > local development/testing easier/more reliable. We made some excellent > headway, focussing on a few key services: SSL, Varnish, > CentralAuth/Multiwiki. > > SSL: > I spent a majority of my time focussing on this and received a lot of > support/help from Ori. There is now an 'https' role in mw-vagrant which > when enabled, will allow you to access your devwiki on port 4430 (forwarded > to 443 in Vagrant). There is one outstanding patchset which will make it > possible to use $wgSecureLogin in MW-Vagrant: > https://gerrit.wikimedia.org/r/#/c/132799/ > > Varnish: > This is proving to be much more difficult than anticipated, however some > progress was made and work is ongoing, spearheaded by Andrew Otto. The plan > is to set up varnish VCLs for mw-vagrant similar to what is set up for text > varnishes in production, with a frontend and backend instance running in > vagrant. Andrew is in the midst of refactoring the production varnish > module, to make it usable in Vagrant. > > CentralAuth/Multiwiki: > Bryan Davis, Chris Steipp, and Reedy spent a lot of time hacking on this, > and we now have support for multiwiki/CentralAuth in Vagrant! There is > still some cleanup work being done for the role to remove kludge/hacks/etc > (see https://gerrit.wikimedia.org/r/#/c/132691/). > > Also of significant note, Matt Flaschen created a mw-vagrant iso which can > be packaged on USB thumb drives, making it possible to set up mw-vagrant > without a network connection. There is still some work to be done here to > create a one-click installer as well as updating documentation. Matt got > this done before the hackathon, and we brought a bunch of USB sticks imaged > with the iso, which was instrumental in getting a bunch of folks new to > mw-vagrant up and running at the hackathon. This was particularly useful > during Bryan Davis's vagrant bootcamp sessions. > > I believe Katie Filbert from Wikidata did some mw-vagrant work at the > hackathon as well, although I'm not clear on the current status. Katie, can > you let us know where things were at with what you were working on? > > All in all it felt like a very fruitful hack session, and we're closer > than ever to having a ready-to-go developer instance that mimics our > production environment. Big thanks to everyone involved in making our work > successful.

On Fri, May 16, 2014 at 2:40 PM, Arthur Richards <arichards(a)wikimedia.org> wrote: kludge/hacks/etc The CentralAuth role and the associated puppet config that allows creation of multiple wikis as Apache virtual hosts on a single MediaWiki-Vagrant virtual machine have been merged! Go forth and debug/extend CentralAuth. :) I'd love to see additional roles created that use the multwiki::wiki Puppet define to add interesting things for testing/debugging like RTL wikis or other complex features such as WikiData that use a collaboration between multiple wikis in the WMF production cluster. If you're interested in working on something like this and get stuck with the Puppet code needed or find shortcomings in the setup that Chris and I developed I'd be glad to try and help work through the issues. Bryan -- Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> [[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA irc: bd808 v:415.839.6885 x6855 _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

On Fri, May 16, 2014 at 2:40 PM, Arthur Richards <arichards(a)wikimedia.org> wrote: kludge/hacks/etc The CentralAuth role and the associated puppet config that allows creation of multiple wikis as Apache virtual hosts on a single MediaWiki-Vagrant virtual machine have been merged! Go forth and debug/extend CentralAuth. :) I'd love to see additional roles created that use the multwiki::wiki Puppet define to add interesting things for testing/debugging like RTL wikis or other complex features such as WikiData that use a collaboration between multiple wikis in the WMF production cluster. If you're interested in working on something like this and get stuck with the Puppet code needed or find shortcomings in the setup that Chris and I developed I'd be glad to try and help work through the issues. Bryan -- Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> [[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA irc: bd808 v:415.839.6885 x6855 _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Bryan and Chris, The multiwiki work is fantastic, a big thank you for pursuing this! I tried to use your new module to provide a vagrant development environment for Fundraising's "payments" wiki [1], and I ran up against a large and very solid-looking wall that I think is worth mentioning. We maintain a special release branch of MediaWiki for payments, with a bit of security hardening. We cannot follow trunk development without carefully reading over the new features, and we need to develop against this target so that we catch version incompatibilities before deployment. I see that multiwiki encapsulates the various wikis by configuration only, and they all share the main codebase. Do you have multiple checkouts of MediaWiki-core on your roadmap, or are we a fringe case? I'd like to help support our development under vagrant, but this issue is a bit of a blocker. Any advice would be appreciated. Thanks, Adam [1] https://gerrit.wikimedia.org/r/135326, production is https://payments.wikimedia.org On Wed, May 21, 2014 at 9:55 AM, Bryan Davis &lt;bd808(a)wikimedia.org <javascript:;>> wrote: this, <javascript:;>> _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org <javascript:;> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Bryan, I think I need to take you up on the offer to help. I can do the coding, but I need some borrowed insight to get started. I don't think the wikimania_scholarships model is a good one to follow, I'd much rather add configurability to the mediawiki::wiki or multiwiki::wiki classes. Unfortunately, I see a lot of cascading changes being necessary, which makes me think I'm on the wrong track.