Hi folks,
in our quest to simplify the creation of production-quality services we
have recently made some modest progress with a service-runner module [1]
and an early service-template-node prototype [2]. The latter deserves its
own discussion (and is at a very early stage), so I'm focusing on
service-runner in this thread.
Service-runner [1] is a small module that we moved out of restbase. It
generalizes some simple start-up, monitoring and supervision facilities
that we refined while building services like Parsoid, Mathoid or RESTBase:
- commandline option parsing & yaml config loading (with a standard format)
- worker pool management using the cluster module; graceful restarts
- logging via gelf to logstash, with option to configure other backends
- generic metric reporting (txstatsd, statsd or simple logging for
development)
- general worker monitoring & debugging: V8 heap metrics & limiting,
support for heap dumps
For small (third party) installs with limited memory, we also added the
capability to cleanly run multiple services in a single process.
The uniform way to run and configure services provided by service-runner
should let us create a shared puppet module to manage most of the
per-service tasks [3]. Another possibility is to automatically build
packages for these services [4], which can help to distribute these
services to third-party users.
So, please have a look & let us know what you are missing / would like to
see. There is a service-runner tag on phabricator [5] that we can use to
track specific tasks.
Thanks,
Gabriel
[1]: https://github.com/wikimedia/service-runner
[2]: https://github.com/wikimedia/service-template-node
[3]: https://phabricator.wikimedia.org/T89901
[4]: https://phabricator.wikimedia.org/T89900
[5]: https://phabricator.wikimedia.org/tag/service-runner/
If you are looking for a Wikimania Hackathon buddy, check
https://wikimania2015.wikimedia.org/wiki/Hackathon/Buddies
On Thu, Feb 19, 2015 at 3:57 PM, Quim Gil <qgil(a)wikimedia.org> wrote:
> Yesterday we opened the travel request process for Wikimedia Foundation
> employees in Engineering and Product willing to participate at the
> Wikimedia Hackathon or Wikimania. There is no public link, but you can
> follow this task at https://phabricator.wikimedia.org/T89355
>
> In this process, we are asking WMF employees to find a hackathon buddy
> with the sole requirement of not being another WMF employee. In fact, in
> the registration for the hackathons we will request the same to all
> participants.
>
> https://www.mediawiki.org/wiki/Hackathons#Pairing_buddies
>
> This means that non-WMF contributors might receive a request from a WMF
> employee to be hackathon buddies. This also means that if you are planning
> to participate in any of these events (and especially if you plan to
> request travel sponsorship to Lyon) you will be encouraged to find a buddy
> as well.
>
> It's going to be fun. :) And no worries, we will help making connections
> to whoever needs that help.
>
--
Quim Gil
Engineering Community Manager @ Wikimedia Foundation
http://www.mediawiki.org/wiki/User:Qgil
Hello!
Global user pages have now been deployed to all public wikis for users
with CentralAuth accounts. Documentation on the feature is available at
mediawiki.org[1], and if you notice any bugs please file them in
Phabricator[2].
Thanks to all the people who helped with the creation and deployment
(incomplete, and in no particular order): Jack Phoenix & ShoutWiki,
Isarra, MZMcBride, Nemo, Quiddity, Aaron S, Matt F, James F, and
everyone who helped with testing it while it was in beta.
[1] https://www.mediawiki.org/wiki/Help:Extension:GlobalUserPage
[2]
https://phabricator.wikimedia.org/maniphest/task/create/?projects=PHID-PROJ…
Currently the min mysql version we require is 5.0.2. In order to fix
T6715 [2], I'd like to bump it to 5.0.3. This would allow us to have
varchar fields larger than 255. Anyone have any objections?
5.0.3 was released in march 2005 (8 years ago!), so this is hardly
bleeding edge. As far as I can tell, Wikiapiry says this would affect
no wikis [1]
[0] https://phabricator.wikimedia.org/T6715
[1] https://wikiapiary.com/w/index.php?title=Special%3ASearchByProperty&propert…
--
bawolff
Hi,
Should composer.lock be added to .gitignore?
It may be different for different extensions. In ContentTranslation we
currently only have:
"require": {
"php": ">=5.3.0",
"composer/installers": ">=1.0.1"
},
I don't know much about Composer, but it looks like nothing more than the
bare minimum. Should composer.lock be version-controlled in such a
situation?
--
Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי
http://aharoni.wordpress.com
“We're living in pieces,
I want to live in peace.” – T. Moore
Hello,
Before someone starts with a proposal for the proposed-tech-project 'Allow
user login with e-mail address'[1], is there still community consensus for
the same ? I personally think its a must-have for MediaWiki, as e-mail
address is easy to remember than a complex username. Currently multiple
users can sign-up with the same e-mail id - which would possibly be a
blocker, and can be fixed. Thanks to MzMcbride, we have an RFC[2] too on
the same.
[1] https://phabricator.wikimedia.org/T30085
[2]
https://www.mediawiki.org/wiki/Requests_for_comment/Login_via_e-mail_address
Thanks,
Tony Thomas <http://tttwrites.wordpress.com/>
FOSS@Amrita <http://foss.amrita.ac.in>
*"where there is a wifi, there is a way"*
does anyone know if there is a method for applying for post project
funding within the wikiverse or if there is a committee that awards a
project after it has proven itself useful?
with kind regards,
dan
Hi Luis,
Thank you for agreeing to consider grant funding for software projects.
It sounds like you also plan a broader review of funding for community
needs and growth. I have a list of requests for changes, which boil down to
removing policy barriers and greatly improving communications and workflows
so that community growth is fostered and volunteer time is used wisely. I
imagine that we will have an opportunity to discuss these matters in person
in Berlin. I look forward to seeing you there, and I greatly appreciate
your interest in supporting communities and contributor growth.
Pine
On Feb 21, 2015 6:12 PM, "Luis Villa" <lvilla(a)wikimedia.org> wrote:
> On Sat, Feb 21, 2015 at 5:39 PM, Erik Moeller <erik(a)wikimedia.org> wrote:
>
> > Damon, Luis and members of their teams will need to weigh in on this,
> > and will want to think through the implications for their respective
> > areas, but it's a good conversation to have -- keeping in mind that
> > Luis is just starting in his new role, so please give him at least a
> > few days to get up to speed. ;-)
> >
>
> Thanks for at least a few hours of cushion, Erik ;)
>
> I'm a big believer in the power of/need for software tools, and at least
> philosophically I'm very open to funding software development outside the
> Foundation (though obviously there are lots of pragmatic difficulties -
> code review, etc.) So, yes, as part of our broader review of how we support
> communities and contributor growth, CE will look at funding code very
> seriously.
>
> Luis
>
> --
> Luis Villa
> Sr. Director of Community Engagement
> Wikimedia Foundation
> *"Imagine a world in which every single human being can freely share in the
> sum of all knowledge. That's our commitment."*
> _______________________________________________
> Wikimedia-l mailing list, guidelines at:
> https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines
> Wikimedia-l(a)lists.wikimedia.org
> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
> <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>