Does Ganeti live in the production cluster and therefore sit behind the firewalling that prohibits loading data into our analytics pipelines from Labs?
On 17 June 2015 at 12:41, Jeff Gage jgage@wikimedia.org wrote:
Labs hosts a special project called Tool Labs which https://wikitech.wikimedia.org/wiki/Help:FAQ describes as "designed to host tools that are not so complicated that they would require a dedicated instance". One notable tool is Geohack (https://tools.wmflabs.org/geohack/): every article about a location links to it. Example from https://en.wikipedia.org/wiki/Aberdeen: Coordinates: 57.1526°N 2.1100°W https://tools.wmflabs.org/geohack/geohack.php?pagename=Aberdeen¶ms=57.1526_N_-2.1100_E_type:city_region:GB
There are also various analytics dashboards in labs which might be considered as "production" https://glam-metrics.wmflabs.org/ https://metrics.wmflabs.org/ http://reportcard.wmflabs.org/ http://searchdata.wmflabs.org/ As others have mentioned, part of the problem is the ease in spinning up a labs instance vs hardware procurement for a deployment into production. Ops (Alex) is working on virtualization infrastructure for use in prod called Ganeti (an alternative to the OpenStack virtualization software which powers labs); the first service was recently migrated from hardware to a Ganeti instance: etherpad. Ganeti could be the way forward for promoting services from labs to prod without requiring dedicated hardware.
https://wikitech.wikimedia.org/wiki/Ganeti
On Wed, Jun 17, 2015 at 8:01 AM, Kevin Smith ksmith@wikimedia.org wrote:
Max: I thought we were hoping to use the labs map servers to support production-like cases. For example, possibly "beta" mobile apps, or maybe hooked into some small production wiki.
Even if that is not the case, it seems like for anything we do run in labs for a long time, we would want to be able to measure. Usage and speed.
Kevin Smith Agile Coach Wikimedia Foundation
*Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.*
On Tue, Jun 16, 2015 at 6:52 PM, Max Semenik maxsem.wiki@gmail.com wrote:
Explain what? Everything we have in labs is for experimentation and prototyping. It should not be used for prod. 16 июня 2015 г. 18:16 пользователь "Oliver Keyes" okeyes@wikimedia.org написал:
Max, could you explain that?
On 16 June 2015 at 20:28, Max Semenik maxsem.wiki@gmail.com wrote:
Maps is not going to be production-like.
On Tue, Jun 16, 2015 at 2:46 PM, Kevin Smith ksmith@wikimedia.org
wrote:
In a recent meeting, Oliver expressed concerns about us having
services
running in labs which are treated sort of like they were in
production.
Examples include WDQS (already) and maps (potentially).
We agreed to have this discussion on the mailing list, so this is an invitation to do so. I am not familiar enough with the various
technical
issues to explain them properly, so hopefully someone else will step
in and
do so. I believe one big area of concern is analytics.
Kevin Smith Agile Coach Wikimedia Foundation
Imagine a world in which every single human being can freely share
in the
sum of all knowledge. That's our commitment. Help us make it a
reality.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
-- Best regards, Max Semenik ([[User:MaxSem]])
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
-- Oliver Keyes Research Analyst Wikimedia Foundation
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search