Can tool labs handle this many hits?
--- Original Message ---
From: "Maarten Dammers" maarten@mdammers.nl Sent: September 1, 2013 4:34 AM To: "Wiki Loves Monuments Photograph Competition" wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Please use toollabs api for your tools
Hi everyone,
Many tools have been build on top http://toolserver.org/~erfgoed/api/api.php . Toolserver is quite overloaded so I build a second api with the same codebase. It's a bit more limited, but should work much better for automated tools. You can find it at http://tools.wmflabs.org/heritage/api/api.php . The mobile app also uses this one.
See for example https://maps.google.nl/maps?q=http:%2F%2Ftools.wmflabs.org%2Fheritage%2Fapi%... for the monuments in my city.
Most of the load will be on the database, statistics about that on http://ganglia.wmflabs.org/latest/?r=week&cs=&ce=&c=tools&h=...
Maarten
_______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Hi Mono,
Op 1-9-2013 16:32, User Mono schreef:
Can tool labs handle this many hits?
Only one way to find out :-) We should probably keep an eye on Ganglia and, if resources really become a problem, request an upgrade of the machine.
Maarten
--- Original Message ---
From: "Maarten Dammers" maarten@mdammers.nl Sent: September 1, 2013 4:34 AM To: "Wiki Loves Monuments Photograph Competition" wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Please use toollabs api for your tools
Hi everyone,
Many tools have been build on top http://toolserver.org/~erfgoed/api/api.php . Toolserver is quite overloaded so I build a second api with the same codebase. It's a bit more limited, but should work much better for automated tools. You can find it at http://tools.wmflabs.org/heritage/api/api.php . The mobile app also uses this one.
See for example https://maps.google.nl/maps?q=http:%2F%2Ftools.wmflabs.org%2Fheritage%2Fapi%... for the monuments in my city.
Most of the load will be on the database, statistics about that on http://ganglia.wmflabs.org/latest/?r=week&cs=&ce=&c=tools&h=...
Maarten
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Maarten Dammers, 01/09/2013 16:37:
Hi Mono,
Op 1-9-2013 16:32, User Mono schreef:
Can tool labs handle this many hits?
Only one way to find out :-) We should probably keep an eye on Ganglia and, if resources really become a problem, request an upgrade of the machine.
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck? Or in other words, what hosts should one keep an eye on in ganglia? I only see a huge peak of network and a pseudo-swapdeath for a couple days but that could be anything. http://ganglia.wmflabs.org/latest/?r=month&cs=&ce=&m=load_one&s=by+name&c=tools&h=&host_regex=&max_graphs=0&tab=m&vn=&sh=1&z=small&hc=4
Nemo
2013/9/2 Federico Leva (Nemo) nemowiki@gmail.com:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck?
Further background here, for who's interested: https://bugzilla.wikimedia.org/show_bug.cgi?id=48851
C
On Mon, Sep 2, 2013 at 1:21 PM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck? Or in other words, what hosts should one keep an eye on in ganglia? I only see a huge peak of network and a pseudo-swapdeath for a couple days but that could be anything. http://ganglia.wmflabs.org/latest/?r=month&cs=&ce=&m=load_one&s=by+name&c=tools&h=&host_regex=&max_graphs=0&tab=m&vn=&sh=1&z=small&hc=4
I think the 'database too slow' was a problem when he used the replica databases - rather than the 'user database' (which is the host tools-db). It currently uses the user database (tools-db) and is fast enough. So if you're looking for a hostname to look at, look at tools-db :)
Hi Cristian,
Op 3-9-2013 1:40, Cristian Consonni schreef:
2013/9/2 Federico Leva (Nemo) nemowiki@gmail.com:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck?
Further background here, for who's interested: https://bugzilla.wikimedia.org/show_bug.cgi?id=48851
Like Yuvi said: You're mixing up things. Inserts at the replicated databases are very slow, that's why I'm not using these, but I'm instead using the tools-db. Very confusing. At first I got the advice to use the replicated database because these would be much faster. Turned out that it was actually the other way around.
Maarten
wikilovesmonuments@lists.wikimedia.org