Can tool labs handle this many hits?
--- Original Message ---
From: "Maarten Dammers" maarten@mdammers.nl Sent: September 1, 2013 4:34 AM To: "Wiki Loves Monuments Photograph Competition" wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Please use toollabs api for your tools
Hi everyone,
Many tools have been build on top http://toolserver.org/~erfgoed/api/api.php . Toolserver is quite overloaded so I build a second api with the same codebase. It's a bit more limited, but should work much better for automated tools. You can find it at http://tools.wmflabs.org/heritage/api/api.php . The mobile app also uses this one.
See for example https://maps.google.nl/maps?q=http:%2F%2Ftools.wmflabs.org%2Fheritage%2Fapi%... for the monuments in my city.
Most of the load will be on the database, statistics about that on http://ganglia.wmflabs.org/latest/?r=week&cs=&ce=&c=tools&h=...
Maarten
_______________________________________________ Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Hi Mono,
Op 1-9-2013 16:32, User Mono schreef:
Can tool labs handle this many hits?
Only one way to find out :-) We should probably keep an eye on Ganglia and, if resources really become a problem, request an upgrade of the machine.
Maarten
--- Original Message ---
From: "Maarten Dammers" maarten@mdammers.nl Sent: September 1, 2013 4:34 AM To: "Wiki Loves Monuments Photograph Competition" wikilovesmonuments@lists.wikimedia.org Subject: [Wiki Loves Monuments] Please use toollabs api for your tools
Hi everyone,
Many tools have been build on top http://toolserver.org/~erfgoed/api/api.php . Toolserver is quite overloaded so I build a second api with the same codebase. It's a bit more limited, but should work much better for automated tools. You can find it at http://tools.wmflabs.org/heritage/api/api.php . The mobile app also uses this one.
See for example https://maps.google.nl/maps?q=http:%2F%2Ftools.wmflabs.org%2Fheritage%2Fapi%... for the monuments in my city.
Most of the load will be on the database, statistics about that on http://ganglia.wmflabs.org/latest/?r=week&cs=&ce=&c=tools&h=...
Maarten
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.org
Maarten Dammers, 01/09/2013 16:37:
Hi Mono,
Op 1-9-2013 16:32, User Mono schreef:
Can tool labs handle this many hits?
Only one way to find out :-) We should probably keep an eye on Ganglia and, if resources really become a problem, request an upgrade of the machine.
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck? Or in other words, what hosts should one keep an eye on in ganglia? I only see a huge peak of network and a pseudo-swapdeath for a couple days but that could be anything. http://ganglia.wmflabs.org/latest/?r=month&cs=&ce=&m=load_one&s=by+name&c=tools&h=&host_regex=&max_graphs=0&tab=m&vn=&sh=1&z=small&hc=4
Nemo
2013/9/2 Federico Leva (Nemo) nemowiki@gmail.com:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck?
Further background here, for who's interested: https://bugzilla.wikimedia.org/show_bug.cgi?id=48851
C
Hi Cristian,
Op 3-9-2013 1:40, Cristian Consonni schreef:
2013/9/2 Federico Leva (Nemo) nemowiki@gmail.com:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck?
Further background here, for who's interested: https://bugzilla.wikimedia.org/show_bug.cgi?id=48851
Like Yuvi said: You're mixing up things. Inserts at the replicated databases are very slow, that's why I'm not using these, but I'm instead using the tools-db. Very confusing. At first I got the advice to use the replicated database because these would be much faster. Turned out that it was actually the other way around.
Maarten
On Mon, Sep 2, 2013 at 1:21 PM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
You mentioned that the (user?) database on Toollabs/Labs is very slow, is that the main bottleneck? Or in other words, what hosts should one keep an eye on in ganglia? I only see a huge peak of network and a pseudo-swapdeath for a couple days but that could be anything. http://ganglia.wmflabs.org/latest/?r=month&cs=&ce=&m=load_one&s=by+name&c=tools&h=&host_regex=&max_graphs=0&tab=m&vn=&sh=1&z=small&hc=4
I think the 'database too slow' was a problem when he used the replica databases - rather than the 'user database' (which is the host tools-db). It currently uses the user database (tools-db) and is fast enough. So if you're looking for a hostname to look at, look at tools-db :)
wikilovesmonuments@lists.wikimedia.org