Cross posting. Really neat stuff!

-Adam

---------- Forwarded message ----------
From: Timo Tijhof <ttijhof@wikimedia.org>
Date: Thu, Jun 25, 2015 at 10:05 AM
Subject: [Ops] How Flickr improved image scaler performance
To: ops Wikimedia List <ops@lists.wikimedia.org>


Flickr shared their story about speeding up resizing of images to near real-time.

http://code.flickr.net/2015/06/25/real-time-resizing-of-flickr-images-using-gpus/

TL;DR:

* Switch to GraphicsMagick  a mature fork of ImageMagick (started in 2002) that is more efficient, smaller code base, more secure, runs faster. (Also used by Etsy).

* Switch again, to Ymagine. Another 2X improvement over GraphicsMagick.

* Switch again, to a GPU-based tool. Another 4X improvement. This GPU tool doesn't appear to be open-sourced, however.

* Only reliably store thumbnails of 2048px (if the original is larger). Generate the rest on-the-fly (from the 2048 one), with HTTP caching only.

http://www.graphicsmagick.org/
http://www.graphicsmagick.org/benchmarks.html
https://github.com/yahoo/ygloo-ymagine

— Timo


_______________________________________________
Ops mailing list
Ops@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/ops