Cross posting. Really neat stuff!

-Adam

---------- Forwarded message ---------- From: Timo Tijhof ttijhof@wikimedia.org Date: Thu, Jun 25, 2015 at 10:05 AM Subject: [Ops] How Flickr improved image scaler performance To: ops Wikimedia List ops@lists.wikimedia.org

Flickr shared their story about speeding up resizing of images to near real-time.

http://code.flickr.net/2015/06/25/real-time-resizing-of-flickr-images-using-...

TL;DR:

* Switch to GraphicsMagick a mature fork of ImageMagick (started in 2002) that is more efficient, smaller code base, more secure, runs faster. (Also used by Etsy).

* Switch again, to Ymagine. Another 2X improvement over GraphicsMagick.

* Switch again, to a GPU-based tool. Another 4X improvement. This GPU tool doesn't appear to be open-sourced, however.

* Only reliably store thumbnails of 2048px (if the original is larger). Generate the rest on-the-fly (from the 2048 one), with HTTP caching only.

http://www.graphicsmagick.org/ http://www.graphicsmagick.org/benchmarks.html https://github.com/yahoo/ygloo-ymagine

— Timo

_______________________________________________ Ops mailing list Ops@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ops