My personal prefered solution would be to have the icons in SVG and embed them directly into the page. But I guess that is not acceptable for the browser agnostic wikipedia audience.
There are always data: urls, which would also save a roundtrip. But without some serverside support to automatically embed those this would create a maintenance nightmare.