On Mon, Oct 29, 2012 at 3:55 PM, Rob Lanphier <robla(a)wikimedia.org> wrote:
> Ok, so after this, and a couple of brief offlist discussions, we've
> made a slight change to the plan [to deploy TimedMediaHandler]:
>
> Here's what we'll do:
> 1) Wednesday, October 31: Deploy to en.wikipedia.org first. There's
> enough video content there, and robust enough feedback (WP:VPT) that
> if there's any problem with video, we'll hear about it. Also, more
> easiliy reversed than going to commons.
> 2) (TBD, possibly Monday, November 5) Deploy to everything *but* commons
> 3) (TBD, possibly Wednesday, November 7) Deploy to commons
>
> I'll make the changes to all of the published plans to reflect this.
Another update. We're going to postpone this one day. There's some
further testing that needs to happen on older versions of IE, as well
as a fix for a blocker that needs to be deployed and spend some time
in test. New time: Thursday, November 1, 16:00 UTC to English
Wikipedia.
Rob
Updated plan:
---------- Forwarded message ----------
From: Rob Lanphier <robla(a)wikimedia.org>
Date: Mon, Oct 29, 2012 at 3:55 PM
Subject: Re: Switching to Timed Media Handler on EnWiki (was: Commons)
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
On Mon, Oct 29, 2012 at 2:52 PM, Jan Gerber <jgerber(a)wikimedia.org> wrote:
>> I know we conducted tests for TMH “playing” well with oggHandler provider (
>> i.e the test2.wikipedia.org pages are embedding commons videos but played
>> back with TMH ) ... I am not sure if we have conducted tests for oggHandler
>> playing well with a TMH provider with the possible configuration phases
>> mentioned above.
>
> good point. labs is setup like that now: en running OggHandler and commons TMH
>
> http://en.wikipedia.beta.wmflabs.org/wiki/File:Citygroup_Center,_San_Franci…
> http://commons.wikimedia.beta.wmflabs.org/wiki/File:Citygroup_Center,_San_F…
>
> so that part looks good to go. (should also test smaller embeds to be sure)
Ok, so after this, and a couple of brief offlist discussions, we've
made a slight change to the plan:
Here's what we'll do:
1) Wednesday, October 31: Deploy to en.wikipedia.org first. There's
enough video content there, and robust enough feedback (WP:VPT) that
if there's any problem with video, we'll hear about it. Also, more
easiliy reversed than going to commons.
2) (TBD, possibly Monday, November 5) Deploy to everything *but* commons
3) (TBD, possibly Wednesday, November 7) Deploy to commons
I'll make the changes to all of the published plans to reflect this.
Rob
Hi all,
Please direct followups to wikitech-l, since I think this is of broad
interest there.
Rob
---------- Forwarded message ----------
From: Rob Lanphier <robla(a)wikimedia.org>
Date: Sun, Oct 28, 2012 at 10:41 PM
Subject: [Wikitech-l] Switching to Timed Media Handler on Commons
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
Hi everyone,
This is a fairly long email describing where we're at with Timed Media
Handler, and what we plan for this week. The short version is:
* We'll be deploying a few fixes tomorrow (Monday)
* If all goes well, we'd like to deploy Timed Media Handler to
Commons on Wednesday (9am PDT)
* Short of deploying to Commons, we'd like to make some other
significant deployment.
I haven't yet run this plan by Jan (hi Jan!), so it's subject to
change, but barring some unforeseen wrinkle, that's what we're rolling
with.
The long version:
As Peter said earlier this week, the last big blocker for using Timed
Media Handler (TMH) was the upgrade to Precise, which is now done
(yay!)
Currently on test2 for videos that where uploaded to test2 thumbnails
work, e.g.:
<http://test2.wikipedia.org/wiki/File:Citygroup_Center,_San_Francisco.ogv>
Thumbs stopped working for videos that are loaded from commons, e.g.
<http://test2.wikipedia.org/wiki/File:Folgers.ogv>
The problem with the videos loaded from commons is that the expected
thumb name starts with "Mid-", and that OggHandler on Commons doesn't
support arbitrary pixel sizes in the request. Meanwhile, TMH assumes
that it can request video thumbs by pixel size.
Jan Gerber prepared a few fixes on Friday, and Aaron is going to
deploy those on Monday. Here's all of Jan's recent commits:
<https://gerrit.wikimedia.org/r/#/q/owner:J,n,z>
I *think* that will clear up the last of our issues that are known
blockers for wider deployment.
On Thursday, Tim, Aaron and I had a conversation on #mediawiki about
CPU time for thumbnailing based on some problems:
<http://bots.wmflabs.org/~wm-bot/logs/%23mediawiki/20121026.txt>
One minor thing we saw was that avconv (a fork of ffmpeg supported as
a replacement for ffmpeg in Ubuntu) seems to have slightly better
performance than ffmpeg. Jan plans to switch over to avconv.
We also noticed that it's possible to mop up a ton of CPU time
creating a video if the video is long enough (and maybe with only a
single keyframe at the beginning). However, Jan pointed out that TMH
uses command line switches that solve this problem by seeking a couple
seconds before the target frame before decoding (using the -ss
parameter on the input), and then decoding a couple seconds of video
to get a good snapshot. Here's the command line:
avconv -ss X -i video.ogv -ss Y -vframes 1 -an -f mjpeg out.jpg
with X=Y-2
This provides a bit of a buffer so that we can be reasonably sure that
avconv pulls in a keyframe, or at least has a chance to pull together
a good snapshot based on several other frames.
Assuming we get the last blocking bugs fixed tomorrow, then we should
be able to go onto Commons on Wednesday, so that's our current plan.
Let us know if there are issues with this.
Thanks!
Rob
Great news from Peter, having upgraded all of the image scalers, which
was the last known blocker for deploying TMH (see his status update
below)
Thumbnails on this page seem to still be missing for a couple of the videos:
http://test2.wikipedia.org/wiki/User:JanGerber/sandbox
...even after a purge, so we might have a different problem to clear up.
--------- Forwarded message ----------
From: Peter Youngmeister <py(a)wikimedia.org>
Date: Wed, Oct 24, 2012 at 11:08 AM
Subject: [Wikitech-l] All wmf imagescalers now running ubuntu 12.04 precise
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
Hi All,
As of this moment, all imagescalers are now running ubuntu 12.04
precise pangolin. This should close a number of bugzilla tickets, as
well as remove the final blocker for timed media handler.
Many thanks to Tim and Faidon for patching/package building for this!
I'm very excited by this, but I'd like to not consider this "done" for
another could of days. I've been combing through the error logs and
nothing new seems to be popping up. That said, this is a very delicate
bit of infrastructure, so there is a possibility, albeit a very slim
one, that something will be off and we'll have to roll back to lucid
until the issue is cleared up. I think this very unlikely, but I would
like to note it in case things requiring packages in precise are
deployed. I do, however, think that it's reasonable to consider the
Rubicon crossed and fix any issues as they arise instead of rolling
back.
And now onto the other apaches!
--peter
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Hi everyone,
There's a private thread that veered into territory we could take
public, so I'm continuing a conversation Michael Dale started. To
catch everyone up, we're discussing what's needed to deploy
TimedMediaHandler more widely to the cluster. As you may recall,
there's a video test page here:
http://test2.wikipedia.org/wiki/User:JanGerber/sandbox
Two problem we're discussing about this page:
* Broken thumbnails
* Seek bar/time indicator fail to progress during playback
More below...
On Thu, Sep 20, 2012 at 12:29 PM, Michael Dale <mdale(a)wikimedia.org> wrote:
> For the bar / time indicator updates its, related to the jQuery 1.8 update,
> we need to schedule the updated deployment of the version that is in the
> git.
Which revisions need to get deployed at this point? I think at least
some of the proposed fixes went out with 1.20wmf12. If there are
additional changes that need to get pushed, we can potentially do
those out of cycle.
> I am not sure about the status of the imagescallers, including the updated
> versions of ffmpeg ?
That's dependent on the upgrade from Lucid to Precise on those
machines. I just spoke with Peter Youngmeister (who is doing that
work), and he says he'll likely get that done next week (contingent on
some package building work that he hopes to wrap up tomorrow).
Rob
*kuch*
-------- Originele bericht --------
Onderwerp: Re: [Wikimania-l] Wikimania 2012 videos are being uploaded
Datum: Tue, 21 Aug 2012 22:10:20 +0100
Van: Michael Peel <michael.peel(a)wikimedia.org.uk>
Antwoord-naar: Wikimania general list (open subscription)
<wikimania-l(a)lists.wikimedia.org>
Aan: Wikimania general list (open subscription)
<wikimania-l(a)lists.wikimedia.org>
> Once we have all the videos, we will send hard drives of the videos off to the server farms for direct upload to Wikimedia Commons, with both low-resolution and full HD versions being made available.
It says a lot about the state of the Wikimedia Commons upload system that even the WMF ends up uploading videos to Youtube in advance of posting them on a website that it operates. :-(
Thanks,
Mike
_______________________________________________
Wikimania-l mailing list
Wikimania-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimania-l
Jan
Very cool! Works for me on the browsers that it's supposed to (FF, Chrome). There's something wrong my my XiphQT component (Ogg) so I couldn't get that part in Safari, but the WebM works fine through the QT component.
This reminds me, now that we're supporting more formats, does it make sense to link Extension:OggHandler/Client_download, should we providing that link even if TMH loads (so they can download alternate codecs), and shouldn't we be linking components like <http://code.google.com/p/webm/downloads/detail?name=WebM%20Component%20Inst…>?
No rush. Just thought I'd mention that before I forgot
On Jul 25, 2012, at 12:11 PM, j(a)thing.net wrote:
> Hi all,
>
> just wanted to let you know that labs has a mostly working setup of TMH
> again. We also pulled in updates form the kaltura branch of the
> javascript code to get improved fullscreen support and better subtitles.
>
> An example of a video with subtitles is at:
> http://commons.wikimedia.beta.wmflabs.org/wiki/File:Mandara_Online_-_Upper_…
>
> labs also has a videoscaler vm now that is setup with the puppet classes
> we can use in production once the servers are ready.
> (https://gerrit.wikimedia.org/r/#/c/16654/)
>
> so would be good to have another look at labs now and see if there are
> things missing to clean up and have another look at our changes in
> relation to security.
>
> I also updated the script to import Youtube videos (including subtitles)
> into mediawiki. Above link was imported using it.
> The script is currently at https://github.com/bit/youtube2mediawiki
>
> Jan
>