Now we're getting somewhere.
It looks like late yesterday TMH started processing it's queue again. However, recent uploads such as http://commons.wikimedia.beta.wmflabs.org/wiki/File:SSA50074.ogv are showing errors of the form:
'/usr/bin/ffmpeg2theora' '/mnt/upload6/wikipedia/commons/c/c1/SSA50074.ogv' -V '160' -F '15' -a '-1' -H '44100' -c '2' --no-upscaling --two-pass --keyint '128' --buf-delay '256' --width '214' --height '160' --aspect '214:160' -o '/tmp/transcode_160p.ogv396b805-1.ogv'
/usr/local/apache/common-local/php-trunk/bin/ulimit4.sh: line 4: /usr/bin/ffmpeg2theora: No such file or directory
On Tue, May 22, 2012 at 2:15 PM, Michael Dale mdale@wikimedia.org wrote:
Looks like the path to ffmpeg2theora no longer exists? Jan can you take a look?
--michael
$ for box in deployment-{jobrunner0{1..2},dbdump,apache2{0..3},thumbproxy,syslog,cache-{upload,bits},feed,imagescaler01,squid,mc,nfs-memc,transcoding,wmsearch,sql}; do printf '%-27s %s\n' "$box:" "$(ssh ${box}.pmtpa.wmflabs 'ls -lk /usr/bin/ffmpeg2theora 2>&1')"; done 2>/dev/null deployment-jobrunner01: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-jobrunner02: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-dbdump: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-apache20: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-apache21: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-apache22: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-apache23: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-thumbproxy: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-syslog: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-cache-upload: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-cache-bits: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-feed: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-imagescaler01: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-squid: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-mc: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-nfs-memc: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-transcoding: -rwxr-xr-x 1 root root 8142 2011-12-21 10:51 /usr/bin/ffmpeg2theora deployment-wmsearch: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory deployment-sql: ls: cannot access /usr/bin/ffmpeg2theora: No such file or directory
-Jeremy
The new labs setup needer newer ffmpeg/libav(>0.6.1) and ffmpeg2theora(>0.27) packages, i made them available in a ppa[1] but how can we get them into apt.wikimedia.org? any pointers are welcome.[2]
transcoding is moving from a special vm to the job-runner instances, they currently dont have the required packages installed and need some configuration settings to run longer and crate larger files:
$wgTranscodeBackgroundTimeLimit = 3600 * 4; $wgMaxShellMemory = 3000000; $wgMaxShellTime = 3600 * 4; $wgMaxShellFileSize = 100*102400;
without those, encoding tasks will be terminated before completion.
In addition TMH creates transcodes in the temp folder(/tmp by default, can be changed by setting $TEMP, $TMP or $TMPDIR environment variable) so job-runners need to have enough space there.
[1] https://launchpad.net/~j/+archive/timedmediahandler [2] https://bugzilla.wikimedia.org/show_bug.cgi?id=37043
On 05/22/2012 08:15 PM, Michael Dale wrote:
Looks like the path to ffmpeg2theora no longer exists? Jan can you take a look?
--michael
On 05/22/2012 11:05 AM, Chris McMahon wrote:
Now we're getting somewhere.
It looks like late yesterday TMH started processing it's queue again. However, recent uploads such as http://commons.wikimedia.beta.wmflabs.org/wiki/File:SSA50074.ogv are showing errors of the form:
'/usr/bin/ffmpeg2theora' '/mnt/upload6/wikipedia/commons/c/c1/SSA50074.ogv' -V '160' -F '15' -a '-1' -H '44100' -c '2' --no-upscaling --two-pass --keyint '128' --buf-delay '256' --width '214' --height '160' --aspect '214:160' -o '/tmp/transcode_160p.ogv396b805-1.ogv'
/usr/local/apache/common-local/php-trunk/bin/ulimit4.sh: line 4: /usr/bin/ffmpeg2theora: No such file or directory
Wikivideo-l mailing list Wikivideo-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikivideo-l
Petr or Andrew,
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
Thanks a bunch!
Michael and Jan,
Is there any other stuff that might not be in the puppettization for building out the machines?
Take care,
terry
On May 22, 2012, at 11:05 AM, Chris McMahon wrote:
Now we're getting somewhere.
It looks like late yesterday TMH started processing it's queue again. However, recent uploads such as http://commons.wikimedia.beta.wmflabs.org/wiki/File:SSA50074.ogv are showing errors of the form:
'/usr/bin/ffmpeg2theora' '/mnt/upload6/wikipedia/commons/c/c1/SSA50074.ogv' -V '160' -F '15' -a '-1' -H '44100' -c '2' --no-upscaling --two-pass --keyint '128' --buf-delay '256' --width '214' --height '160' --aspect '214:160' -o '/tmp/transcode_160p.ogv396b805-1.ogv'
/usr/local/apache/common-local/php-trunk/bin/ulimit4.sh: line 4: /usr/bin/ffmpeg2theora: No such file or directory
Wikivideo-l mailing list Wikivideo-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikivideo-l
On Tue, May 22, 2012 at 5:06 PM, Terry Chay tchay@wikimedia.org wrote:
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
(Adding Antoine; see http://lists.wikimedia.org/pipermail/wikivideo-l/2012-May/000106.html )
Another remaining issue is that thumbnail generation is broken, e.g.:
http://upload.beta.wmflabs.org/wikipedia/commons/thumb/2/2a/Kiril_Lazarov_06...
The performance of deployment-prep seems much better, though. :)
Erik Moeller wrote:
On Tue, May 22, 2012 at 5:06 PM, Terry Chay tchay@wikimedia.org wrote:
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
(Adding Antoine; see http://lists.wikimedia.org/pipermail/wikivideo-l/2012-May/000106.html )
Hello Erik,
Thanks for the CC:, I completely forgot to subscribe to it following Chris announce some days ago.
I have replied to Terry message on the wikivideo-l mailing list: http://lists.wikimedia.org/pipermail/wikivideo-l/2012-May/000109.html
Another remaining issue is that thumbnail generation is broken, e.g.:
http://upload.beta.wmflabs.org/wikipedia/commons/thumb/2/2a/Kiril_Lazarov_06...
The performance of deployment-prep seems much better, though. :)
There is still a lot to do. thumb URL being part of it :-D I will add a bug in bugzilla so we can track that issue.
Le 23/05/12 02:06, Terry Chay wrote:
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
Exactly. The first thing I did when entering the beta project has been to rebuild the software installations from scratch and setup basic utilities on par with production.
For later reference, the TimeMediaHandler resizing is probably going to be done by the instances named deployment-jobrunnerXX .
The operations/puppet repository has a manifests/timedmediahandler.pp but it probably need to be rewritten differently.
There is definitely a long list of prerequisites before even having everything properly setup. Meanwhile, can everyone please open bug report in bugzilla.wikimedia.org whenever something is wrong or need to be implemented? That will makes things easier to track ;-]
Terry --
On 5/22/12 7:06 PM, Terry Chay wrote:
Petr or Andrew,
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
ffmpeg is a part of the imagescaler class, but ffmpeg2theora doesn't seem to be a part of ffmpeg. I've added ffmpeg2theora to imagescaler as well, so it should appear on those systems that include that class (e.g. deployment-imagescaler01). Will that get you what you need? Is it appropriate to associate ffmpeg2theora with scaling? And, do you happen to know if this change is appropriate for puppet in production as well?
-Andrew
Andrew,
1) Thanks a lot! 2) My bad. I shouldn't have said ffmpeg before realizing that the packages needed were different. 3) I guess I should leave it up to you and Jan Gerber (in the cc:) to hash out some details. Please read http://lists.wikimedia.org/pipermail/wikivideo-l/2012-May/000110.html so it doesn't get messed up in the telephone game. :-)
Antoine,
Will https://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
Take care,
terry On May 22, 2012, at 7:52 PM, Andrew Bogott wrote:
Terry --
On 5/22/12 7:06 PM, Terry Chay wrote:
Petr or Andrew,
It looks like ffmpeg2theora is no longer on these machines. My guess is that ffmpeg was never added to the puppet config and got blasted when we redid the hardware. Can you add this binary and puppetize the config so this doesn't happen again?
ffmpeg is a part of the imagescaler class, but ffmpeg2theora doesn't seem to be a part of ffmpeg. I've added ffmpeg2theora to imagescaler as well, so it should appear on those systems that include that class (e.g. deployment-imagescaler01). Will that get you what you need? Is it appropriate to associate ffmpeg2theora with scaling? And, do you happen to know if this change is appropriate for puppet in production as well?-Andrew
Hi Terry,
On Wed, May 23, 2012 at 08:49:05AM -0700, Terry Chay wrote:
Will https://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
I think https://bugzilla.wikimedia.org/show_bug.cgi?id=37043 is a better, even if it describes another variant of the problem.
Regards, Faidon
Are you guys unstuck for testing and development?
On May 23, 2012, at 9:00 AM, Faidon Liambotis wrote:
Hi Terry,
On Wed, May 23, 2012 at 08:49:05AM -0700, Terry Chay wrote:
Will https://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
I think https://bugzilla.wikimedia.org/show_bug.cgi?id=37043 is a better, even if it describes another variant of the problem.
Regards, Faidon
The videos are not working in Safari. They work in Firefox except for the all the play, pause etc buttons are not showing in firefox. Bugs are filed...
https://bugzilla.wikimedia.org/show_bug.cgi?id=37513 https://bugzilla.wikimedia.org/show_bug.cgi?id=37514
Thanks,
Tauhida
On May 29, 2012, at 5:44 PM, Terry Chay wrote:
Are you guys unstuck for testing and development?
On May 23, 2012, at 9:00 AM, Faidon Liambotis wrote:
Hi Terry,
On Wed, May 23, 2012 at 08:49:05AM -0700, Terry Chay wrote:
Will https://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
I think https://bugzilla.wikimedia.org/show_bug.cgi?id=37043 is a better, even if it describes another variant of the problem.
Regards, Faidon
Wikivideo-l mailing list Wikivideo-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikivideo-l
Thanks for the bug report.
I have done a pass on the TMH extension brining it up to date with file repo changes as well as the upstream kaltura player updates ( fullscreen support, improved player performance & stability ) https://gerrit.wikimedia.org/r/#/q/status:open+project:mediawiki/extensions/... and https://gerrit.wikimedia.org/r/#/q/status:open+project:mediawiki/extensions/...
I will take a look at the safari issue shortly and update the respective bug.
thanks again for the effort, looking forward to closing any remaining opened issues.
peace, michael
On 06/12/2012 09:05 AM, Tauhida Parveen wrote:
The videos are not working in Safari. They work in Firefox except for the all the play, pause etc buttons are not showing in firefox. Bugs are filed...
https://bugzilla.wikimedia.org/show_bug.cgi?id=37513 https://bugzilla.wikimedia.org/show_bug.cgi?id=37514
Thanks,
Tauhida
On May 29, 2012, at 5:44 PM, Terry Chay wrote:
Are you guys unstuck for testing and development?
On May 23, 2012, at 9:00 AM, Faidon Liambotis wrote:
Hi Terry,
On Wed, May 23, 2012 at 08:49:05AM -0700, Terry Chay wrote:
Willhttps://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
I think https://bugzilla.wikimedia.org/show_bug.cgi?id=37043 is a better, even if it describes another variant of the problem.
Regards, Faidon
Wikivideo-l mailing list Wikivideo-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikivideo-l
Wikivideo-l mailing list Wikivideo-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikivideo-l
Le 23/05/12 17:49, Terry Chay a écrit :
Antoine,
Will https://bugzilla.wikimedia.org/show_bug.cgi?id=37036 do or should we use something else?
That will work, together with its pending bug about updating the ffmpeg packages: https://bugzilla.wikimedia.org/show_bug.cgi?id=37043
:)
wikivideo-l@lists.wikimedia.org