On Jul 14, 2015, at 13:03, Kevin Smith
<ksmith(a)wikimedia.org> wrote:
If or when this is resolved, it would be great to reply back to this thread to close it
off.
Kevin Smith
Agile Coach
Wikimedia Foundation
Imagine a world in which every single human being can freely share in the sum of all
knowledge. That's our commitment. Help us make it a reality.
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
Tried starting over. Sadface ensued:
$ git submodule update --init --recursive
fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8
Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path
'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and
sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto <aotto(a)wikimedia.org
<mailto:aotto@wikimedia.org>> wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t
have to look into it today. Will check on that in a bit. James, what’s your IRC nick?
I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas
<jdouglas(a)wikimedia.org <mailto:jdouglas@wikimedia.org>> wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of
'/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
==> default: Error:
/Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure:
change from stopped to running failed: Could not start
Service[hadoop-yarn-resourcemanager]: Execution of
'/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett(a)wikimedia.org
<mailto:neverett@wikimedia.org>> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
Still no luck. It looks like it's merged into master, so I just need to `git
submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant
repository. You can update it youself with:
pushd <submodule dir>
git checkout master
git pull
popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the
error was (for debug purposes):
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
--------------------------------------
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException
exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not
look like a tar archive
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with
failure status due to previous errors
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto <aotto(a)wikimedia.org
<mailto:aotto@wikimedia.org>> wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to
follow up.
I just merged
https://gerrit.wikimedia.org/r/#/c/222312/
<https://gerrit.wikimedia.org/r/#/c/222312/>, which hopefully should fix. Try it
out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to
start, but I’m not really sure why. Let me know if you have that problem too and I’ll
continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas
<jdouglas(a)wikimedia.org <mailto:jdouglas@wikimedia.org>> wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the
error was (for debug purposes):
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
--------------------------------------
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException
exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not
look like a tar archive
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with
failure status due to previous errors
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.util.Shell.run(Shell.java:455)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at
org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57)
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
--------------------------------------
==> default: Error: /usr/bin/oozie-setup sharelib create -fs
hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz
returned 1 instead of one of [0]
==> default: Error:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun
to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev
<> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of
[0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett(a)wikimedia.org
<mailto:neverett@wikimedia.org>> wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the
_vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message
better. Something like "Could not find declared class ..... Try running git submodule
update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson(a)wikimedia.org
<mailto:ebernhardson@wikimedia.org>> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursive
On Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas(a)wikimedia.org
<mailto:jdouglas@wikimedia.org>> wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything
to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError:
Could not find declared class ::cdh::hadoop at
/vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node
mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need
to apt-get install something Hadoop related, but my Google-fu isn't helping.
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-search>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-search>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-search>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-search>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-search>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org <mailto:Wikimedia-search@lists.wikimedia.org>