I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursive
On Mon, Jun 29, 2015 at 9:18 AM, James Douglas jdouglas@wikimedia.org wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas jdouglas@wikimedia.org wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett neverett@wikimedia.org wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas jdouglas@wikimedia.org wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas jdouglas@wikimedia.org wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett neverett@wikimedia.org wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas jdouglas@wikimedia.org wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/ https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: // adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote: Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson@wikimedia.org mailto:ebernhardson@wikimedia.org> wrote: replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas jdouglas@wikimedia.org wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org
wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas jdouglas@wikimedia.org wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error
ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas jdouglas@wikimedia.org wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org
wrote:
I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error > ArgumentError: Could not find declared class ::cdh::hadoop at > /vagrant/puppet/modules/role/manifests/hadoop.pp:45 > on node mediawiki-vagrant.dev >
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas jdouglas@wikimedia.org wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas < jdouglas@wikimedia.org> wrote:
> I'm having trouble enabling the analytics role on vagrant. Does > this mean anything to anyone? > > ==> default: Error: Puppet::Parser::AST::Resource failed with error >> ArgumentError: Could not find declared class ::cdh::hadoop at >> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >> on node mediawiki-vagrant.dev >> > > I even tried vagrant destroying, and starting from scratch. It > seems like maybe I need to apt-get install something Hadoop related, but my > Google-fu isn't helping. > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]:
Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett neverett@wikimedia.org wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas jdouglas@wikimedia.org wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice:
/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson@wikimedia.org> wrote:
> replied on irc, but i'll add here too so others running into issue > can fix: > > The analytics role uses a couple submodules, init them in the > vagrant repository with: > > git submodule update --init --recursive > > On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < > jdouglas@wikimedia.org> wrote: > >> I'm having trouble enabling the analytics role on vagrant. Does >> this mean anything to anyone? >> >> ==> default: Error: Puppet::Parser::AST::Resource failed with error >>> ArgumentError: Could not find declared class ::cdh::hadoop at >>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>> on node mediawiki-vagrant.dev >>> >> >> I even tried vagrant destroying, and starting from scratch. It >> seems like maybe I need to apt-get install something Hadoop related, but my >> Google-fu isn't helping. >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto <aotto@wikimedia.org mailto:aotto@wikimedia.org> wrote: Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/ https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: // adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote: Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson@wikimedia.org mailto:ebernhardson@wikimedia.org> wrote: replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto aotto@wikimedia.org wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]:
Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett neverett@wikimedia.org wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org
wrote:
// adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack > trace for the error was (for debug purposes): > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > -------------------------------------- > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > ExitCodeException exitCode=2: gzip: > /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: > This does not look like a tar archive > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: > Exiting with failure status due to previous errors > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.util.Shell.run(Shell.java:455) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > -------------------------------------- > ==> default: Error: /usr/bin/oozie-setup sharelib create -fs > hdfs://mediawiki-vagrant.dev -locallib > /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] > ==> default: Error: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs > hdfs://mediawiki-vagrant.dev -locallib > /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
> Ah! > > So lots of roles use submodules in the mediawiki code - but what you > mean is that the _vagrant_ code needs a submodule. > > The "best" citizen thing to do would be to try to make the error > message better. Something like "Could not find declared class ..... Try > running git submodule update --init --recursive in the root of the vagrant > checkout!" would have made this > > On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < > ebernhardson@wikimedia.org> wrote: > >> replied on irc, but i'll add here too so others running into issue >> can fix: >> >> The analytics role uses a couple submodules, init them in the >> vagrant repository with: >> >> git submodule update --init --recursive >> >> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >> jdouglas@wikimedia.org> wrote: >> >>> I'm having trouble enabling the analytics role on vagrant. Does >>> this mean anything to anyone? >>> >>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>> on node mediawiki-vagrant.dev >>>> >>> >>> I even tried vagrant destroying, and starting from scratch. It >>> seems like maybe I need to apt-get install something Hadoop related, but my >>> Google-fu isn't helping. >>> >>> _______________________________________________ >>> Wikimedia-search mailing list >>> Wikimedia-search@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>> >>> >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas jdouglas@wikimedia.org wrote:
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto aotto@wikimedia.org wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]:
Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett neverett@wikimedia.org wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < jdouglas@wikimedia.org> wrote:
> // adding ottomata > > Now I'm running into a problem with my system missing oozie: > > ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >> trace for the error was (for debug purposes): >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> -------------------------------------- >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ExitCodeException exitCode=2: gzip: >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> This does not look like a tar archive >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> Exiting with failure status due to previous errors >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.run(Shell.java:455) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> -------------------------------------- >> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >> hdfs://mediawiki-vagrant.dev -locallib >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >> ==> default: Error: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >> hdfs://mediawiki-vagrant.dev -locallib >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >> > > > On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < > neverett@wikimedia.org> wrote: > >> Ah! >> >> So lots of roles use submodules in the mediawiki code - but what >> you mean is that the _vagrant_ code needs a submodule. >> >> The "best" citizen thing to do would be to try to make the error >> message better. Something like "Could not find declared class ..... Try >> running git submodule update --init --recursive in the root of the vagrant >> checkout!" would have made this >> >> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >> ebernhardson@wikimedia.org> wrote: >> >>> replied on irc, but i'll add here too so others running into issue >>> can fix: >>> >>> The analytics role uses a couple submodules, init them in the >>> vagrant repository with: >>> >>> git submodule update --init --recursive >>> >>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>> jdouglas@wikimedia.org> wrote: >>> >>>> I'm having trouble enabling the analytics role on vagrant. Does >>>> this mean anything to anyone? >>>> >>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>> on node mediawiki-vagrant.dev >>>>> >>>> >>>> I even tried vagrant destroying, and starting from scratch. It >>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>> Google-fu isn't helping. >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >>> _______________________________________________ >>> Wikimedia-search mailing list >>> Wikimedia-search@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>> >>> >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
If or when this is resolved, it would be great to reply back to this thread to close it off.
Kevin Smith Agile Coach Wikimedia Foundation
*Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.*
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas jdouglas@wikimedia.org wrote:
Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas jdouglas@wikimedia.org wrote:
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto aotto@wikimedia.org wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start
Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett@wikimedia.org
wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas jdouglas@wikimedia.org wrote:
Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org wrote:
> Thanks for the bump! I read this email on my phone some evening, and > then forgot to follow up. > > I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which > hopefully should fix. Try it out! You’ll need to run git submodule update > after you pull that down. > > I’m having a problem on my vagrant with getting the resource manager > http server to start, but I’m not really sure why. Let me know if you have > that problem too and I’ll continue to poke at it. > > > On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org > wrote: > > *bump* > > On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < > jdouglas@wikimedia.org> wrote: > >> // adding ottomata >> >> Now I'm running into a problem with my system missing oozie: >> >> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>> trace for the error was (for debug purposes): >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> -------------------------------------- >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> ExitCodeException exitCode=2: gzip: >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>> This does not look like a tar archive >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>> Exiting with failure status due to previous errors >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> -------------------------------------- >>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>> hdfs://mediawiki-vagrant.dev -locallib >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>> ==> default: Error: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>> hdfs://mediawiki-vagrant.dev -locallib >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>> >> >> >> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >> neverett@wikimedia.org> wrote: >> >>> Ah! >>> >>> So lots of roles use submodules in the mediawiki code - but what >>> you mean is that the _vagrant_ code needs a submodule. >>> >>> The "best" citizen thing to do would be to try to make the error >>> message better. Something like "Could not find declared class ..... Try >>> running git submodule update --init --recursive in the root of the vagrant >>> checkout!" would have made this >>> >>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>> ebernhardson@wikimedia.org> wrote: >>> >>>> replied on irc, but i'll add here too so others running into >>>> issue can fix: >>>> >>>> The analytics role uses a couple submodules, init them in the >>>> vagrant repository with: >>>> >>>> git submodule update --init --recursive >>>> >>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>> jdouglas@wikimedia.org> wrote: >>>> >>>>> I'm having trouble enabling the analytics role on vagrant. Does >>>>> this mean anything to anyone? >>>>> >>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>> on node mediawiki-vagrant.dev >>>>>> >>>>> >>>>> I even tried vagrant destroying, and starting from scratch. It >>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>> Google-fu isn't helping. >>>>> >>>>> _______________________________________________ >>>>> Wikimedia-search mailing list >>>>> Wikimedia-search@lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >>> _______________________________________________ >>> Wikimedia-search mailing list >>> Wikimedia-search@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>> >>> >> > >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
I believe this is resolved, James, can you confirm?
On Jul 14, 2015, at 13:03, Kevin Smith ksmith@wikimedia.org wrote:
If or when this is resolved, it would be great to reply back to this thread to close it off.
Kevin Smith Agile Coach Wikimedia Foundation
Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto <aotto@wikimedia.org mailto:aotto@wikimedia.org> wrote: Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto <aotto@wikimedia.org mailto:aotto@wikimedia.org> wrote: Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/ https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: // adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote: Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson@wikimedia.org mailto:ebernhardson@wikimedia.org> wrote: replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
I never made it past the following error:
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
But it's no longer a blocker, since we put the HDFS task on the back burner.
On Tue, Jul 14, 2015 at 1:51 PM, Andrew Otto aotto@wikimedia.org wrote:
I believe this is resolved, James, can you confirm?
On Jul 14, 2015, at 13:03, Kevin Smith ksmith@wikimedia.org wrote:
If or when this is resolved, it would be great to reply back to this thread to close it off.
Kevin Smith Agile Coach Wikimedia Foundation
*Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.*
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas jdouglas@wikimedia.org wrote:
Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas jdouglas@wikimedia.org wrote:
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto aotto@wikimedia.org wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start
Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org > wrote:
> Awesome, thanks! Trying it out now. > > On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org > wrote: > >> Thanks for the bump! I read this email on my phone some evening, >> and then forgot to follow up. >> >> I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which >> hopefully should fix. Try it out! You’ll need to run git submodule update >> after you pull that down. >> >> I’m having a problem on my vagrant with getting the resource >> manager http server to start, but I’m not really sure why. Let me know if >> you have that problem too and I’ll continue to poke at it. >> >> >> On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org >> wrote: >> >> *bump* >> >> On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < >> jdouglas@wikimedia.org> wrote: >> >>> // adding ottomata >>> >>> Now I'm running into a problem with my system missing oozie: >>> >>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>>> trace for the error was (for debug purposes): >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> -------------------------------------- >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> ExitCodeException exitCode=2: gzip: >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>> This does not look like a tar archive >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>> Exiting with failure status due to previous errors >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> -------------------------------------- >>>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>>> hdfs://mediawiki-vagrant.dev -locallib >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>> ==> default: Error: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>>> hdfs://mediawiki-vagrant.dev -locallib >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>> >>> >>> >>> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >>> neverett@wikimedia.org> wrote: >>> >>>> Ah! >>>> >>>> So lots of roles use submodules in the mediawiki code - but what >>>> you mean is that the _vagrant_ code needs a submodule. >>>> >>>> The "best" citizen thing to do would be to try to make the error >>>> message better. Something like "Could not find declared class ..... Try >>>> running git submodule update --init --recursive in the root of the vagrant >>>> checkout!" would have made this >>>> >>>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>>> ebernhardson@wikimedia.org> wrote: >>>> >>>>> replied on irc, but i'll add here too so others running into >>>>> issue can fix: >>>>> >>>>> The analytics role uses a couple submodules, init them in the >>>>> vagrant repository with: >>>>> >>>>> git submodule update --init --recursive >>>>> >>>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>>> jdouglas@wikimedia.org> wrote: >>>>> >>>>>> I'm having trouble enabling the analytics role on vagrant. >>>>>> Does this mean anything to anyone? >>>>>> >>>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>>> on node mediawiki-vagrant.dev >>>>>>> >>>>>> >>>>>> I even tried vagrant destroying, and starting from scratch. It >>>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>>> Google-fu isn't helping. >>>>>> >>>>>> _______________________________________________ >>>>>> Wikimedia-search mailing list >>>>>> Wikimedia-search@lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Wikimedia-search mailing list >>>>> Wikimedia-search@lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >> >> >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
wikimedia-search@lists.wikimedia.org