ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev

/Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]

Ah! So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule. The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < ebernhardson(a)wikimedia.org&gt; wrote: > replied on irc, but i'll add here too so others running into issue can > fix: > > The analytics role uses a couple submodules, init them in the vagrant > repository with: > > git submodule update --init --recursive > > On Mon, Jun 29, 2015 at 9:18 AM, James Douglas &lt;jdouglas(a)wikimedia.org > > wrote: > >> I'm having trouble enabling the analytics role on vagrant. Does this >> mean anything to anyone? >> >> ==> default: Error: Puppet::Parser::AST::Resource failed with error >>> ArgumentError: Could not find declared class ::cdh::hadoop at >>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>> on node mediawiki-vagrant.dev >>> >> >> I even tried vagrant destroying, and starting from scratch. It seems >> like maybe I need to apt-get install something Hadoop related, but my >> Google-fu isn't helping. >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > > _______________________________________________ Wikimedia-search mailing list Wikimedia-search(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search

Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up. I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down. I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it. On Jul 1, 2015, at 18:25, James Douglas &lt;jdouglas(a)wikimedia.org&gt; wrote: *bump* On Mon, Jun 29, 2015 at 2:36 PM, James Douglas &lt;jdouglas(a)wikimedia.org&gt; wrote: > // adding ottomata > > Now I'm running into a problem with my system missing oozie: > > ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >> trace for the error was (for debug purposes): >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> -------------------------------------- >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ExitCodeException exitCode=2: gzip: >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> This does not look like a tar archive >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> Exiting with failure status due to previous errors >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.run(Shell.java:455) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> -------------------------------------- >> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >> hdfs://mediawiki-vagrant.dev -locallib >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >> ==> default: Error: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >> hdfs://mediawiki-vagrant.dev -locallib >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >> > > > On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < > neverett(a)wikimedia.org&gt; wrote: > >> Ah! >> >> So lots of roles use submodules in the mediawiki code - but what you >> mean is that the _vagrant_ code needs a submodule. >> >> The "best" citizen thing to do would be to try to make the error >> message better. Something like "Could not find declared class ..... Try >> running git submodule update --init --recursive in the root of the vagrant >> checkout!" would have made this >> >> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >> ebernhardson(a)wikimedia.org&gt; wrote: >> >>> replied on irc, but i'll add here too so others running into issue >>> can fix: >>> >>> The analytics role uses a couple submodules, init them in the >>> vagrant repository with: >>> >>> git submodule update --init --recursive >>> >>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>> jdouglas(a)wikimedia.org&gt; wrote: >>> >>>> I'm having trouble enabling the analytics role on vagrant. Does >>>> this mean anything to anyone? >>>> >>>> ==> default: Error: Puppet::Parser::AST::Resource failed with error >>>>> ArgumentError: Could not find declared class ::cdh::hadoop at >>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>> on node mediawiki-vagrant.dev >>>>> >>>> >>>> I even tried vagrant destroying, and starting from scratch. It >>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>> Google-fu isn't helping. >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search(a)lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >>> _______________________________________________ >>> Wikimedia-search mailing list >>> Wikimedia-search(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>> >>> >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> >

Awesome, thanks! Trying it out now. On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto &lt;aotto(a)wikimedia.org&gt; wrote: > Thanks for the bump! I read this email on my phone some evening, and > then forgot to follow up. > > I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which > hopefully should fix. Try it out! You’ll need to run git submodule update > after you pull that down. > > I’m having a problem on my vagrant with getting the resource manager > http server to start, but I’m not really sure why. Let me know if you have > that problem too and I’ll continue to poke at it. > > > On Jul 1, 2015, at 18:25, James Douglas &lt;jdouglas(a)wikimedia.org&gt; > wrote: > > *bump* > > On Mon, Jun 29, 2015 at 2:36 PM, James Douglas &lt;jdouglas(a)wikimedia.org > > wrote: > >> // adding ottomata >> >> Now I'm running into a problem with my system missing oozie: >> >> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>> trace for the error was (for debug purposes): >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> -------------------------------------- >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> ExitCodeException exitCode=2: gzip: >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>> This does not look like a tar archive >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>> Exiting with failure status due to previous errors >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>> ==> default: Notice: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> -------------------------------------- >>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>> hdfs://mediawiki-vagrant.dev -locallib >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>> ==> default: Error: >>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>> hdfs://mediawiki-vagrant.dev -locallib >>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>> >> >> >> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >> neverett(a)wikimedia.org&gt; wrote: >> >>> Ah! >>> >>> So lots of roles use submodules in the mediawiki code - but what you >>> mean is that the _vagrant_ code needs a submodule. >>> >>> The "best" citizen thing to do would be to try to make the error >>> message better. Something like "Could not find declared class ..... Try >>> running git submodule update --init --recursive in the root of the vagrant >>> checkout!" would have made this >>> >>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>> ebernhardson(a)wikimedia.org&gt; wrote: >>> >>>> replied on irc, but i'll add here too so others running into issue >>>> can fix: >>>> >>>> The analytics role uses a couple submodules, init them in the >>>> vagrant repository with: >>>> >>>> git submodule update --init --recursive >>>> >>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>> jdouglas(a)wikimedia.org&gt; wrote: >>>> >>>>> I'm having trouble enabling the analytics role on vagrant. Does >>>>> this mean anything to anyone? >>>>> >>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>> on node mediawiki-vagrant.dev >>>>>> >>>>> >>>>> I even tried vagrant destroying, and starting from scratch. It >>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>> Google-fu isn't helping. >>>>> >>>>> _______________________________________________ >>>>> Wikimedia-search mailing list >>>>> Wikimedia-search(a)lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search(a)lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >>> _______________________________________________ >>> Wikimedia-search mailing list >>> Wikimedia-search(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>> >>> >> > >

Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:

wrote:

On Thu, Jul 2, 2015 at 2:05 PM, James Douglas &lt;jdouglas(a)wikimedia.org&gt; wrote: > Still no luck. It looks like it's merged into master, so I just need > to `git submodule update` from `vagrant/` right? > Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd You can even commit that sequence of events and add it for review. Nik > > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack > trace for the error was (for debug purposes): > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > -------------------------------------- > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > ExitCodeException exitCode=2: gzip: > /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: > This does not look like a tar archive > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: > Exiting with failure status due to previous errors > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) > ==> default: Notice: > /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: > at org.apache.hadoop.util.Shell.run(Shell.java:455) > > > > On Thu, Jul 2, 2015 at 9:15 AM, James Douglas &lt;jdouglas(a)wikimedia.org&gt; > wrote: > >> Awesome, thanks! Trying it out now. >> >> On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto &lt;aotto(a)wikimedia.org&gt; >> wrote: >> >>> Thanks for the bump! I read this email on my phone some evening, and >>> then forgot to follow up. >>> >>> I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which >>> hopefully should fix. Try it out! You’ll need to run git submodule update >>> after you pull that down. >>> >>> I’m having a problem on my vagrant with getting the resource manager >>> http server to start, but I’m not really sure why. Let me know if you have >>> that problem too and I’ll continue to poke at it. >>> >>> >>> On Jul 1, 2015, at 18:25, James Douglas &lt;jdouglas(a)wikimedia.org&gt; >>> wrote: >>> >>> *bump* >>> >>> On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < >>> jdouglas(a)wikimedia.org&gt; wrote: >>> >>>> // adding ottomata >>>> >>>> Now I'm running into a problem with my system missing oozie: >>>> >>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>>>> trace for the error was (for debug purposes): >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> -------------------------------------- >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> ExitCodeException exitCode=2: gzip: >>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>>> This does not look like a tar archive >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>>> Exiting with failure status due to previous errors >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>>>> ==> default: Notice: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> -------------------------------------- >>>>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>>>> hdfs://mediawiki-vagrant.dev -locallib >>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>>> ==> default: Error: >>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>>>> hdfs://mediawiki-vagrant.dev -locallib >>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>>> >>>> >>>> >>>> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >>>> neverett(a)wikimedia.org&gt; wrote: >>>> >>>>> Ah! >>>>> >>>>> So lots of roles use submodules in the mediawiki code - but what >>>>> you mean is that the _vagrant_ code needs a submodule. >>>>> >>>>> The "best" citizen thing to do would be to try to make the error >>>>> message better. Something like "Could not find declared class ..... Try >>>>> running git submodule update --init --recursive in the root of the vagrant >>>>> checkout!" would have made this >>>>> >>>>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>>>> ebernhardson(a)wikimedia.org&gt; wrote: >>>>> >>>>>> replied on irc, but i'll add here too so others running into >>>>>> issue can fix: >>>>>> >>>>>> The analytics role uses a couple submodules, init them in the >>>>>> vagrant repository with: >>>>>> >>>>>> git submodule update --init --recursive >>>>>> >>>>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>>>> jdouglas(a)wikimedia.org&gt; wrote: >>>>>> >>>>>>> I'm having trouble enabling the analytics role on vagrant. Does >>>>>>> this mean anything to anyone? >>>>>>> >>>>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>>>> on node mediawiki-vagrant.dev >>>>>>>> >>>>>>> >>>>>>> I even tried vagrant destroying, and starting from scratch. It >>>>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>>>> Google-fu isn't helping. >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Wikimedia-search mailing list >>>>>>> Wikimedia-search(a)lists.wikimedia.org >>>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Wikimedia-search mailing list >>>>>> Wikimedia-search(a)lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Wikimedia-search mailing list >>>>> Wikimedia-search(a)lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>> >>>>> >>>> >>> >>> >> > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > > _______________________________________________ Wikimedia-search mailing list Wikimedia-search(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search

Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :) On Jul 2, 2015, at 14:22, James Douglas &lt;jdouglas(a)wikimedia.org&gt; wrote: Getting closer! ==> default: Error: Could not start > Service[hadoop-yarn-resourcemanager]: Execution of > '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: > ==> default: Error: > /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: > change from stopped to running failed: Could not start > Service[hadoop-yarn-resourcemanager]: Execution of > '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: > On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett < neverett(a)wikimedia.org&gt; wrote: > > > On Thu, Jul 2, 2015 at 2:05 PM, James Douglas &lt;jdouglas(a)wikimedia.org&gt; > wrote: > >> Still no luck. It looks like it's merged into master, so I just need >> to `git submodule update` from `vagrant/` right? >> > > Only if the submodule was updated. That is a commit that has to be > done in the vagrant repository. You can update it youself with: > pushd <submodule dir> > git checkout master > git pull > popd > > You can even commit that sequence of events and add it for review. > > Nik > >> >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >> trace for the error was (for debug purposes): >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> -------------------------------------- >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ExitCodeException exitCode=2: gzip: >> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> This does not look like a tar archive >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >> Exiting with failure status due to previous errors >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >> ==> default: Notice: >> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >> at org.apache.hadoop.util.Shell.run(Shell.java:455) >> >> >> >> On Thu, Jul 2, 2015 at 9:15 AM, James Douglas &lt;jdouglas(a)wikimedia.org >> > wrote: >> >>> Awesome, thanks! Trying it out now. >>> >>> On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto &lt;aotto(a)wikimedia.org&gt; >>> wrote: >>> >>>> Thanks for the bump! I read this email on my phone some evening, >>>> and then forgot to follow up. >>>> >>>> I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which >>>> hopefully should fix. Try it out! You’ll need to run git submodule update >>>> after you pull that down. >>>> >>>> I’m having a problem on my vagrant with getting the resource >>>> manager http server to start, but I’m not really sure why. Let me know if >>>> you have that problem too and I’ll continue to poke at it. >>>> >>>> >>>> On Jul 1, 2015, at 18:25, James Douglas &lt;jdouglas(a)wikimedia.org&gt; >>>> wrote: >>>> >>>> *bump* >>>> >>>> On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < >>>> jdouglas(a)wikimedia.org&gt; wrote: >>>> >>>>> // adding ottomata >>>>> >>>>> Now I'm running into a problem with my system missing oozie: >>>>> >>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>>>>> trace for the error was (for debug purposes): >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> -------------------------------------- >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> ExitCodeException exitCode=2: gzip: >>>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>>>> This does not look like a tar archive >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>>>> Exiting with failure status due to previous errors >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>>>>> ==> default: Notice: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> -------------------------------------- >>>>>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>>>>> hdfs://mediawiki-vagrant.dev -locallib >>>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>>>> ==> default: Error: >>>>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>>>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>>>>> hdfs://mediawiki-vagrant.dev -locallib >>>>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>>>> >>>>> >>>>> >>>>> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >>>>> neverett(a)wikimedia.org&gt; wrote: >>>>> >>>>>> Ah! >>>>>> >>>>>> So lots of roles use submodules in the mediawiki code - but what >>>>>> you mean is that the _vagrant_ code needs a submodule. >>>>>> >>>>>> The "best" citizen thing to do would be to try to make the error >>>>>> message better. Something like "Could not find declared class ..... Try >>>>>> running git submodule update --init --recursive in the root of the vagrant >>>>>> checkout!" would have made this >>>>>> >>>>>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>>>>> ebernhardson(a)wikimedia.org&gt; wrote: >>>>>> >>>>>>> replied on irc, but i'll add here too so others running into >>>>>>> issue can fix: >>>>>>> >>>>>>> The analytics role uses a couple submodules, init them in the >>>>>>> vagrant repository with: >>>>>>> >>>>>>> git submodule update --init --recursive >>>>>>> >>>>>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>>>>> jdouglas(a)wikimedia.org&gt; wrote: >>>>>>> >>>>>>>> I'm having trouble enabling the analytics role on vagrant. >>>>>>>> Does this mean anything to anyone? >>>>>>>> >>>>>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>>>>> on node mediawiki-vagrant.dev >>>>>>>>> >>>>>>>> >>>>>>>> I even tried vagrant destroying, and starting from scratch. It >>>>>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>>>>> Google-fu isn't helping. >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> Wikimedia-search mailing list >>>>>>>> Wikimedia-search(a)lists.wikimedia.org >>>>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Wikimedia-search mailing list >>>>>>> Wikimedia-search(a)lists.wikimedia.org >>>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>>> >>>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Wikimedia-search mailing list >>>>>> Wikimedia-search(a)lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>> >>>>>> >>>>> >>>> >>>> >>> >> >> _______________________________________________ >> Wikimedia-search mailing list >> Wikimedia-search(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >> >> > > _______________________________________________ > Wikimedia-search mailing list > Wikimedia-search(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > >