I never made it past the following error:
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
But it's no longer a blocker, since we put the HDFS task on the back burner.
On Tue, Jul 14, 2015 at 1:51 PM, Andrew Otto aotto@wikimedia.org wrote:
I believe this is resolved, James, can you confirm?
On Jul 14, 2015, at 13:03, Kevin Smith ksmith@wikimedia.org wrote:
If or when this is resolved, it would be great to reply back to this thread to close it off.
Kevin Smith Agile Coach Wikimedia Foundation
*Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.*
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas jdouglas@wikimedia.org wrote:
Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas jdouglas@wikimedia.org wrote:
I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto aotto@wikimedia.org wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas jdouglas@wikimedia.org wrote:
Getting closer!
==> default: Error: Could not start
Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett < neverett@wikimedia.org> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas jdouglas@wikimedia.org wrote:
Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org > wrote:
> Awesome, thanks! Trying it out now. > > On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto aotto@wikimedia.org > wrote: > >> Thanks for the bump! I read this email on my phone some evening, >> and then forgot to follow up. >> >> I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which >> hopefully should fix. Try it out! You’ll need to run git submodule update >> after you pull that down. >> >> I’m having a problem on my vagrant with getting the resource >> manager http server to start, but I’m not really sure why. Let me know if >> you have that problem too and I’ll continue to poke at it. >> >> >> On Jul 1, 2015, at 18:25, James Douglas jdouglas@wikimedia.org >> wrote: >> >> *bump* >> >> On Mon, Jun 29, 2015 at 2:36 PM, James Douglas < >> jdouglas@wikimedia.org> wrote: >> >>> // adding ottomata >>> >>> Now I'm running into a problem with my system missing oozie: >>> >>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack >>>> trace for the error was (for debug purposes): >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> -------------------------------------- >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> ExitCodeException exitCode=2: gzip: >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>> This does not look like a tar archive >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: >>>> Exiting with failure status due to previous errors >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell.run(Shell.java:455) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) >>>> ==> default: Notice: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> -------------------------------------- >>>> ==> default: Error: /usr/bin/oozie-setup sharelib create -fs >>>> hdfs://mediawiki-vagrant.dev -locallib >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>> ==> default: Error: >>>> /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: >>>> change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs >>>> hdfs://mediawiki-vagrant.dev -locallib >>>> /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] >>>> >>> >>> >>> On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett < >>> neverett@wikimedia.org> wrote: >>> >>>> Ah! >>>> >>>> So lots of roles use submodules in the mediawiki code - but what >>>> you mean is that the _vagrant_ code needs a submodule. >>>> >>>> The "best" citizen thing to do would be to try to make the error >>>> message better. Something like "Could not find declared class ..... Try >>>> running git submodule update --init --recursive in the root of the vagrant >>>> checkout!" would have made this >>>> >>>> On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson < >>>> ebernhardson@wikimedia.org> wrote: >>>> >>>>> replied on irc, but i'll add here too so others running into >>>>> issue can fix: >>>>> >>>>> The analytics role uses a couple submodules, init them in the >>>>> vagrant repository with: >>>>> >>>>> git submodule update --init --recursive >>>>> >>>>> On Mon, Jun 29, 2015 at 9:18 AM, James Douglas < >>>>> jdouglas@wikimedia.org> wrote: >>>>> >>>>>> I'm having trouble enabling the analytics role on vagrant. >>>>>> Does this mean anything to anyone? >>>>>> >>>>>> ==> default: Error: Puppet::Parser::AST::Resource failed with >>>>>>> error ArgumentError: Could not find declared class ::cdh::hadoop at >>>>>>> /vagrant/puppet/modules/role/manifests/hadoop.pp:45 >>>>>>> on node mediawiki-vagrant.dev >>>>>>> >>>>>> >>>>>> I even tried vagrant destroying, and starting from scratch. It >>>>>> seems like maybe I need to apt-get install something Hadoop related, but my >>>>>> Google-fu isn't helping. >>>>>> >>>>>> _______________________________________________ >>>>>> Wikimedia-search mailing list >>>>>> Wikimedia-search@lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>>> >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Wikimedia-search mailing list >>>>> Wikimedia-search@lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Wikimedia-search mailing list >>>> Wikimedia-search@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/wikimedia-search >>>> >>>> >>> >> >> >
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search