I believe this is resolved, James, can you confirm?
On Jul 14, 2015, at 13:03, Kevin Smith ksmith@wikimedia.org wrote:
If or when this is resolved, it would be great to reply back to this thread to close it off.
Kevin Smith Agile Coach Wikimedia Foundation
Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.
On Thu, Jul 2, 2015 at 2:32 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Tried starting over. Sadface ensued:
$ git submodule update --init --recursive fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8 Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'
On Thu, Jul 2, 2015 at 12:26 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm earldouglas. I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.
On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto <aotto@wikimedia.org mailto:aotto@wikimedia.org> wrote: Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today. Will check on that in a bit. James, what’s your IRC nick? I’m ottomata. Also, what rooms do you frequent? :)
On Jul 2, 2015, at 14:22, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote:
Getting closer!
==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1: ==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote:
On Thu, Jul 2, 2015 at 2:05 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Still no luck. It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?
Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with: pushd <submodule dir> git checkout master git pull popd
You can even commit that sequence of events and add it for review.
Nik
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455)
On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: Awesome, thanks! Trying it out now.
On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto <aotto@wikimedia.org mailto:aotto@wikimedia.org> wrote: Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.
I just merged https://gerrit.wikimedia.org/r/#/c/222312/ https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix. Try it out! You’ll need to run git submodule update after you pull that down.
I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why. Let me know if you have that problem too and I’ll continue to poke at it.
On Jul 1, 2015, at 18:25, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote:
*bump*
On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: // adding ottomata
Now I'm running into a problem with my system missing oozie:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes): ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell.run(Shell.java:455) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57) ==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: -------------------------------------- ==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0] ==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev <> -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org mailto:neverett@wikimedia.org> wrote: Ah!
So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.
The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this
On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson@wikimedia.org mailto:ebernhardson@wikimedia.org> wrote: replied on irc, but i'll add here too so others running into issue can fix:
The analytics role uses a couple submodules, init them in the vagrant repository with:
git submodule update --init --recursiveOn Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org mailto:jdouglas@wikimedia.org> wrote: I'm having trouble enabling the analytics role on vagrant. Does this mean anything to anyone?
==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::cdh::hadoop at /vagrant/puppet/modules/role/manifests/hadoop.pp:45 on node mediawiki-vagrant.dev
I even tried vagrant destroying, and starting from scratch. It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
Wikimedia-search mailing list Wikimedia-search@lists.wikimedia.org mailto:Wikimedia-search@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimedia-search https://lists.wikimedia.org/mailman/listinfo/wikimedia-search