I believe this is resolved, James, can you confirm?
On Jul 14, 2015, at 13:03, Kevin Smith <ksmith@wikimedia.org> wrote:

If or when this is resolved, it would be great to reply back to this thread to close it off.



Kevin Smith
Agile Coach
Wikimedia Foundation


Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment. Help us make it a reality.

On Thu, Jul 2, 2015 at 2:32 PM, James Douglas <jdouglas@wikimedia.org> wrote:
Tried starting over.  Sadface ensued:

$ git submodule update --init --recursive
fatal: reference is not a tree: 8845f99cda552ca518c00525e4942a4a70a42dd8
Unable to checkout '8845f99cda552ca518c00525e4942a4a70a42dd8' in submodule path 'puppet/modules/cdh'


On Thu, Jul 2, 2015 at 12:26 PM, James Douglas <jdouglas@wikimedia.org> wrote:
I'm earldouglas.  I'm always in wikimedia-search, -dev, and -operations, and sometimes pop in and out of -tech, -staff, and -office.

On Thu, Jul 2, 2015 at 12:22 PM, Andrew Otto <aotto@wikimedia.org> wrote:
Rats, that is the same error I was getting, I was hoping that was localized so I wouldn’t have to look into it today.  Will check on that in a bit.  James, what’s your IRC nick?  I’m ottomata.  Also, what rooms do you frequent? :)


On Jul 2, 2015, at 14:22, James Douglas <jdouglas@wikimedia.org> wrote:

Getting closer!

==> default: Error: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:
==> default: Error: /Stage[main]/Cdh::Hadoop::Resourcemanager/Service[hadoop-yarn-resourcemanager]/ensure: change from stopped to running failed: Could not start Service[hadoop-yarn-resourcemanager]: Execution of '/etc/init.d/hadoop-yarn-resourcemanager start' returned 1:


On Thu, Jul 2, 2015 at 11:10 AM, Nikolas Everett <neverett@wikimedia.org> wrote:


On Thu, Jul 2, 2015 at 2:05 PM, James Douglas <jdouglas@wikimedia.org> wrote:
Still no luck.  It looks like it's merged into master, so I just need to `git submodule update` from `vagrant/` right?

Only if the submodule was updated. That is a commit that has to be done in the vagrant repository. You can update it youself with:
pushd <submodule dir>
git checkout master
git pull
popd

You can even commit that sequence of events and add it for review.

Nik

==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes):
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: --------------------------------------
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.util.Shell.run(Shell.java:455)


On Thu, Jul 2, 2015 at 9:15 AM, James Douglas <jdouglas@wikimedia.org> wrote:
Awesome, thanks!  Trying it out now.

On Thu, Jul 2, 2015 at 8:07 AM, Andrew Otto <aotto@wikimedia.org> wrote:
Thanks for the bump! I read this email on my phone some evening, and then forgot to follow up.

I just merged https://gerrit.wikimedia.org/r/#/c/222312/, which hopefully should fix.  Try it out! You’ll need to run git submodule update after you pull that down.

I’m having a problem on my vagrant with getting the resource manager http server to start, but I’m not really sure why.  Let me know if you have that problem too and I’ll continue to poke at it.


On Jul 1, 2015, at 18:25, James Douglas <jdouglas@wikimedia.org> wrote:

*bump*

On Mon, Jun 29, 2015 at 2:36 PM, James Douglas <jdouglas@wikimedia.org> wrote:
// adding ottomata

Now I'm running into a problem with my system missing oozie:

==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: Stack trace for the error was (for debug purposes):
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: --------------------------------------
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: ExitCodeException exitCode=2: gzip: /usr/lib/oozie/oozie-sharelib-yarn.tar.gz: No such file or directory
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: This does not look like a tar archive
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: tar: Exiting with failure status due to previous errors
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.util.Shell.run(Shell.java:455)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.fs.FileUtil.unTarUsingTar(FileUtil.java:675)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.hadoop.fs.FileUtil.unTar(FileUtil.java:651)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:131)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns:      at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57)
==> default: Notice: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: --------------------------------------
==> default: Error: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]
==> default: Error: /Stage[main]/Cdh::Oozie::Server/Exec[oozie_sharelib_install]/returns: change from notrun to 0 failed: /usr/bin/oozie-setup sharelib create -fs hdfs://mediawiki-vagrant.dev -locallib /usr/lib/oozie/oozie-sharelib-yarn.tar.gz returned 1 instead of one of [0]


On Mon, Jun 29, 2015 at 11:03 AM, Nikolas Everett <neverett@wikimedia.org> wrote:
Ah!

So lots of roles use submodules in the mediawiki code - but what you mean is that the _vagrant_ code needs a submodule.

The "best" citizen thing to do would be to try to make the error message better. Something like "Could not find declared class ..... Try running git submodule update --init --recursive in the root of the vagrant checkout!" would have made this

On Mon, Jun 29, 2015 at 12:54 PM, Erik Bernhardson <ebernhardson@wikimedia.org> wrote:
replied on irc, but i'll add here too so others running into issue can fix:

The analytics role uses a couple submodules, init them in the vagrant repository with:

    git submodule update --init --recursive

On Mon, Jun 29, 2015 at 9:18 AM, James Douglas <jdouglas@wikimedia.org> wrote:
I'm having trouble enabling the analytics role on vagrant.  Does this mean anything to anyone?

==> default: Error: Puppet::Parser::AST::Resource failed with error ArgumentError: Could not find declared class ::cdh::hadoop at
                     /vagrant/puppet/modules/role/
manifests/hadoop.pp:45 on node mediawiki-vagrant.dev

I even tried vagrant destroying, and starting from scratch.  It seems like maybe I need to apt-get install something Hadoop related, but my Google-fu isn't helping.

_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search



_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search



_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search







_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search



_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search






_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search