<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">On 13/01/2013 01:25, Ryan Lane wrote:<br>
    </div>
    <blockquote
cite="mid:CALKgCA1v2OEHjaUGmF51_d9yMNNBejsCQ1Do4A+G9R30vFB2pA@mail.gmail.com"
      type="cite">
      <div dir="ltr">On Sat, Jan 12, 2013 at 4:44 PM, Ryan Lane <span
          dir="ltr"><<a moz-do-not-send="true"
            href="mailto:rlane32@gmail.com" target="_blank">rlane32@gmail.com</a>></span>
        wrote:<br>
        <div class="gmail_extra">
          <div class="gmail_quote">
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
              0.8ex;border-left:1px solid
              rgb(204,204,204);padding-left:1ex">
              <div dir="ltr">
                <div class="im">On Fri, Jan 11, 2013 at 11:32 PM, Petr
                  Bena <span dir="ltr"><<a moz-do-not-send="true"
                      href="mailto:benapetr@gmail.com" target="_blank">benapetr@gmail.com</a>></span>
                  wrote:<br>
                </div>
                <div class="gmail_extra">
                  <div class="gmail_quote">
                    <div class="im">
                      <blockquote class="gmail_quote" style="margin:0px
                        0px 0px 0.8ex;border-left:1px solid
                        rgb(204,204,204);padding-left:1ex">
                        <div dir="ltr">
                          <div>there is something very wrong<br>
                            <br>
                          </div>
                          everytime I change it to normal, within few
                          minutes it's back to 000 - can someone from
                          ops take a look on that?<br>
                        </div>
                        <div>
                          <div>
                            <div class="gmail_extra"><br>
                            </div>
                          </div>
                        </div>
                      </blockquote>
                      <div><br>
                      </div>
                    </div>
                    <div>Seems there's a split-brain for that volume.
                      I'm so tired of glusterfs. I've cleaned up the
                      simple split-brains, and have fixed the
                      permissions issues, but there's still a number of
                      issues reporting in the log for split-brain. I'm
                      going to talk with the gluster folks about this.<span
                        class=""><font color="#888888"><br>
                          <br>
                        </font></span></div>
                  </div>
                </div>
              </div>
            </blockquote>
            <div><br>
              Well, It seems that the split brain isn't actually
              affecting the permissions. According to the bug apache is
              doing this with mod_userdir.<br>
              <br>
            </div>
            The split-brain actually isn't an issue. Now that I've
            checked it, there were 3 bad files:<br>
            <br>
/data/project/public_html/petrb/logs/#wikimedia-operations/20121217.txt<br>
/data/project/public_html/petrb/wm-bot/html/#wikimedia-operations/20121217.htm<br>
/data/project/public_html/petrb/wm-bot/html/##thesecretlair/20121217.htm<br>
            <br>
          </div>
          <div class="gmail_quote">And the rest of the split-brain is
            for directories, which are likely due to bad timestamps.<br>
            <br>
          </div>
          <div class="gmail_quote">- Ryan<br>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Labs-l mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a>
<a class="moz-txt-link-freetext" href="https://lists.wikimedia.org/mailman/listinfo/labs-l">https://lists.wikimedia.org/mailman/listinfo/labs-l</a>
</pre>
    </blockquote>
    It's not Apache - there's a script which both creates directories
    for project members if they don't exist and chmod's non-members to
    000 (if a user is removed from the project their stuff shouldn't be
    accessible outside of the project, such as in the case of a
    suspended user).<br>
    <br>
    I've just updated the script to ignore anything that isn't a dir, so
    if someone creates a recursive symlink again it won't remove
    everyone's access.<br>
    <br>
    Also added auto symlinking ~$USER/public_html to
    /data/project/public_html/$USER which petr requested a while back.<br>
    <br>
    <a class="moz-txt-link-freetext" href="https://gerrit.wikimedia.org/r/#/c/26441/38..44/modules/labs-bots/files/userweb/update.py">https://gerrit.wikimedia.org/r/#/c/26441/38..44/modules/labs-bots/files/userweb/update.py</a>
    for reference.<br>
    <br>
    - Damian<br>
  </body>
</html>