<div dir="ltr"><div>TPG has been discussing this in the context of how we, as a team that does process assistance and consulting, can quantify our value. A few highlights from our discussions:<br><br>"if you can't measure it, you can't manage it." is not true. "if you can't measure it, you can't prove it" captures the kernel of truth, but begs the question of what needs to be proved by whom to whom.<br><br></div><div>The "Compstat" effect, in which anyone who has a metric-based incentive is thus incented to influence the metric, not necessarily the underlying reality the metric is intended to measure. I.e., hire and fire police by numbers and crime statistics will become unreliable; fire teachers based on student test performance and test-taking will become less reliable.<br><br></div>It's also important to differentiate between self-accountability and external accountability. People measure their own performance to get a truer understanding of their own work and avoid various biases; this is subject to different problems and trade-offs than measuring work for someone else's judgment.<br><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><font color="#888888"><div><b>--<br>Joel Aufrecht<br></b></div><div>Team Practices Group<b><br></b></div><div>Wikimedia Foundation<br></div></font></div></div></div></div></div>
<br><div class="gmail_quote">On Mon, Dec 14, 2015 at 2:00 PM, Dan Duvall <span dir="ltr"><<a href="mailto:dduvall@wikimedia.org" target="_blank">dduvall@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">Thanks for sharing, indeed! The tone is charged but, if I'm being honest, I share many of the same sentiments and in no more eloquent terms. I've always considered them a pretty cruel imposition for people working at an operational level, people that have already pledged to give nearly half—and in many cases, it's much closer to all—of their waking life to the Wikimedia movement.</div><div class="gmail_quote"><br></div><div class="gmail_quote"><span class="">On Mon, Dec 14, 2015 at 12:43 PM, Kevin Smith <span dir="ltr"><<a href="mailto:ksmith@wikimedia.org" target="_blank">ksmith@wikimedia.org</a>></span> wrote:<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div>Hopefully we (as an org) are aiming for KPI's that measure actual end-user value and impact ("outcomes") as opposed to measuring our own internal amounts of work ("outputs"), or worse (e.g. "how much time an employee spends in the bathroom").<br></div></div></blockquote><div><br></div></span><div>Therein lays the crux of the problem for me: Our KPIs have been employed completely backwards. We didn't start by defining KPIs for organizational impact (likely because we lack organizational initiatives and strategy to begin with) or for intermediary goals (there are no intermediaries of 'undefined'). Instead, our ED mandated that teams use KPIs to measure their own individual conceptions of success which, in the absence of any similar accountabilities measures at the C-level, amounted to saying "prove your worth to us." Leaving teams to formulate their own models of success without any shared consensus about the bigger picture has also rendered our KPIs biased and unverified—in other words, they are pseudoscientific.</div></div><div class="gmail_extra"><br></div>Every second spent on fulfilling KPIs in an organization of such strategic and operational disparity is a huge waste of donor money in my opinion.</div><div class="gmail_extra"><br></div><div class="gmail_extra">And just because I saw "if you can't measure it, you can't manage it" in the article, I have to follow up with this article. :)</div><div class="gmail_extra"><br></div><div class="gmail_extra"><a href="http://www.druckerinstitute.com/2013/07/measurement-myopia/" target="_blank">http://www.druckerinstitute.com/2013/07/measurement-myopia/</a></div><span class="HOEnZb"><font color="#888888"><div class="gmail_extra"><div><br></div>-- <br><div><div dir="ltr">Dan Duvall<div>Automation Engineer</div><div><a href="http://wikimediafoundation.org" target="_blank">Wikimedia Foundation</a><br></div></div></div>
</div></font></span></div>
<br>_______________________________________________<br>
teampractices mailing list<br>
<a href="mailto:teampractices@lists.wikimedia.org">teampractices@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/teampractices" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/teampractices</a><br>
<br></blockquote></div><br></div>