Hi Justin,

This is a very useful list (and you've definitely shared it before!) but I'm not trying to be complete—the list of potential metrics is probably endless—but rather to define the terms we use often that people who aren't search nerds or who aren't on the Discovery team might not know.

"PaulScore' was the most egregious example—since we just made the name up—and started the list.

Thanks! —Trey

Trey Jones Software Engineer, Discovery Wikimedia Foundation

On Thu, Sep 15, 2016 at 1:04 PM, Justin Ormont justin.ormont@gmail.com wrote:

Greetings Trey,

A few months ago, I wrote-up a list on Quora of search metrics that I find useful. I may have passed a link to MWF folks before; if not you may find it interesting.

https://www.quora.com/What-search-metrics-do-you-use- most-to-understand-how-your-search-is-performing-If-you- could-add-one-more-metric-to-help-what-would-it-be/answer/ Justin-Ormont?share=1

--justin

On Thu, Sep 15, 2016 at 9:22 AM, Trey Jones tjones@wikimedia.org wrote:

...

Hi everyone,

I've created a first draft of a small glossary of terms we use in search, including internal-only vocab (PaulScore, Discernatron, RelForge, etc.) and some general vocab (recall, precision, F1, DCG, etc).

The glossary lives on mediawiki.org: https://www.mediawiki.org/wiki/Wikimedia_Discovery/Search/Glossary

This isn't an overly formal glossary, so some of my opinions may have made it into the definitions.

Feel free to edit, expand, editorialize, or even suggest new items to be defined.

Thanks, —Trey

Trey Jones Software Engineer, Discovery Wikimedia Foundation

---

discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery

---

discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery

Well done, Trey! :)

-- Deb Tankersley Product Manager, Discovery IRC: debt Wikimedia Foundation

On Thu, Sep 15, 2016 at 10:30 AM, Guillaume Lederrey < glederrey@wikimedia.org> wrote:

Kool! That's definitely a page I'm going to point some people to!

On Thu, Sep 15, 2016 at 6:22 PM, Trey Jones tjones@wikimedia.org wrote:

...

Hi everyone,

I've created a first draft of a small glossary of terms we use in search, including internal-only vocab (PaulScore, Discernatron, RelForge, etc.)

and

...

some general vocab (recall, precision, F1, DCG, etc).

The glossary lives on mediawiki.org: https://www.mediawiki.org/wiki/Wikimedia_Discovery/Search/Glossary

This isn't an overly formal glossary, so some of my opinions may have

made

...

it into the definitions.

Feel free to edit, expand, editorialize, or even suggest new items to be defined.

Thanks, —Trey

Trey Jones Software Engineer, Discovery Wikimedia Foundation

---

discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery

-- Guillaume Lederrey Operations Engineer, Discovery Wikimedia Foundation UTC+2 / CEST

---

discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery