Hi Justin,
This is a very useful list (and you've definitely shared it before!) but I'm not trying to be complete—the list of potential metrics is probably endless—but rather to define the terms we use often that people who aren't search nerds or who aren't on the Discovery team might not know.
"PaulScore' was the most egregious example—since we just made the name up—and started the list.
Thanks! —Trey
Trey Jones Software Engineer, Discovery Wikimedia Foundation
On Thu, Sep 15, 2016 at 1:04 PM, Justin Ormont justin.ormont@gmail.com wrote:
Greetings Trey,
A few months ago, I wrote-up a list on Quora of search metrics that I find useful. I may have passed a link to MWF folks before; if not you may find it interesting.
https://www.quora.com/What-search-metrics-do-you-use- most-to-understand-how-your-search-is-performing-If-you- could-add-one-more-metric-to-help-what-would-it-be/answer/ Justin-Ormont?share=1
--justin
On Thu, Sep 15, 2016 at 9:22 AM, Trey Jones tjones@wikimedia.org wrote:
Hi everyone,
I've created a first draft of a small glossary of terms we use in search, including internal-only vocab (PaulScore, Discernatron, RelForge, etc.) and some general vocab (recall, precision, F1, DCG, etc).
The glossary lives on mediawiki.org: https://www.mediawiki.org/wiki/Wikimedia_Discovery/Search/Glossary
This isn't an overly formal glossary, so some of my opinions may have made it into the definitions.
Feel free to edit, expand, editorialize, or even suggest new items to be defined.
Thanks, —Trey
Trey Jones Software Engineer, Discovery Wikimedia Foundation
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery
discovery mailing list discovery@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/discovery