<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Sorry I ommited some info.</div><div>The blog post for more info can be found at:</div><div><a href="https://phabricator.wikimedia.org/phame/post/view/68/more_better_model_information_and_threshold_optimizations/">https://phabricator.wikimedia.org/phame/post/view/68/more_better_model_information_and_threshold_optimizations/</a></div><div>On Aug 31, 2017, at 4:18 PM, zppix e <<a href="mailto:megadev44s.mail@gmail.com">megadev44s.mail@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div><div id="magicdomid2" class="" style="margin: 0px; padding: 0px;"><span class="author-a-z90zz76zz83z4z71zxjz77zqbz87zbz67zez67zs" style="margin: 0px; padding: 0px; cursor: auto; background-color: rgba(255, 255, 255, 0);">We'd like to let you know about an upcoming change to ORES that might break your code. We've made some improvements to the way that "model_info" is reported from ORES. Rather than us needing to specify thresholds when we train a model (e.g. "filter_rate_at_recall(min_recall=0.9)"), the system now allows arbitrary queries (e.g. "filter_rate @ recall >= 0.9"). This if more flexible but it may cause problems for anyone who was using the machine-readable thresholds to support a UI in the past. Scores themselves will remain unchanged. </span></div><div id="magicdomid3" class="" style="margin: 0px; padding: 0px;"><span style="background-color: rgba(255, 255, 255, 0);"><br style="margin: 0px; padding: 0px;"></span></div><div id="magicdomid4" class="" style="margin: 0px; padding: 0px;"><span style="background-color: rgba(255, 255, 255, 0);"><span class="author-a-k443mz85zz67zvz80z4wfgz79zud" style="margin: 0px; padding: 0px; cursor: auto;">The model info and threshold systems will stay in the current state until we </span><span class="author-a-z90zz76zz83z4z71zxjz77zqbz87zbz67zez67zs" style="margin: 0px; padding: 0px; cursor: auto;">are ready to </span><span class="author-a-k443mz85zz67zvz80z4wfgz79zud" style="margin: 0px; padding: 0px; cursor: auto;">deploy the newer version to production (probably around Sept. 20th). If you have any questions, please feel free to contact the </span><span class="author-a-z90zz76zz83z4z71zxjz77zqbz87zbz67zez67zs" style="margin: 0px; padding: 0px; cursor: auto;">Scoring Platform</span><span class="author-a-k443mz85zz67zvz80z4wfgz79zud" style="margin: 0px; padding: 0px; cursor: auto;"> Team, via email (<a href="mailto:ai@lists.wikimedia.net">ai@lists.wikimedia.net</a>) or IRC (<a href="http://chat.freenode.net:6668">chat.freenode.net:6668</a> #wikimedia-ai)</span></span></div><div id="magicdomid5" class="" style="margin: 0px; padding: 0px; white-space: pre-wrap; font-family: 'Helvetica Neue', Arial, sans-serif; font-size: 12px; background-color: rgb(255, 255, 255);"><br style="margin: 0px; padding: 0px;"></div><br>--</div><div>Zppix</div><div>Volunteer developer for Wikimedia</div><div><br><br>Sent from my iPhone</div></div></blockquote></body></html>