We'd like to let you know about an upcoming change to ORES that might break your code. We've made some improvements to the way that "model_info" is reported from ORES. Rather than us needing to specify thresholds when we train a model (e.g. "filter_rate_at_recall(min_recall=0.9)"), the system now allows arbitrary queries (e.g. "filter_rate @ recall >= 0.9"). This if more flexible but it may cause problems for anyone who was using the machine-readable thresholds to support a UI in the past. Scores themselves will remain unchanged.
The model info and threshold systems will stay in the current state until we are ready to deploy the newer version to production (probably around Sept. 20th). If you have any questions, please feel free to contact the Scoring Platform Team, via email (ai@lists.wikimedia.net) or IRC (chat.freenode.net:6668 #wikimedia-ai)
--