Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
1. A gadget 2. An addition to the ORES extension 3. A bot
Is that correct?
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this:
https://en.wikipedia.org/wiki/Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for all
articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this:
https://en.wikipedia.org/wiki/Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for all
articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this:
https://en.wikipedia.org/wiki/Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for all
articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
Hi artificial intelligence people,
Are there baseline ORES scores available for articles? If so, I'm thinking that it would be interesting to have the option to add a template to an article's talk page that shows its ORES score as well as its ORES percentile rank on a particular wiki.
Pine _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this: https://en.wikipedia.org/wiki/
Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for all
articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey, ORES has "article quality" models for English, Russian and French Wikipedia. There is a very short introduction in ORES https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models description page. But if I want to explain it my way. It'll give you a prediction of class of the article (A, B, C, FA, GA, stub, start) for a given revision. For example for this revision https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES predicts https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 that it's GA (which it is). The biggest use case for now is that people produce reports of articles needing re https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments assessment https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for wikiprojects https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. The other use case is list of popular articles that ORES thinks their quality is low https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) .
Your use case about ORES prediction is valid the second part is a little bit complicated though. For the first part, we have either option of a gadget or adding it to the ORES extension. If it's very important to let everyone see the scores, we can write a bot to update reports weekly in English Wikipedia for articles in a certain Wikiproject and we use these data in the WPP templates. Which one do you think suits English Wikipedia better?
Best
On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote:
> Hi artificial intelligence people, > > Are there baseline ORES scores available for articles? If so, I'm > thinking that it would be interesting to have the option to add a template > to an article's talk page that shows its ORES score as well as its ORES > percentile rank on a particular wiki. > > Pine > _______________________________________________ > AI mailing list > AI@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/ai >
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Pinging again to repeat my question from my previous email.
Thanks, Pine
On Aug 9, 2016 16:04, "Pine W" wiki.pine@gmail.com wrote:
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this: https://en.wikipedia.org/wiki/
Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for
all articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for getting back to me. My mind is a little full at the moment, and I have some deadlines this week, so it may take me a little while to get back to you. But I'm flagging this conversation for follow up, hopefully by the end of this week or early next week.
Thanks for your patience, Pine
On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup ladsgroup@gmail.com wrote:
> Hey, > ORES has "article quality" models for English, Russian and French > Wikipedia. There is a very short introduction in ORES > https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models > description page. > But if I want to explain it my way. It'll give you a prediction of > class of the article (A, B, C, FA, GA, stub, start) for a given revision. > For example for this revision > https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES > predicts > https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 > that it's GA (which it is). > The biggest use case for now is that people produce reports of > articles needing re > https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments > assessment > https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for > wikiprojects > https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. > The other use case is list of popular articles that ORES thinks > their quality is low > https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) > . > > Your use case about ORES prediction is valid the second part is a > little bit complicated though. For the first part, we have either option of > a gadget or adding it to the ORES extension. If it's very important to let > everyone see the scores, we can write a bot to update reports weekly in > English Wikipedia for articles in a certain Wikiproject and we use these > data in the WPP templates. Which one do you think suits English Wikipedia > better? > > Best > > > On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote: > >> Hi artificial intelligence people, >> >> Are there baseline ORES scores available for articles? If so, I'm >> thinking that it would be interesting to have the option to add a template >> to an article's talk page that shows its ORES score as well as its ORES >> percentile rank on a particular wiki. >> >> Pine >> _______________________________________________ >> AI mailing list >> AI@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ai >> > > _______________________________________________ > AI mailing list > AI@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/ai > >
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Oh, Sorry I missed the question. Yes, it's fairly easy :)
Best
On Tue, Aug 16, 2016 at 12:15 PM Pine W wiki.pine@gmail.com wrote:
Pinging again to repeat my question from my previous email.
Thanks, Pine
On Aug 9, 2016 16:04, "Pine W" wiki.pine@gmail.com wrote:
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
Thanks for waiting. As I understand it, we have these options for making the ORES scores visible on article talk pages:
- A gadget
- An addition to the ORES extension
- A bot
Is that correct?
Yes
WP:WPP refers to WikiProject Philosophy; did you man something else or am I misunderstanding the abbreviation?
My bad, I meant something like this:
https://en.wikipedia.org/wiki/Template:WikiProject_Physics
I'm thinking that a gadget might be a workable solution, but my preference would be to have the score displayed on all article talk pages automatically for everyone to see including readers who are not logged in. A bot that posted scores to talk pages and updated the scores on a weekly basis would be good for that purpose.
Both are possible solutions but as for bots. Updating the score for
all articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
I'm unclear on how an addition to the ORES extension would work; can you explain further what that option would involve?
Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
Thanks,
Pine
On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com wrote:
> Hi Amir, > > Thanks for getting back to me. My mind is a little full at the > moment, and I have some deadlines this week, so it may take me a little > while to get back to you. But I'm flagging this conversation for follow up, > hopefully by the end of this week or early next week. > > Thanks for your patience, > Pine > > On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup <ladsgroup@gmail.com > > wrote: > >> Hey, >> ORES has "article quality" models for English, Russian and French >> Wikipedia. There is a very short introduction in ORES >> https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models >> description page. >> But if I want to explain it my way. It'll give you a prediction of >> class of the article (A, B, C, FA, GA, stub, start) for a given revision. >> For example for this revision >> https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES >> predicts >> https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 >> that it's GA (which it is). >> The biggest use case for now is that people produce reports of >> articles needing re >> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments >> assessment >> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for >> wikiprojects >> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. >> The other use case is list of popular articles that ORES thinks >> their quality is low >> https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) >> . >> >> Your use case about ORES prediction is valid the second part is a >> little bit complicated though. For the first part, we have either option of >> a gadget or adding it to the ORES extension. If it's very important to let >> everyone see the scores, we can write a bot to update reports weekly in >> English Wikipedia for articles in a certain Wikiproject and we use these >> data in the WPP templates. Which one do you think suits English Wikipedia >> better? >> >> Best >> >> >> On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com wrote: >> >>> Hi artificial intelligence people, >>> >>> Are there baseline ORES scores available for articles? If so, I'm >>> thinking that it would be interesting to have the option to add a template >>> to an article's talk page that shows its ORES score as well as its ORES >>> percentile rank on a particular wiki. >>> >>> Pine >>> _______________________________________________ >>> AI mailing list >>> AI@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/ai >>> >> >> _______________________________________________ >> AI mailing list >> AI@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ai >> >> > _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Thanks. I will add this to my agenda for later this year.
Pine
On Aug 16, 2016 01:48, "Amir Ladsgroup" ladsgroup@gmail.com wrote:
Oh, Sorry I missed the question. Yes, it's fairly easy :)
Best
On Tue, Aug 16, 2016 at 12:15 PM Pine W wiki.pine@gmail.com wrote:
Pinging again to repeat my question from my previous email.
Thanks, Pine
On Aug 9, 2016 16:04, "Pine W" wiki.pine@gmail.com wrote:
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Hey,
On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote:
> Hi Amir, > > Thanks for waiting. As I understand it, we have these options for > making the ORES scores visible on article talk pages: > > 1. A gadget > 2. An addition to the ORES extension > 3. A bot > > Is that correct? > Yes
> > WP:WPP refers to WikiProject Philosophy; did you man something else > or am I misunderstanding the abbreviation? > > My bad, I meant something like this: https://en.wikipedia.org/wiki/ Template:WikiProject_Physics
> I'm thinking that a gadget might be a workable solution, but my > preference would be to have the score displayed on all article talk pages > automatically for everyone to see including readers who are not logged in. > A bot that posted scores to talk pages and updated the scores on a weekly > basis would be good for that purpose. > > Both are possible solutions but as for bots. Updating the score for all articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) on weekly basis is not efficient. That bot needs to do 35K edits every week and it might make some people mad. We can have an initial release and update it on demand (like adding a link to the score in the template. If someone wants that score gets updated. Just clicks on the link and the bot update it)
> I'm unclear on how an addition to the ORES extension would work; can > you explain further what that option would involve? > Adding it to the ores extension will make things much easier. You just need to enable it in your beta features and then in the talk page or action=info you will see the score. Implementing it is difficult due to storage issues for the database and we might need to get operations approval before continuing.
Best
> > Thanks, > > Pine > > On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com > wrote: > >> Hi Amir, >> >> Thanks for getting back to me. My mind is a little full at the >> moment, and I have some deadlines this week, so it may take me a little >> while to get back to you. But I'm flagging this conversation for follow up, >> hopefully by the end of this week or early next week. >> >> Thanks for your patience, >> Pine >> >> On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup < >> ladsgroup@gmail.com> wrote: >> >>> Hey, >>> ORES has "article quality" models for English, Russian and French >>> Wikipedia. There is a very short introduction in ORES >>> https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models >>> description page. >>> But if I want to explain it my way. It'll give you a prediction of >>> class of the article (A, B, C, FA, GA, stub, start) for a given revision. >>> For example for this revision >>> https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES >>> predicts >>> https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 >>> that it's GA (which it is). >>> The biggest use case for now is that people produce reports of >>> articles needing re >>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments >>> assessment >>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for >>> wikiprojects >>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. >>> The other use case is list of popular articles that ORES thinks >>> their quality is low >>> https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) >>> . >>> >>> Your use case about ORES prediction is valid the second part is a >>> little bit complicated though. For the first part, we have either option of >>> a gadget or adding it to the ORES extension. If it's very important to let >>> everyone see the scores, we can write a bot to update reports weekly in >>> English Wikipedia for articles in a certain Wikiproject and we use these >>> data in the WPP templates. Which one do you think suits English Wikipedia >>> better? >>> >>> Best >>> >>> >>> On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com >>> wrote: >>> >>>> Hi artificial intelligence people, >>>> >>>> Are there baseline ORES scores available for articles? If so, I'm >>>> thinking that it would be interesting to have the option to add a template >>>> to an article's talk page that shows its ORES score as well as its ORES >>>> percentile rank on a particular wiki. >>>> >>>> Pine >>>> _______________________________________________ >>>> AI mailing list >>>> AI@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/ai >>>> >>> >>> _______________________________________________ >>> AI mailing list >>> AI@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/ai >>> >>> >> > _______________________________________________ > AI mailing list > AI@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/ai >
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
Just to note that https://upload.wikimedia.org/wikipedia/commons/6/6a/Wikimedia_Foundation_and... suggests that WMF Product "Add an indicator of quality icon (akin to the signal strength icon for mobile networks) on each article, based on research and analysis on article contributions and edits." This is similar to what I have in mind for talk pages with ORES scores. Adding indicators to the front page of articles would likely require an RfC which may be more involved than an RfB to add the score to talk pages. Still, I can see how having an ORES score, or the Wikipedia Quality score (at least on ENWP) indicated by an icon at the top of article pages would be useful, especially if readers can intuitively understand what the indicator is telling them without needing to look at documentation.
I think it might be best to start with ORES scores on talk pages. That fills the need that I have in mind. If someone wants to extend this to having article quality indicators on the front page of articles, I'd be happy to collaborate with them.
Pine
On Tue, Aug 16, 2016 at 7:32 AM, Pine W wiki.pine@gmail.com wrote:
Thanks. I will add this to my agenda for later this year.
Pine
On Aug 16, 2016 01:48, "Amir Ladsgroup" ladsgroup@gmail.com wrote:
Oh, Sorry I missed the question. Yes, it's fairly easy :)
Best
On Tue, Aug 16, 2016 at 12:15 PM Pine W wiki.pine@gmail.com wrote:
Pinging again to repeat my question from my previous email.
Thanks, Pine
On Aug 9, 2016 16:04, "Pine W" wiki.pine@gmail.com wrote:
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
Hi Amir,
I think that I'm following better now.
The extension option doesn't sound workable for what I have in mind. I'd like the score to be visible without needing to be logged in, which I believe means that the feature can't be conditional on having access to beta features.
The solution to click on a talk page link for an updated score sounds more workable. It would be best if the score refreshed automatically every time someone viewed the talk page for the purpose that I have in mind, but I don't know what kind of performance penalty and computing resources that would require. If either of those are nontrivial, then having a template on the talk page that says something like "Score last refreshed on TIME DATE. There have been X revisions since that time. Click here to update the score" would be good for the use case that I have in mind.
Pine
On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
> Hey, > > > On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote: > >> Hi Amir, >> >> Thanks for waiting. As I understand it, we have these options for >> making the ORES scores visible on article talk pages: >> >> 1. A gadget >> 2. An addition to the ORES extension >> 3. A bot >> >> Is that correct? >> > Yes > >> >> WP:WPP refers to WikiProject Philosophy; did you man something else >> or am I misunderstanding the abbreviation? >> >> My bad, I meant something like this: https://en.wikipedia.org/wiki/ > Template:WikiProject_Physics > >> I'm thinking that a gadget might be a workable solution, but my >> preference would be to have the score displayed on all article talk pages >> automatically for everyone to see including readers who are not logged in. >> A bot that posted scores to talk pages and updated the scores on a weekly >> basis would be good for that purpose. >> >> Both are possible solutions but as for bots. Updating the score for > all articles of a wikiproject (e.g. Wikiproject medicine has 35K articles) > on weekly basis is not efficient. That bot needs to do 35K edits every week > and it might make some people mad. We can have an initial release and > update it on demand (like adding a link to the score in the template. If > someone wants that score gets updated. Just clicks on the link and the bot > update it) > >> I'm unclear on how an addition to the ORES extension would work; >> can you explain further what that option would involve? >> > Adding it to the ores extension will make things much easier. You > just need to enable it in your beta features and then in the talk page or > action=info you will see the score. Implementing it is difficult due to > storage issues for the database and we might need to get operations > approval before continuing. > > Best > >> >> Thanks, >> >> Pine >> >> On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com >> wrote: >> >>> Hi Amir, >>> >>> Thanks for getting back to me. My mind is a little full at the >>> moment, and I have some deadlines this week, so it may take me a little >>> while to get back to you. But I'm flagging this conversation for follow up, >>> hopefully by the end of this week or early next week. >>> >>> Thanks for your patience, >>> Pine >>> >>> On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup < >>> ladsgroup@gmail.com> wrote: >>> >>>> Hey, >>>> ORES has "article quality" models for English, Russian and French >>>> Wikipedia. There is a very short introduction in ORES >>>> https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models >>>> description page. >>>> But if I want to explain it my way. It'll give you a prediction >>>> of class of the article (A, B, C, FA, GA, stub, start) for a given >>>> revision. For example for this revision >>>> https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES >>>> predicts >>>> https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 >>>> that it's GA (which it is). >>>> The biggest use case for now is that people produce reports of >>>> articles needing re >>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments >>>> assessment >>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for >>>> wikiprojects >>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. >>>> The other use case is list of popular articles that ORES thinks >>>> their quality is low >>>> https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) >>>> . >>>> >>>> Your use case about ORES prediction is valid the second part is a >>>> little bit complicated though. For the first part, we have either option of >>>> a gadget or adding it to the ORES extension. If it's very important to let >>>> everyone see the scores, we can write a bot to update reports weekly in >>>> English Wikipedia for articles in a certain Wikiproject and we use these >>>> data in the WPP templates. Which one do you think suits English Wikipedia >>>> better? >>>> >>>> Best >>>> >>>> >>>> On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com >>>> wrote: >>>> >>>>> Hi artificial intelligence people, >>>>> >>>>> Are there baseline ORES scores available for articles? If so, >>>>> I'm thinking that it would be interesting to have the option to add a >>>>> template to an article's talk page that shows its ORES score as well as its >>>>> ORES percentile rank on a particular wiki. >>>>> >>>>> Pine >>>>> _______________________________________________ >>>>> AI mailing list >>>>> AI@lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/ai >>>>> >>>> >>>> _______________________________________________ >>>> AI mailing list >>>> AI@lists.wikimedia.org >>>> https://lists.wikimedia.org/mailman/listinfo/ai >>>> >>>> >>> >> _______________________________________________ >> AI mailing list >> AI@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ai >> > > _______________________________________________ > AI mailing list > AI@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/ai > > _______________________________________________ AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
We are currently working on doing something that might help us to do the quality assessment on English Wikipedia (and some other wikis). See these two phabricator tasks: https://phabricator.wikimedia.org/T135684 https://phabricator.wikimedia.org/T106278
Best
On Thu, Sep 1, 2016 at 2:07 AM Pine W wiki.pine@gmail.com wrote:
Just to note that https://upload.wikimedia.org/wikipedia/commons/6/6a/Wikimedia_Foundation_and... suggests that WMF Product "Add an indicator of quality icon (akin to the signal strength icon for mobile networks) on each article, based on research and analysis on article contributions and edits." This is similar to what I have in mind for talk pages with ORES scores. Adding indicators to the front page of articles would likely require an RfC which may be more involved than an RfB to add the score to talk pages. Still, I can see how having an ORES score, or the Wikipedia Quality score (at least on ENWP) indicated by an icon at the top of article pages would be useful, especially if readers can intuitively understand what the indicator is telling them without needing to look at documentation.
I think it might be best to start with ORES scores on talk pages. That fills the need that I have in mind. If someone wants to extend this to having article quality indicators on the front page of articles, I'd be happy to collaborate with them.
Pine
On Tue, Aug 16, 2016 at 7:32 AM, Pine W wiki.pine@gmail.com wrote:
Thanks. I will add this to my agenda for later this year.
Pine
On Aug 16, 2016 01:48, "Amir Ladsgroup" ladsgroup@gmail.com wrote:
Oh, Sorry I missed the question. Yes, it's fairly easy :)
Best
On Tue, Aug 16, 2016 at 12:15 PM Pine W wiki.pine@gmail.com wrote:
Pinging again to repeat my question from my previous email.
Thanks, Pine
On Aug 9, 2016 16:04, "Pine W" wiki.pine@gmail.com wrote:
I'd like to work on this if I had the time to learn and to do it. Maybe I will in early September or sometime later this year. I've put it on my to do list. This would be my first bot; do you think that it's a good project for a newbie bot builder?
Pine
On Sat, Aug 6, 2016 at 11:16 AM, Amir Ladsgroup ladsgroup@gmail.com wrote:
Building that is easy, you just need someone to add these functionalities to the templates and a bot to run it for the first time.
Any volunteers?
Best
On Mon, Aug 1, 2016 at 9:37 PM Pine W wiki.pine@gmail.com wrote:
> Hi Amir, > > I think that I'm following better now. > > The extension option doesn't sound workable for what I have in mind. > I'd like the score to be visible without needing to be logged in, which I > believe means that the feature can't be conditional on having access to > beta features. > > The solution to click on a talk page link for an updated score > sounds more workable. It would be best if the score refreshed automatically > every time someone viewed the talk page for the purpose that I have in > mind, but I don't know what kind of performance penalty and computing > resources that would require. If either of those are nontrivial, then > having a template on the talk page that says something like "Score last > refreshed on TIME DATE. There have been X revisions since that time. Click > here to update the score" would be good for the use case that I have in > mind. > > Pine > > On Mon, Aug 1, 2016 at 1:48 AM, Amir Ladsgroup ladsgroup@gmail.com > wrote: > >> Hey, >> >> >> On Sun, Jul 31, 2016 at 8:16 AM Pine W wiki.pine@gmail.com wrote: >> >>> Hi Amir, >>> >>> Thanks for waiting. As I understand it, we have these options for >>> making the ORES scores visible on article talk pages: >>> >>> 1. A gadget >>> 2. An addition to the ORES extension >>> 3. A bot >>> >>> Is that correct? >>> >> Yes >> >>> >>> WP:WPP refers to WikiProject Philosophy; did you man something >>> else or am I misunderstanding the abbreviation? >>> >>> My bad, I meant something like this: >> https://en.wikipedia.org/wiki/Template:WikiProject_Physics >> >>> I'm thinking that a gadget might be a workable solution, but my >>> preference would be to have the score displayed on all article talk pages >>> automatically for everyone to see including readers who are not logged in. >>> A bot that posted scores to talk pages and updated the scores on a weekly >>> basis would be good for that purpose. >>> >>> Both are possible solutions but as for bots. Updating the score >> for all articles of a wikiproject (e.g. Wikiproject medicine has 35K >> articles) on weekly basis is not efficient. That bot needs to do 35K edits >> every week and it might make some people mad. We can have an initial >> release and update it on demand (like adding a link to the score in the >> template. If someone wants that score gets updated. Just clicks on the link >> and the bot update it) >> >>> I'm unclear on how an addition to the ORES extension would work; >>> can you explain further what that option would involve? >>> >> Adding it to the ores extension will make things much easier. You >> just need to enable it in your beta features and then in the talk page or >> action=info you will see the score. Implementing it is difficult due to >> storage issues for the database and we might need to get operations >> approval before continuing. >> >> Best >> >>> >>> Thanks, >>> >>> Pine >>> >>> On Sun, Jul 24, 2016 at 11:29 PM, Pine W wiki.pine@gmail.com >>> wrote: >>> >>>> Hi Amir, >>>> >>>> Thanks for getting back to me. My mind is a little full at the >>>> moment, and I have some deadlines this week, so it may take me a little >>>> while to get back to you. But I'm flagging this conversation for follow up, >>>> hopefully by the end of this week or early next week. >>>> >>>> Thanks for your patience, >>>> Pine >>>> >>>> On Fri, Jul 22, 2016 at 9:59 PM, Amir Ladsgroup < >>>> ladsgroup@gmail.com> wrote: >>>> >>>>> Hey, >>>>> ORES has "article quality" models for English, Russian and >>>>> French Wikipedia. There is a very short introduction in ORES >>>>> https://meta.wikimedia.org/wiki/Objective_Revision_Evaluation_Service#Article_quality_models >>>>> description page. >>>>> But if I want to explain it my way. It'll give you a prediction >>>>> of class of the article (A, B, C, FA, GA, stub, start) for a given >>>>> revision. For example for this revision >>>>> https://en.wikipedia.org/w/index.php?title=Alan_Turing&oldid=730400015 ORES >>>>> predicts >>>>> https://ores.wikimedia.org/v2/scores/enwiki/?models=wp10&revids=730400015 >>>>> that it's GA (which it is). >>>>> The biggest use case for now is that people produce reports of >>>>> articles needing re >>>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments >>>>> assessment >>>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments for >>>>> wikiprojects >>>>> https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Stories#Updating_WikiProject_Medicine_article_assessments. >>>>> The other use case is list of popular articles that ORES thinks >>>>> their quality is low >>>>> https://en.wikipedia.org/wiki/User:DataflowBot/output/Popular_low_quality_articles_(id-2) >>>>> . >>>>> >>>>> Your use case about ORES prediction is valid the second part is >>>>> a little bit complicated though. For the first part, we have either option >>>>> of a gadget or adding it to the ORES extension. If it's very important to >>>>> let everyone see the scores, we can write a bot to update reports weekly in >>>>> English Wikipedia for articles in a certain Wikiproject and we use these >>>>> data in the WPP templates. Which one do you think suits English Wikipedia >>>>> better? >>>>> >>>>> Best >>>>> >>>>> >>>>> On Sat, Jul 23, 2016 at 2:57 AM Pine W wiki.pine@gmail.com >>>>> wrote: >>>>> >>>>>> Hi artificial intelligence people, >>>>>> >>>>>> Are there baseline ORES scores available for articles? If so, >>>>>> I'm thinking that it would be interesting to have the option to add a >>>>>> template to an article's talk page that shows its ORES score as well as its >>>>>> ORES percentile rank on a particular wiki. >>>>>> >>>>>> Pine >>>>>> _______________________________________________ >>>>>> AI mailing list >>>>>> AI@lists.wikimedia.org >>>>>> https://lists.wikimedia.org/mailman/listinfo/ai >>>>>> >>>>> >>>>> _______________________________________________ >>>>> AI mailing list >>>>> AI@lists.wikimedia.org >>>>> https://lists.wikimedia.org/mailman/listinfo/ai >>>>> >>>>> >>>> >>> _______________________________________________ >>> AI mailing list >>> AI@lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/ai >>> >> >> _______________________________________________ >> AI mailing list >> AI@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ai >> >> > _______________________________________________ > AI mailing list > AI@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/ai >
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai
AI mailing list AI@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ai