Hi there Wikimetrics fans,
I wanted to get some input on a proposal to add a "pages edited" metric to
Wikimetrics (see this story
<https://www.mediawiki.org/wiki/Analytics/Wikimetrics/Stories#User_reports_p…>
).
This was proposed because "Articles Improved
<https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_articles…>"
is one of the new Grantmaking Global Metrics
<https://meta.wikimedia.org/wiki/Grants:Learning_%26_Evaluation/Global_metri…>,
and there's currently no way to get the # of pages that were edited by the
members of a cohort through Wikimetrics.
As we've scoped it, this metric would be listed along with the other
available metrics on https://metrics.wmflabs.org/metrics/. Any Wikimetrics
user would be able to run this metric for reports the same way they would
run any other--they can filter by pages edited in a particular namespace,
date range, retrieve individual and aggregate results, etc. It would also
be possible to get the # of pages edited across different projects for
CentralAuth cohorts.
What do y'all think: does this sound reasonable and useful?
Best,
Jonathan
--
Jonathan T. Morgan
Learning Strategist
Wikimedia Foundation
User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
jmorgan(a)wikimedia.org
Hello,
Yes, I apologize you are facing difficulty with running reports. There have been some recent changes to the labs server that have been causing instability for the Wikimetrics tool. Although our analytics team has been working on it, I am forwarding this note to the wikimetrics list to let the team know your having issue as well and to loop you in for updates.
If you are not already subscribed, I suggest subscribing to the list so you will get messages in the future about issues that sometimes come up and can report directly to the support team able to help.
You can subscribe at:
wikimetrics(a)lists.wikimedia.org
Thank you for your patience.
Best regards,
Jaime
> On Jan 28, 2015, at 4:15 AM, Milica Žarković <milica.zarkovic(a)vikimedija.org> wrote:
>
> Dear Jaime,
>
> I'm writing on behalf of Wikimedia Serbia.
>
> My colleagues gave me your email address to contact you directly for support with Wiki Metrics. The thing is that, for some reason, program refuses to do metrics and create a report (other than in algorithm form) for given cohorts.
> Is there something we could do to fix this problem?
>
> Our current task is writing a Voluntary report for 2014., and it would be very helpful if you could support us on this issue.
>
> Kindest regards,
> Milica Žarković
>
>
> Milica Žarković,
> Education Program Manager
>
> Wikimedia Serbia
> web. rs.wikimedia.org -
> tel. 00381 (0)60 7 454 77
>
> Bulevar kralja Aleksandra br.20
> 11000 Beograd
Hello again Dan and Marcel,
I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.
Could you please fix it again?
Many thanks,
Amanda
*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally
Wikimetrics has been having serious connectivity problems for a few days.
It turned out to be solvable by using some new hostnames (
labsdb1002.eqiad.wmnet). I fixed it just now, please retry your reports
and let me know if anything is still wrong.
On Fri, Jan 23, 2015 at 10:46 AM, Dan Andreescu <dandreescu(a)wikimedia.org>
wrote:
> Hi everyone. I will work on this as soon as I get into the office, in
> about an hour from now. Yuvi suggested one thing that I wasn't aware of
> that might make this a simple fix.
>
>
> On Friday, January 23, 2015, Dan Higgins <dhiggins(a)wikimedia.org> wrote:
>
>> Hi Kevin,
>>
>> Sorry to be a pest but do you have any update on sorting out the
>> Wikimetrics issues? It seems to have gotten worse since we last spoke to
>> you with around 1 in 10 reports going through.
>>
>> Thanks,
>>
>> Dan
>>
>> On Tue, Jan 20, 2015 at 7:17 PM, Kevin Leduc <kevin(a)wikimedia.org> wrote:
>>
>>> All the developers are in transit to SF today. Dan said he'd be in the
>>> office this afternoon. First dev I see I'll notify them of problems in
>>> wikimetrics.
>>>
>>> On Tue, Jan 20, 2015 at 11:10 AM, Amanda Bittaker <
>>> abittaker(a)wikimedia.org> wrote:
>>>
>>>> Hello again gentlemen,
>>>>
>>>> I think Dan might have already pinged you, but just in case, I wanted
>>>> to let you know that we are getting these failures again. It's kind
>>>> of crunch time for getting this data, so we're just banging our heads
>>>> against the wall and retrying the reports until they work (1 out of 4
>>>> times for me.) Is there any way you all could work your magic again?
>>>>
>>>> Many thanks once again,
>>>> Amanda
>>>>
>>>>
>>>>
>>>> On Wed, Dec 10, 2014 at 4:30 PM, Kevin Leduc <kevin(a)wikimedia.org>
>>>> wrote:
>>>> > It's good to hear it's working again. Don't hesitate to reach out to
>>>> us
>>>> > here or at wikimetrics(a)lists.wikimedia.org if you notice this kind of
>>>> > trouble again.
>>>> >
>>>> > On Wed, Dec 10, 2014 at 3:37 PM, Amanda Bittaker <
>>>> abittaker(a)wikimedia.org>
>>>> > wrote:
>>>> >>
>>>> >> It's working perfectly now--a thousand thank yous, Dan and Marcel.
>>>> >>
>>>> >> On Wed, Dec 10, 2014 at 3:24 PM, Edward Galvez <
>>>> egalvez(a)wikimedia.org>
>>>> >> wrote:
>>>> >>>
>>>> >>> Thanks so much Dan and Marcel!
>>>> >>>
>>>> >>> -E
>>>> >>>
>>>> >>>
>>>> >>> On Wed, Dec 10, 2014 at 3:08 PM, Dan Andreescu <
>>>> dandreescu(a)wikimedia.org>
>>>> >>> wrote:
>>>> >>>>
>>>> >>>> forgot Marcel - my fault. Jaime & folks, in general Marcel rules
>>>> and
>>>> >>>> he's probably going to help you out faster / better than I can.
>>>> >>>>
>>>> >>>> On Wed, Dec 10, 2014 at 5:57 PM, Dan Andreescu
>>>> >>>> <dandreescu(a)wikimedia.org> wrote:
>>>> >>>>>
>>>> >>>>> Ok, Amanda and anyone else who had problems. Please try again. I
>>>> >>>>> think I've cleared up some gunk and that might have helped
>>>> things. We'll be
>>>> >>>>> looking at performance more closely soon.
>>>> >>>>>
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> Steps taken, logging mostly for post-mortem purpose
>>>> >>>>>
>>>> >>>>> * delete from report where recurrent_parent_id is null and
>>>> recurrent =
>>>> >>>>> 0 and created < date('2014-12-01');
>>>> >>>>> ** This deleted records that are not visible in the system
>>>> anymore.
>>>> >>>>> They are recoverable from the wikimetrics database backups but we
>>>> don't need
>>>> >>>>> them in the database. These probably slowed some things down, in
>>>> total the
>>>> >>>>> statement deleted 1623628 rows.
>>>> >>>>>
>>>> >>>>> * alter table report add column old_recurrent tinyint(1); update
>>>> report
>>>> >>>>> set recurrent = 0, old_recurrent = 1 where user_id = 461 and
>>>> recurrent = 1;
>>>> >>>>> ** This disables WikimetricsBot recurrent reports, but preserves
>>>> the
>>>> >>>>> data so we can deal with them later. When labs is done
>>>> re-synchronizing, we
>>>> >>>>> will be re-running these reports. They feed data to Vital Signs,
>>>> in case
>>>> >>>>> someone's curious about what they are.
>>>> >>>>>
>>>> >>>>> * Stopped and rebooted the system. The backup system seems to be
>>>> >>>>> hanging or taking a really long time. I'd like to take a look at
>>>> this in
>>>> >>>>> more depth, but my guess is the amount it's transferring has gone
>>>> beyond
>>>> >>>>> what we expected.
>>>> >>>>>
>>>> >>>>> On Wed, Dec 10, 2014 at 5:23 PM, Dan Andreescu
>>>> >>>>> <dandreescu(a)wikimedia.org> wrote:
>>>> >>>>>>
>>>> >>>>>> We're sorry - the problems we were facing last week have probably
>>>> >>>>>> festered. I'm going to turn off some things and reset the
>>>> system. I'll
>>>> >>>>>> report back.
>>>> >>>>>>
>>>> >>>>>> On Wed, Dec 10, 2014 at 4:47 PM, Amanda Bittaker
>>>> >>>>>> <abittaker(a)wikimedia.org> wrote:
>>>> >>>>>>>
>>>> >>>>>>> Oh yes, and Jaime did have me restart my browser and clear the
>>>> cache,
>>>> >>>>>>> but it did not help.
>>>> >>>>>>>
>>>> >>>>>>> Thanks again,
>>>> >>>>>>> Amanda
>>>> >>>>>>>
>>>> >>>>>>> On Wed, Dec 10, 2014 at 1:45 PM, Amanda Bittaker
>>>> >>>>>>> <abittaker(a)wikimedia.org> wrote:
>>>> >>>>>>>>
>>>> >>>>>>>> Hello Kevin,
>>>> >>>>>>>>
>>>> >>>>>>>> Jaime asked me to email you about some trouble I've been
>>>> having with
>>>> >>>>>>>> Wikimetrics. The whole team has been experiencing a pretty
>>>> high rate of
>>>> >>>>>>>> failures in both report creation and cohort uploads. Almost
>>>> nothing has
>>>> >>>>>>>> gotten through for me today: of the last 13 reports I've run,
>>>> 3 were
>>>> >>>>>>>> successful. Of the failures, I would say maybe only two or
>>>> three "pended"
>>>> >>>>>>>> at all before becoming failures. I've been experiencing the
>>>> same problem
>>>> >>>>>>>> with cohort uploads.
>>>> >>>>>>>>
>>>> >>>>>>>> The reports have been: Newly Registered, Edits, and Rolling
>>>> Active
>>>> >>>>>>>> Editor using expanded cohorts. Please find attached an
>>>> example of one of
>>>> >>>>>>>> the reports. I tried uploading cohorts using text files of
>>>> user names and
>>>> >>>>>>>> pasting user names from Notepad into the "Paste Usernames"
>>>> field. I do
>>>> >>>>>>>> expand the cohorts every time.
>>>> >>>>>>>>
>>>> >>>>>>>> Do you know why the failure rate is so high, especially this
>>>> >>>>>>>> morning, and is there a way to eliminate or mitigate this
>>>> problem in the
>>>> >>>>>>>> future?
>>>> >>>>>>>>
>>>> >>>>>>>> Many thanks for the assistance, and please do let me know if
>>>> you
>>>> >>>>>>>> need any more information from me on this.
>>>> >>>>>>>>
>>>> >>>>>>>> Best,
>>>> >>>>>>>> Amanda
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>
>>>> >>>>>
>>>> >>>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> --
>>>> >>> Edward Galvez
>>>> >>> Program Evaluation Associate
>>>> >>> Wikimedia Foundation
>>>> >>
>>>> >>
>>>> >
>>>>
>>>
>>>
>>
Hey guys,
Hope you can help!
Need to run a super simple report on Wikimetrics -- just one user, just one
project, just one language, bytes added and number of edits -- for our QR.
But it keeps crashing.
Please tell me you can help?? :(
<3
Anna
--
Anna Koval, M.Ed.
Manager, Wikipedia Education Program
Wikimedia Foundation
+1.415.839.6885 x6729
akoval(a)wikimedia.org
education.wikimedia.org
Dear Wikimetrics Users:
Wikimetrics was updated last night (2014-01-08) with many new features that
were implemented at the end of 2014. Here is a list of what is live (as of
yesterday) on https://metrics.wmflabs.org/ :
View Members in a Cohort
>From the cohorts page ( https://metrics.wmflabs.org/cohorts ) there is a
new blue button “View Members” which takes you to a new web page with a
list of the first 20 usernames in the cohort. You can also browse the list
using the search field or the drop down to filter out invalid or valid
usernames.
Remove Member from Cohort
>From the web page described above, you can remove a username from a
cohort. On rare occasions a user may request his username be removed from
a cohort; this feature makes the process trivial.
You may also want to remove usernames that failed validation. Usernames
are deemed invalid when there is no such account on the wiki (specified
when creating a cohort). This may happen when the username is incorrect or
when that user has never visited the wiki in question. In the latter case,
you will be presented with a separate button to remove only the invalid
(usernames,wiki) combinations.
Privacy Policy
Wikimetrics runs on Wikimedia Labs infrastructure (
https://www.mediawiki.org/wiki/Wikimedia_Labs ) and is governed by its
terms of use (
https://wikitech.wikimedia.org/wiki/Wikitech:Labs_Terms_of_use ). As such
we have added a new page stating so ( https://metrics.wmflabs.org/policy )
with a link to it on the header of the website.
Updated Support Page
Should you find any bugs, feel free to log it on our bug tracking
platform. For convenience a link is posted on the support page (
https://metrics.wmflabs.org/support ). This link has been updated to
reflect WMF’s migration away from Bugzilla onto Phabricator.
If you have questions or run into issues, you are always free to ask your
questions on this mailing list: wikimetrics(a)lists.wikimedia.org