Mobile-l January 2017

mobile-l@lists.wikimedia.org

11 participants
10 discussions

[Apps] Stripping content inside brackets from the first sentence of articles

by Dan Garry

Hi everyone, *tl;dr: We'll be stripping all content contained inside brackets from the first sentence of articles in the Wikipedia app.* The Mobile Apps Team is focussed on making the app a beautiful and engaging reader experience, and trying to support use cases like wanting to look something up quickly to find what it is. Unfortunately, there are several aspects of Wikipedia at present that are actively detrimental to that goal. One example of this are the lead sentences. As mentioned in the other thread on this matter <https://lists.wikimedia.org/pipermail/mobile-l/2015-March/008715.html>, lead sentences are poorly formatted and contain information that is detrimental to quickly looking up a topic. The team did a quick audit <https://docs.google.com/a/wikimedia.org/spreadsheets/d/1BJ7uDgzO8IJT0M3UM2q…> of the information available inside brackets in the first sentences, and typically it is pronunciation information which is probably better placed in the infobox rather than breaking up the first sentence. The other problem is that this information was typically inserted and previewed on a platform where space is not at a premium, and that calculation is different on mobile devices. In order to better serve the quick lookup use case, the team has reached the decision to strip anything inside brackets in the first sentence of articles in the Wikipedia app. Stripping content is not a decision to be made lightly. People took the time to write it, and that should be respected. We realise this is controversial. That said, it's the opinion of the team that the problem is pretty clear: this content is not optimised for users quickly looking things up on mobile devices at all, and will take a long time to solve through alternative means. A quicker solution is required. The screenshots below are mockups of the before and after of the change. These are not final, I just put them together quickly to illustrate what I'm talking about. - Before: http://i.imgur.com/VwKerbv.jpg - After: http://i.imgur.com/2A5PLmy.jpg If you have any questions, let me know. Thanks, Dan -- Dan Garry Associate Product Manager, Mobile Apps Wikimedia Foundation

4 years, 6 months

Results from similar articles A/B test

by Dmitry Brant

Hello all, As mentioned previously, the current version of the Android app contains an A/B test where it presents "read more" suggestions to the user, based on (a) the standard "morelike" query, or (b) the new "opening_text" query. Here are the results from the last ~10 days of the test[0]: - The clickthrough rate using the default morelike query is (and has been) around 15%. - With the new opening_text query, the clickthrough rate decreases to about 12%: [image: Inline image 1] Therefore, it seems that the new query has a nontrivial negative effect on CTR :( We'll plan on removing this test in the next release of the app, but we'll be happy to plug in a different or updated query, if it will be of further use to Discovery. [0] https://docs.google.com/a/wikimedia.org/spreadsheets/d/1BFsrAcPgexQyNVemmJ3… (queries embedded as comments in the headers) -- Dmitry Brant Senior Software Engineer / Product Owner (Android) Wikimedia Foundation https://www.mediawiki.org/wiki/Wikimedia_mobile_engineering

6 years, 11 months

CREDIT next week, and a survey

by Adam Baso

(Another) cross post. Hi everybody! As a reminder the CREDIT Showcase is next week on Wednesday, 1-February-2017 (see https://www.mediawiki.org/wiki/CREDIT_showcase for details). Also, as I mentioned previously we're conducting a survey about CREDIT. We'd appreciate your feedback! Here is a link to the survey (which is hosted on a third-party service), and, for information about privacy and data handling, the survey privacy statement. https://docs.google.com/a/wikimedia.org/forms/d/e/1FAIpQLSedAtyPfcEhT6OVd26… https://wikimediafoundation.org/wiki/CREDIT_Feedback_Survey_Privacy_Stateme… . This email is being sent to several mailing lists in order to reach multiple audiences. As always, please follow the list link at the very bottom of this email in case you want to manage your list subscription options such as digest, unsubscribe, and so on. And, as usual, if you'd like to share the news about the upcoming CREDIT, here's some suggested verbiage. *Hi <FNAME>* *I hope all is well with you! I wanted to let you know about CREDIT, a monthly demo series that we’re running to showcase open source tech projects from Wikimedia’s Community, Reading, Editing, Discovery, Infrastructure and Technology teams. * *CREDIT is open to the public, and we welcome questions and discussion. The next CREDIT will be held on February 1st at 11am PT / 2pm ET / 19:00 UTC. * *There’s more info on MediaWiki <https://www.mediawiki.org/wiki/CREDIT_showcase>, and on Etherpad <https://etherpad.wikimedia.org/p/CREDIT>, which is where we take notes and ask questions. You can also ask questions on IRC in the Freenode chatroom #wikimedia-office (web-based access here <https://webchat.freenode.net/?channels=%23wikimedia-office>). Links to video will become available at these locations shortly before the event.* *Please feel free to pass this information along to any interested folks. Our projects tend to focus on areas that might be of interest to folks working across the open source tech community: language detection, numerical sort, large data visualizations, maps, and all sorts of other things.* *If you have any questions, please let me know! Thanks, and I hope to see you at CREDIT.* *YOURNAME* Thanks! Adam Baso Director of Engineering, Reading Wikimedia Foundation abaso(a)wikimedia.org

7 years, 2 months

Removing wfIncrStats from MobileFrontend's Special:MobileOptions page

by Sam Smith

Hullo, Some time ago, the Reading Web team noticed that the Special:MobileOptions page is instrumented in two distinct ways: using EventLogging and wfIncrStats. We had a little spare bandwidth this sprint and got around to removing the <https://phabricator.wikimedia.org/T132134>wfIncrStats <https://phabricator.wikimedia.org/T132134>-based logging from <https://phabricator.wikimedia.org/T132134>Special:MobileOptions <https://phabricator.wikimedia.org/T132134>. As of today's deploy, we won't be incrementing the following keys in statsd: - mobile.options.views - mobile.options.errors - mobile.options.saves We'll be looking into and documenting other wfIncrStats-based logging in the MobileFrontend codebase soon. Thanks! -Sam

7 years, 3 months

Wiki-specific parsing in mobile "services"

by Federico Leva (Nemo)

Is it considered acceptable now to produce a service or API that hardcodes wiki-specific parsing of certain wikitext or HTML patterns in certain wiki pages (such as the "On this day" section of the main page of one wiki)? I'm confused by the status of things and after my comment https://phabricator.wikimedia.org/T143408#2919000 I see little effort on finding solutions potentially able to scale to all our projects and languages (which I assume to be the mission, see "globally" in https://wikimediafoundation.org/wiki/Mission_statement ; please point it out if this assumption is incorrect). It might be that wiki-specific parsing hardcoded in MediaWiki/Wikimedia code is actually able to scale, if written correctly; a comment on the association patch seemed to imply so. This would be a very surprising finding, and one which goes against 15 years of experience, so if we have some examples or evidence of this it would be very worthwhile to point them out. Nemo

7 years, 3 months

Wikipedia app v5.3.4 for iOS released to store

by Joshua Minor

Live from the Dev Summit, we just released a small update for the Wikipedia iOS app to the App Store. Version 5.3.4 includes a handful of stability and bug fixes, particularly when starting the app or using the Share-a-fact feature. Thanks, Josh Minor PM, Wikipedia for iOS

7 years, 3 months

Readership metrics for the timespan until January 1, 2017

by Zareen Farooqui

Hi all, Here is the usual look <https://www.mediawiki.org/wiki/Reading/Readership_metrics_reports> at our most important readership metrics. This time we see a seasonal decline in desktop engagement and rise in mobile engagement over the winter holidays. As laid out earlier <https://lists.wikimedia.org/pipermail/mobile-l/2015-September/009773.html>, the main purpose is to raise awareness about how these are developing, call out the impact of any unusual events, and facilitate thinking about core metrics in general. As always; feedback and discussion welcome. Week-over-week and month-over-month changes are now being recorded on the Product page <https://www.mediawiki.org/wiki/Wikimedia_Product#Reading> at MediaWiki.org. This edition of the report covers a timespan of four weeks. The chart below looks at long-term traffic trends from May 2013 - December 2016. This shows that over the last three and a half years, the annual change in overall pageviews is down 3%, desktop is down 16%, and mobile (web + apps) is trending upwards at a rate of 23%. However, the past few months have seen total pageviews increasing year-over-year (chart further below). Now to the usual data. (All numbers below are averages for December 5, 2016 - January 1, 2017 unless otherwise noted.) Pageviews Total: 528 million/day (-0.2% from the previous report) Context (April 2015-January 2017): See also the Vital Signs dashboard <https://analytics.wikimedia.org/dashboards/vital-signs/#projects=all/metric…> Similar to last year <https://upload.wikimedia.org/wikipedia/commons/c/c6/Readership_metrics_for_…>, overall daily pageviews declined for the 3 weeks leading up to Christmas. However, mobile pageviews spike around Christmas and New Years. To facilitate our understanding of which traffic movements are seasonal and which may indicate lasting changes, here is a chart overlaying the total pageview numbers back to May 2013 (the earliest time for which we have data according to the current pageview definition): The blue lines shows a seasonal dip in pageviews around Christmas time. Since then, total pageviews have been rising, as expected. The year-over-year increase in total pageviews has continued (December 2016 is up 5.9% from December 2015). Desktop: 51.5% (previous report: 54.1%) Mobile web: 46.8% (previous report: 44.8%) Apps: 1.7% (previous report: 1.1%) Since the last report timeframe, overall mobile percentage rose, mainly due to the large spike around Christmas (58% mobile pageviews) and New Years (59% mobile pageviews). This resembles the Christmas bump from 2015, however at a level that is about 3-4% higher now. While December 20, 2015 was the first ever day where the majority of pageviews were mobile, the week from December 26, 2016 to January 1, 2017 marks the first full week where this was the case (53.6% mobile wep + app)! Presumably though this will drop again below parity in January. Also, a caveat that part of this increase was caused by the iOS Wikipedia app’s pageviews almost quadrupling from December 20 on, which might <https://phabricator.wikimedia.org/T154735> be an anomaly. However, this does not have a large effect overall, as it increases mobile % by only about 1.3%. Global North ratio: 76.8% of total pageviews (previous report: 75.3%) Context (January 2016-January 2017): There is a noticeable decrease in Global North pageviews percentage for a couple days around December 21, but a growth to almost 80% immediately follows. NB: We are currently rethinking this metric and might replace it with a different country selection constructed as part of the work on the New Readers project. Unique devices See the announcement blog post <https://blog.wikimedia.org/2016/03/30/unique-devices-dataset/> from March 2016 for background and details on this metric. These estimated numbers are provided for all Wikimedia language projects (separately for the desktop and mobile web version). Because of the instrumentation method, there is no global metric for all projects and all languages, but following some recent discussions it is now planned <https://phabricator.wikimedia.org/T138027> to extend it to a cross-language global metric per project at least. For now, we track the daily numbers of the English Wikipedia in this report. Daily unique devices estimate for English Wikipedia: - Mobile web: 33.6 million (previous report: 33.9 million) - Desktop: 21.6 million (previous report: 24.1 million) - Total: 55.2 million (previous report: 57.9 million) - Average mobile web ratio: 61.2% (previous report: 58.7%) Context (January 2016- January 2017): This metric hasn’t existed long enough yet to get a good sense of what yearly seasonalities may exist, but since the last report time frame daily unique desktop devices continued their decline until a small rise for a couple days following Christmas. Daily unique mobile devices also followed this pattern, but the decline leading up to Christmas was less pronounced. Interestingly, even though the number of unique desktop devices was declining in early December, the number of daily views per desktop device was rising. The small increase in mobile pageviews mentioned in the last report has continued. New app installations Android: 19.1k/day (-3.9% from the previous report) Daily installs per device, from Google Play Context (last eight months): At the beginning of December, the previously discussed increase in installs stopped for an unknown reason. However, there is a large spike of 28,452 installs on December 25. We continue to see above average install numbers for a few days, until December 31st. The number of uninstalls have been dropping slowly for the last few weeks in December. iOS: 5.33 k/day (-0.2% from the previous report) Download numbers from App Annie Context (last two months): [image: Wikipedia iOS app daily downloads by country, Nov 1, 2016 - Jan 1, 2017 (App Annie).png] Downloads of the iOS app saw a considerable increase around December 25, remaining at higher levels for the following week - clearly the result of Apple providing a lot of christmas presents again this year. There was also a spike on December 18 in downloads from the Netherlands, which because of its form and the fact that the increase was by a suspiciously round number (from around 50 to 10,050 downloads per day) is likely to have been an anomaly. App user retention Android: 16.8% (previous report: 16.4%) (Ratio of app installs opened again 7 days after installation, among all installed one week before a date that falls within this report. 1:100 sample) Context (last seven months): As remarked in earlier reports, this data is a bit too noisy for drawing conclusions about whether retention changed significantly between different releases. But we can at least rule out the existence of major shifts during this timespan. iOS: N/A <https://phabricator.wikimedia.org/T126693> Unique app users Android: 1.179 million / day (+0.3% from the previous report) Context (last seven months): Android daily active users remain steady until a spike around Christmas and New Year which matches the spike in unique mobile devices and mobile pageviews. iOS: N/A <https://phabricator.wikimedia.org/T130432> Zareen Farooqui, Data Analyst Intern, Wikimedia Foundation Tilman Bayer, Senior Analyst, Wikimedia Foundation Data sources For reference, the queries and source links used are listed below (access is needed for each). Unless otherwise noted, all content of this report is © Wikimedia Foundation and released under the CC BY-SA 3.0 <https://creativecommons.org/licenses/by-sa/3.0/> license. Most of the above charts are available on Commons, too. <https://commons.wikimedia.org/wiki/Category:Wikimedia_readership_metrics_re…> SELECT year, month, CONCAT(year,"-",LPAD(month,2,"0")) as yearmonth, SUM(view_count) AS allhuman, sum(IF(access_method = 'desktop', view_count, null)) AS desktophuman FROM wmf.projectview_hourly WHERE year = 2016 AND month > 10 AND agent_type = 'user' GROUP BY year, month ORDER BY year, month LIMIT 1000; SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year>0 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000; SELECT access_method, SUM(view_count)/(7*4) FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2016-12-05" AND "2017-01-01" GROUP BY access_method; SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")), SUM(view_count) AS all, SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,I S,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO, NZ,JP,SG,KR,TW,US') > 0, view_count, 0)) AS Global_North_views FROM wmf.projectview_hourly WHERE year > 0 AND agent_type='user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000; SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, SUM(IF(uri_host LIKE 'en.m.wikipedia%', uniques_estimate, 0)) AS enwiki_mobile_web FROM wmf.last_access_uniques_daily WHERE year=2016 OR year=2017 GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000; SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, SUM(IF(uri_host LIKE 'en.wikipedia%', uniques_estimate, 0)) AS enwiki_desktop FROM wmf.last_access_uniques_daily WHERE year=2016 OR year=2017 GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000; SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) AS date, SUM(IF(access_method = 'mobile web', view_count, null)) AS mobilewebviews, SUM(IF(access_method = 'desktop', view_count, null)) AS desktopviews FROM wmf.projectview_hourly WHERE year=2016 OR year=2017 AND agent_type = 'user' AND project = 'en.wikipedia' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000; SELECT LEFT(timestamp, 8) AS date, SUM(IF(event_appInstallAgeDays = 0, 1, 0)) AS day0_active, SUM(IF(event_appInstallAgeDays = 7, 1, 0)) AS day7_active FROM log.MobileWikiAppDailyStats_12637385 WHERE userAgent LIKE '%-r-%' AND userAgent NOT LIKE '%Googlebot%' GROUP BY date ORDER BY DATE; (with the retention rate calculated as day7_active divided by day0_active from seven days earlier, of course) https://console.developers.google.com/storage/browser/pubsite_prod_rev_0281… (“overview”) https://www.appannie.com/dashboard/252257/item/324715238/downloads/ (select “Total”) https://analytics.itunes.apple.com/#/retention?app=324715238 SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android'; Zareen Farooqui

7 years, 3 months

Re: [WikimediaMobile] [Wikitech-l] 2017-01-04 Scrum of Scrums meeting notes

by Federico Leva (Nemo)

Thanks. https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-01-04#Web mentions a next sprint about MobileFrontend technical debt. How can one propose tickets for such sprint? Nemo

7 years, 3 months

Wikipedia v5.3.4 for iOS beta 1 released

by Joshua Minor

Hello, Happy new year! New year, new version... We just posted a first beta of v5.3.4 to our TestFlight beta channel. This version improves stability, particularly at start up and with image loading, along with a handful of other bug fixes. If you'd like to sign up as a beta tester, please join us here: https://docs.google.com/forms/d/e/1FAIpQLSfW7zFnUDYABvHLWlFclZ7OJEK82WjVIjs… Cheers, Josh Minor PM, Wikipedia for iOS

7 years, 3 months

[KIWIX] for Android 2.1 released

by Emmanuel Engelhart

Hi We have released last week a new version of Kiwix for Android. Here the list of improvements: * FIX: Display of storage devices * FIX: External SD cards detection * FIX: ZIM files detection speed * FIX: Core errors handling * FIX: Save images * FIX: ZIM file deletion * FIX: Transparent action menu * FIX: ZIM opening from external file browsers * NEW: Pause/Resume TTS The app is available on Google play at http://android.kiwix.org and the APK can also be download at http://download.kiwix.org/bin/kiwix.apk Happy new year Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication

7 years, 3 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Mobile-l January 2017