wikistream: displays wikipedia updates in realtime

List overview All Threads
Download

newer

older

Wikimedia Coding Challenge:...

Call - Building Digital Commons 29...

Ed Summers

16 Jun 2011 16 Jun '11

4:40 a.m.

I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time: http://wikistream.inkdroid.org Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy. Anyhow, I'd be interested in any feedback you might have about wikistream. //Ed

Show replies by date

lior gimel

16 Jun 16 Jun

5:18 a.m.

New subject: wikistream: displays wikipedia updates in realtime

This is a great feature for public presentations, thanks for creating it. I think a version that displays edit only updates from the English language wikipedia could be a nice feature. Lior On Thu, Jun 16, 2011 at 7:40 AM, Ed Summers <ehs(a)pobox.com> wrote:

...

Samuel Klein

5:46 a.m.

New subject: wikistream: displays wikipedia updates in realtime

...

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266

Samuel Klein

5:46 a.m.

New subject: wikistream: displays wikipedia updates in realtime

I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust. On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266

Ed Summers

6:01 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Good ideas. Although I'm not sure how much of that I can glean from the IRC messages without starting to hammer on the Wikipedia APIs. //Ed On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust. On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote:

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266 _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

lior gimel

6:03 a.m.

New subject: wikistream: displays wikipedia updates in realtime

A separate column for bot edits could be nice too. On Thu, Jun 16, 2011 at 9:01 AM, Ed Summers <ehs(a)pobox.com> wrote:

...

I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust. On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote: > Without changing the concept or algorithm much, I'd like to see a > three column version, with the left-most column being for all edits -- > with speed smoothed out over time (time delay 30 seconds, average it > out); the middle one being edits changing over 100 chars that aren't > immediately reverted (time-delayed 1 min?), and the left column being > edits changing over 1,000 chars that aren't quickly reverted > (time-delayed 2 minutes?), and aren't by bots or huggle. > > SJ > > > On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <ehs(a)pobox.com> wrote: >> I've been looking to experiment with node.js lately and created a >> little toy webapp that displays updates from the major language >> wikipedias in real time: >> >> http://wikistream.inkdroid.org >> >> Perhaps like you, I've often tried to convey to folks in the GLAM >> sector (Galleries, Libraries, Archives and Museums) just how much >> Wikipedia is actively edited. GLAM institutions are increasingly >> interested in "digital curation" and I've sometimes displayed the IRC >> activity at workshops to demonstrate the sheer number of people (and >> bots) that are actively engaged in improving the content there...with >> the hopes of making the Wikipedia platform part of their curation >> strategy. >> >> Anyhow, I'd be interested in any feedback you might have about

wikistream.

>> >> //Ed >> >> _______________________________________________ >> Wiki-research-l mailing list >> Wiki-research-l(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >> > > > > -- > Samuel Klein identi.ca:sj w:user:sj +1 617

529 4266

-- Samuel Klein identi.ca:sj w:user:sj +1 617

529 4266

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

6:04 a.m.

New subject: wikistream: displays wikipedia updates in realtime

...

Ward Cunningham

2:43 p.m.

New subject: wikistream: displays wikipedia updates in realtime

I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:

...

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

3:53 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Wow, thanks Ward. You made my professional career :-) Major props to node.js, redis and socket.io. I really just put the lego pieces together. It feels like the tools are getting better and better some days. (he says as he tunes the TCP stack on his little linode VPN to keep up with the traffic ...) //Ed On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham <ward(a)c2.com> wrote:

...

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Sage Ross

4:56 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Really solid! This looks like the new go-to visualization for demonstrating the pace of changes on Wikipedia. One feature you might consider adding to it would be the option to just see the stream from one language. Another thing that would be good, in my opinion, would be to replace the flags with something like color-coded language abbreviations: en, de, and so on. Thanks much for this. I've already added it to the Wikimedia Education Portal as a resource that teachers can use for getting students excited about Wikipedia when they are running Wikipedia assignments in class. -Sage Ross On Thu, Jun 16, 2011 at 11:53 AM, Ed Summers <ehs(a)pobox.com> wrote:

...

Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle. SJ On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <ehs(a)pobox.com> wrote: > I've been looking to experiment with node.js lately and created a > little toy webapp that displays updates from the major language > wikipedias in real time: > > http://wikistream.inkdroid.org > > Perhaps like you, I've often tried to convey to folks in the GLAM > sector (Galleries, Libraries, Archives and Museums) just how much > Wikipedia is actively edited. GLAM institutions are increasingly > interested in "digital curation" and I've sometimes displayed the IRC > activity at workshops to demonstrate the sheer number of people (and > bots) that are actively engaged in improving the content there...with > the hopes of making the Wikipedia platform part of their curation > strategy. > > Anyhow, I'd be interested in any feedback you might have about wikistream. > > //Ed > > _______________________________________________ > Wiki-research-l mailing list > Wiki-research-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > -- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266 _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

R.Stuart Geiger

4:59 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Yes, this is amazing, thanks for making it! It's great that it shows bot edits in a different color, as most people just tend to filter them out. This definitely will be my go-to visualization for presentations, both about Wikipedia generally and about bots. Stuart Geiger On Thu, Jun 16, 2011 at 9:56 AM, Sage Ross <ragesoss+wikipedia(a)gmail.com> wrote:

...

Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work. On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote: > Without changing the concept or algorithm much, I'd like to see a > three column version, with the left-most column being for all edits -- > with speed smoothed out over time (time delay 30 seconds, average it > out); the middle one being edits changing over 100 chars that aren't > immediately reverted (time-delayed 1 min?), and the left column being > edits changing over 1,000 chars that aren't quickly reverted > (time-delayed 2 minutes?), and aren't by bots or huggle. > > SJ > > > On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers <ehs(a)pobox.com> wrote: >> I've been looking to experiment with node.js lately and created a >> little toy webapp that displays updates from the major language >> wikipedias in real time: >> >> http://wikistream.inkdroid.org >> >> Perhaps like you, I've often tried to convey to folks in the GLAM >> sector (Galleries, Libraries, Archives and Museums) just how much >> Wikipedia is actively edited. GLAM institutions are increasingly >> interested in "digital curation" and I've sometimes displayed the IRC >> activity at workshops to demonstrate the sheer number of people (and >> bots) that are actively engaged in improving the content there...with >> the hopes of making the Wikipedia platform part of their curation >> strategy. >> >> Anyhow, I'd be interested in any feedback you might have about wikistream. >> >> //Ed >> >> _______________________________________________ >> Wiki-research-l mailing list >> Wiki-research-l(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wiki-research-l >> > > > > -- > Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266 > > _______________________________________________ > Wiki-research-l mailing list > Wiki-research-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

18 Jun 18 Jun

12:33 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Hi SJ, On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

I am trying out a slider that allows you to set an "edit size" limit, which should achieve roughly the same thing without the need for additional columns. I haven't done any checking for pages that are immediately reverted though (yet). When I have time next I want to highlight the bots differently, maybe with a small robot icon (let me know if you know of one), and allow them to be filtered. Also I want to add language filtering since several people have asked for that. I'm not quite sure how to do the right-to-left for (ar,fa, ur, and he) since this basically right justifies things, and it's mixed in with other direction text. Ideas welcome on that front. //Ed PS. I'm having some issues keeping the service running. At the moment I'm not sure if its a bug in my code or something lower level in socket.io, express or node just yet...

Samuel Klein

11:05 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed -- Nice. To be clear, I would still appreciate a multi-column look, because for me that is a much clearer visualization of the site's activity than looking at any single edit-size-range. It's like a sparkline: you can get both a sense of flow and a feel for the texture in the dimension of significance. In fact, for the larger edits it might make sense to include 40 chars of text from the update on a second line. Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover. SJ On Sat, Jun 18, 2011 at 8:33 AM, Ed Summers <ehs(a)pobox.com> wrote:

...

Hi SJ, On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein <meta.sj(a)gmail.com> wrote:

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266

Ed Summers

19 Jun 19 Jun

9:48 p.m.

New subject: wikistream: displays wikipedia updates in realtime

On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.

...

Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.

Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs? //Ed

Samuel Klein

11:24 p.m.

New subject: wikistream: displays wikipedia updates in realtime

On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers <ehs(a)pobox.com> wrote:

...

Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.

Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs?

There are a few types of reverts. Some have "rv" or "rvv" or "revert" [or equivalent in the appropriate language] in the edit summary, undoing 1 edit Some are (-N) changes immediately after a (+N) change, with some other edit summary A combination of the above rolling back multiple edits. Here (-N) is larger than the previous (+M) The first group can be identified with few false positives - and the -N/+N character-change used for confirmation. S.

Jyothis E

20 Jun 20 Jun

1:48 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed, Can we plan for a few filter options for name spaces, time zones, IP edits vs non IP edits, for IP edits, may be geolocation based IP activism on a mao, Also may be languages grouped by continent (may be tie with timezone) etc? Regards, Jyothis. http://www.Jyothis.net My Malayalam Wikipedia page <http://ml.wikipedia.org/wiki/User:Jyothis> Metawiki page <http://meta.wikimedia.org/wiki/User:Jyothis> I am the first customer of http://www.netdotnet.com My toolserver tools <http://toolserver.org/~jyothis> woods are lovely dark and deep, but i have promises to keep and miles to go before i sleep and *lines to go before I press sleep* completion date = (start date + ((estimated effort x 3.1415926) / resources) + ((total coffee breaks x 0.25) / 24)) + Effort in meetings On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers <ehs(a)pobox.com> wrote:

...

On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.

Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.

Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs? //Ed _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Jodi Schneider

3:14 a.m.

It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi On Mon, Jun 20, 2011 at 2:48 AM, Jyothis E <jyothis.e(a)gmail.com> wrote:

...

On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.

Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

1:57 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Hi Jodi, On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider <jschneider(a)pobox.com> wrote:

...

It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi

Yes, absolutely. Do you happen to know if their IRC logs are roughly the same as the main language wikipedias? Another good candidate for adding to the Issue tracker if you have time to note it down. //Ed

Ed Summers

22 Jun 22 Jun

4:19 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Thanks for the suggestions all (keep them coming). I added the ability to filter by language, as well by whether the edit was by a logged in user, an anonymous (IP) user, or a bot. I'm not completely happy with the icons I chose so if you know of any better ones please let me know. http://wikistream.inkdroid.org //Ed On Mon, Jun 20, 2011 at 9:57 AM, Ed Summers <ehs(a)pobox.com> wrote:

...

Hi Jodi, On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider <jschneider(a)pobox.com> wrote:

It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi

Dario Taraborelli

4:45 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed, nice job. Some minor glitches you may want to fix: - there's a typo in the dropdown menu (All Wikpedias) - you should probably set a min-width for the control panel - when I move the slide to values greater than 0 the text is wrapped, no matter how large my browser window is (tested in FF/Safari/Chrome on Mac OS) - there is no legend explaining how the diff size is measured (I know it's trivial, but it would be helpful for people who are not familiar with Wikipedia) - for RTL languages (Arabic, Hebrew) the diff size is displayed incorrectly in Safari (it's appended to the left and, when negative, the minus sign is wrongly positioned) HTH Dario On Jun 21, 2011, at 9:19 PM, Ed Summers wrote:

...

Hi Jodi, On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider <jschneider(a)pobox.com> wrote:

It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

4:59 a.m.

New subject: wikistream: displays wikipedia updates in realtime

On Wed, Jun 22, 2011 at 12:45 AM, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

...

- there's a typo in the dropdown menu (All Wikpedias)

fixed, thanks!

...

- you should probably set a min-width for the control panel - when I move the slide to values greater than 0 the text is wrapped, no matter how large my browser window is (tested in FF/Safari/Chrome on Mac OS)

Hmm, is this still the case? I fixed the width of the #controls to 650px. Hopefully that'll prevent that behavior.

...

- there is no legend explaining how the diff size is measured (I know it's trivial, but it would be helpful for people who are not familiar with Wikipedia)

Yes, good idea, I guess I've got some real estate for that.

...

- for RTL languages (Arabic, Hebrew) the diff size is displayed incorrectly in Safari (it's appended to the left and, when negative, the minus sign is wrongly positioned)

Thanks, I'm not quite sure how to fix that. But I'll add it to the RTL ticket that is already in GitHub. https://github.com/edsu/wikistream/issues/6 //Ed

Dario Taraborelli

5:11 a.m.

New subject: wikistream: displays wikipedia updates in realtime

...

Hmm, is this still the case? I fixed the width of the #controls to 650px. Hopefully that'll prevent that behavior.

min-width now works as expected, but the wrapped text issue is still there in all three browsers D

Ed Summers

5:24 a.m.

New subject: wikistream: displays wikipedia updates in realtime

On Wed, Jun 22, 2011 at 1:11 AM, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote:

...

min-width now works as expected, but the wrapped text issue is still there in all three browsers

Dmitry Chichkov

6:25 a.m.

New subject: wikistream: displays wikipedia updates in realtime

You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)... Best, Dmitry On Jun 21, 2011 10:25 PM, "Ed Summers" <ehs(a)pobox.com> wrote:

...

On Wed, Jun 22, 2011 at 1:11 AM, Dario Taraborelli <dtaraborelli(a)wikimedia.org> wrote: > min-width now works as expected, but the wrapped text issue is still

there in all three browsers

...

Ok I made the deltaControl a bit bigger. It looks fine in my Chrome and Firefox (on Linux). If it is still a problem for you could I twist your arm into opening a ticket with the details of what browser/OS you are using, so we don't bug everyone on the list with my lack of CSS chops? :-) https://github.com/edsu/wikistream/issues //Ed _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

10:14 a.m.

New subject: wikistream: displays wikipedia updates in realtime

On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov <dchichkov(a)gmail.com> wrote:

...

You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)...

Oh wow, maybe I can shut mine off now :-) //Ed

Federico Leva (Nemo)

17 Aug 17 Aug

8:19 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed Summers, 22/06/2011 12:14:

...

On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote:

You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)...

Oh wow, maybe I can shut mine off now :-)

Looks like the opposite happened. Nemo

Dmitry Chichkov

9:33 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Hmm... Somebody actually visited the site. Interesting. I've been running it over a year and I haven't seen the thing used much. Looks like it was only some weird IP change, I've updated the DNS. So it should be back up pretty soon. Anyway the main point was to show some alternative implementation/ideas. And by the way source code is available here http://code.google.com/p/wrdese/it's a very lightweight Django/JQuery project and can be tweaked fairly easily... -- Best, Dmitry On Wed, Aug 17, 2011 at 1:19 AM, Federico Leva (Nemo) <nemowiki(a)gmail.com>wrote;wrote:

...

Ed Summers, 22/06/2011 12:14:

On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote: > You may want to take a look at the wpcvn.com - it also displays

realtime

stream (filtered)...

Oh wow, maybe I can shut mine off now :-)

Looks like the opposite happened. Nemo _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Dmitry Chichkov

10:03 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Just verified, it is back up. And actual changes are also coming through [filtered by negative user ratings (calculated using some pretty old wikipedia dump)]. -- Best, Dmitry On Wed, Aug 17, 2011 at 2:33 AM, Dmitry Chichkov <dchichkov(a)gmail.com>wrote;wrote:

...

Hmm... Somebody actually visited the site. Interesting. I've been running it over a year and I haven't seen the thing used much. Looks like it was only some weird IP change, I've updated the DNS. So it should be back up pretty soon. Anyway the main point was to show some alternative implementation/ideas. And by the way source code is available here http://code.google.com/p/wrdese/ it's a very lightweight Django/JQuery project and can be tweaked fairly easily... -- Best, Dmitry On Wed, Aug 17, 2011 at 1:19 AM, Federico Leva (Nemo) <nemowiki(a)gmail.com>wrote;wrote:

Ed Summers, 22/06/2011 12:14:

On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote: > You may want to take a look at the wpcvn.com - it also displays

realtime

stream (filtered)...

Oh wow, maybe I can shut mine off now :-)

Ed Summers

25 Jun 25 Jun

4:38 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Hi all, Just a quick heads up to let you know I added some statistics gathering to wikistream.inkdroid.org for displaying "trending" articles. Trending articles are just articles ranked by how many times they were edited in the current hour or day (relative to GMT). I added similar stats for editors and bots. Since I just deployed the code, the numbers for today aren't complete, but they should be going forward. I wanted to store the stats from the past hour and past 24 hours using a rolling window. But this proved trickier (for me) to do w/ the Redis backend that I was already using for streaming the updates (pub/sub). It should be possible, but I thought I would make a start, and see if it was worth the extra effort. Let me know what you think, if anything comes to mind. //Ed

Jodi Schneider

26 Jun 26 Jun

1:55 a.m.

The trending articles are really nice, Ed! It would be nice to add tooltips for the bot/person/(whatever the red things are) icons; those icon-based filters are a nice addition! -Jodi On Sat, Jun 25, 2011 at 5:38 PM, Ed Summers <ehs(a)pobox.com> wrote:

...

Ed Summers

16 Oct 16 Oct

2:44 a.m.

New subject: wikistream: displays wikipedia updates in realtime

This thread is pretty old, and what I'm going to say is hardly research worthy, but I thought I'd mention that I recently made the wikistream background image change based on uploads to the Wikimedia Commons :-) http://wikistream.inkdroid.org/ If you try it out you might have to wait for a moment for a Commons upload to trigger the background to change from the default white. //Ed On Sat, Jun 25, 2011 at 9:55 PM, Jodi Schneider <jschneider(a)pobox.com> wrote:

...

_______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Fae

2:57 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed Summers

3:29 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Just fixed that, thanks! //Ed On Sat, Oct 15, 2011 at 10:57 PM, Fae <faenwp(a)gmail.com> wrote:

...

It makes the trends page unreadable. Could you add a white underlay to the tabulated text so it does not become obscured by a changing unpredictable background? Cheers, Fae -- http://enwp.org/user_talk:fae Guide to email tags: http://j.mp/faetags _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

Ed Summers

20 Jun 20 Jun

1:55 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Hi Jyothis, On Sun, Jun 19, 2011 at 9:48 PM, Jyothis E <jyothis.e(a)gmail.com> wrote:

...

Can we plan for a few filter options for name spaces, time zones, IP edits vs non IP edits, for IP edits, may be geolocation based IP activism on a mao, Also may be languages grouped by continent (may be tie with timezone) etc?

Yes, great ideas! Definitely add these ideas in the Issue tracker [1] if you get a chance. //Ed [1] https://github.com/edsu/wikistream/issues

fox

16 Jun 16 Jun

5:06 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Il 16/06/2011 06:40, Ed Summers ha scritto:

...

I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time

Ziko van Dijk

5:21 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Hello, Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included? Kind regards Ziko 2011/6/16 fox <fox91(a)anche.no>no>:

...

Il 16/06/2011 06:40, Ed Summers ha scritto:

I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time

It's really nice, i think that would be great having an API to use that data for other web apps (for example to get the last page that has been edited from the english wikipedia in JSON or XML format). Good job ;) -- f. "I didn't try, I succeeded" (Dr. Sheldon Cooper, PhD) () ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

-- Ziko van Dijk The Netherlands http://zikoblog.wordpress.com/

Goran Milovanovic

6:08 p.m.

New subject: wikistream: displays wikipedia updates in realtime

This is a b s o l u t e l y amazing. Cheers, Goran On Thu, Jun 16, 2011 at 7:21 PM, Ziko van Dijk <zvandijk(a)googlemail.com>wrote;wrote:

...

Hello, Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included? Kind regards Ziko 2011/6/16 fox <fox91(a)anche.no>no>:

Il 16/06/2011 06:40, Ed Summers ha scritto:

I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time

-- Ziko van Dijk The Netherlands http://zikoblog.wordpress.com/ _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

-- -------------------------------------------------------------- "Truth is much too complicated to allow anything but approximations." :: John von Neumann -------------------------------------------------------------- http://www.milovanovicresearch.com

Samuel Klein

7:36 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Fancy options: - Choose individual Projects [just look at wiktionary, for instance] - Choose a color scheme or audio scheme to go with it [ rcbirds comes to mind :) ] - Add small languages - Include or ignore bots, period On Thu, Jun 16, 2011 at 1:21 PM, Ziko van Dijk <zvandijk(a)googlemail.com> wrote:

...

Hello, Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included? Kind regards Ziko 2011/6/16 fox <fox91(a)anche.no>no>:

Il 16/06/2011 06:40, Ed Summers ha scritto:

I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time

-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266

Joe Corneli

20 Jun 20 Jun

12:05 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Options: Show summary lines and time of edit.

Joe Corneli

12:13 a.m.

New subject: wikistream: displays wikipedia updates in realtime

Another crazy idea: bullet-time on mouseover. Not sure how that would work, but the damn thing moves too fast! (Good job everybody.)

Piotr Konieczny

16 Jun 16 Jun

7:49 p.m.

New subject: wikistream: displays wikipedia updates in realtime

Ed Summers wrote:

...

Nice, I certainly agree it is a good "screensaver" for public presentations and such. Feature request: ability to select feed from only some wikis (for example, En Wikipedia only, or Pl Wikipedia only). -- Piotr Konieczny PhD Candidate Dept of Sociology Uni of Pittsburgh http://pittsburgh.academia.edu/PiotrKonieczny/ http://en.wikipedia.org/wiki/User:Piotrus

4576

days inactive

4698

days old

wiki-research-l@lists.wikimedia.org

Manage subscription

40 comments

17 participants

tags (0)

participants (17)

Dario Taraborelli
Dmitry Chichkov
Ed Summers
Fae
Federico Leva (Nemo)
fox
Goran Milovanovic
Jodi Schneider
Joe Corneli
Jyothis E
lior gimel
Piotr Konieczny
R.Stuart Geiger
Sage Ross
Samuel Klein
Ward Cunningham
Ziko van Dijk