I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
This is a great feature for public presentations, thanks for creating it. I think a version that displays edit only updates from the English language wikipedia could be a nice feature. Lior
On Thu, Jun 16, 2011 at 7:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Good ideas. Although I'm not sure how much of that I can glean from the IRC messages without starting to hammer on the Wikipedia APIs.
//Ed
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
A separate column for bot edits could be nice too.
On Thu, Jun 16, 2011 at 9:01 AM, Ed Summers ehs@pobox.com wrote:
Good ideas. Although I'm not sure how much of that I can glean from the IRC messages without starting to hammer on the Wikipedia APIs.
//Ed
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
I'd also like to see another layer of color-coding - background shading based on some measure of wikitrust.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about
wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617
529 4266
-- Samuel Klein identi.ca:sj w:user:sj +1 617
529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wow, thanks Ward. You made my professional career :-)
Major props to node.js, redis and socket.io. I really just put the lego pieces together. It feels like the tools are getting better and better some days. (he says as he tunes the TCP stack on his little linode VPN to keep up with the traffic ...)
//Ed
On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham ward@c2.com wrote:
I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Really solid! This looks like the new go-to visualization for demonstrating the pace of changes on Wikipedia.
One feature you might consider adding to it would be the option to just see the stream from one language.
Another thing that would be good, in my opinion, would be to replace the flags with something like color-coded language abbreviations: en, de, and so on.
Thanks much for this. I've already added it to the Wikimedia Education Portal as a resource that teachers can use for getting students excited about Wikipedia when they are running Wikipedia assignments in class.
-Sage Ross
On Thu, Jun 16, 2011 at 11:53 AM, Ed Summers ehs@pobox.com wrote:
Wow, thanks Ward. You made my professional career :-)
Major props to node.js, redis and socket.io. I really just put the lego pieces together. It feels like the tools are getting better and better some days. (he says as he tunes the TCP stack on his little linode VPN to keep up with the traffic ...)
//Ed
On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham ward@c2.com wrote:
I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Yes, this is amazing, thanks for making it! It's great that it shows bot edits in a different color, as most people just tend to filter them out. This definitely will be my go-to visualization for presentations, both about Wikipedia generally and about bots.
Stuart Geiger
On Thu, Jun 16, 2011 at 9:56 AM, Sage Ross ragesoss+wikipedia@gmail.com wrote:
Really solid! This looks like the new go-to visualization for demonstrating the pace of changes on Wikipedia.
One feature you might consider adding to it would be the option to just see the stream from one language.
Another thing that would be good, in my opinion, would be to replace the flags with something like color-coded language abbreviations: en, de, and so on.
Thanks much for this. I've already added it to the Wikimedia Education Portal as a resource that teachers can use for getting students excited about Wikipedia when they are running Wikipedia assignments in class.
-Sage Ross
On Thu, Jun 16, 2011 at 11:53 AM, Ed Summers ehs@pobox.com wrote:
Wow, thanks Ward. You made my professional career :-)
Major props to node.js, redis and socket.io. I really just put the lego pieces together. It feels like the tools are getting better and better some days. (he says as he tunes the TCP stack on his little linode VPN to keep up with the traffic ...)
//Ed
On Thu, Jun 16, 2011 at 10:43 AM, Ward Cunningham ward@c2.com wrote:
I've written this app several times using technology from text-to-speech to quartz-composer. I have to tip my hat to Ed for doing a better job than I ever did and doing it in a way that he makes look effortless. Kudos to Ed for sharing both the page and the software that produces it. You made my morning. -- Ward
On Jun 15, 2011, at 11:04 PM, Ed Summers wrote:
Actually re-reading this again, I definitely can grab the number of characters in the change from the IRC update ... something like this 3 column display could work.
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
SJ
On Thu, Jun 16, 2011 at 12:40 AM, Ed Summers ehs@pobox.com wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.org
Perhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Samuel Klein identi.ca:sj w:user:sj +1 617 529 4266
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi SJ,
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
I am trying out a slider that allows you to set an "edit size" limit, which should achieve roughly the same thing without the need for additional columns. I haven't done any checking for pages that are immediately reverted though (yet).
When I have time next I want to highlight the bots differently, maybe with a small robot icon (let me know if you know of one), and allow them to be filtered. Also I want to add language filtering since several people have asked for that. I'm not quite sure how to do the right-to-left for (ar,fa, ur, and he) since this basically right justifies things, and it's mixed in with other direction text. Ideas welcome on that front.
//Ed
PS. I'm having some issues keeping the service running. At the moment I'm not sure if its a bug in my code or something lower level in socket.io, express or node just yet...
Ed -- Nice. To be clear, I would still appreciate a multi-column look, because for me that is a much clearer visualization of the site's activity than looking at any single edit-size-range. It's like a sparkline: you can get both a sense of flow and a feel for the texture in the dimension of significance.
In fact, for the larger edits it might make sense to include 40 chars of text from the update on a second line.
Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.
SJ
On Sat, Jun 18, 2011 at 8:33 AM, Ed Summers ehs@pobox.com wrote:
Hi SJ,
On Thu, Jun 16, 2011 at 1:46 AM, Samuel Klein meta.sj@gmail.com wrote:
Without changing the concept or algorithm much, I'd like to see a three column version, with the left-most column being for all edits -- with speed smoothed out over time (time delay 30 seconds, average it out); the middle one being edits changing over 100 chars that aren't immediately reverted (time-delayed 1 min?), and the left column being edits changing over 1,000 chars that aren't quickly reverted (time-delayed 2 minutes?), and aren't by bots or huggle.
I am trying out a slider that allows you to set an "edit size" limit, which should achieve roughly the same thing without the need for additional columns. I haven't done any checking for pages that are immediately reverted though (yet).
When I have time next I want to highlight the bots differently, maybe with a small robot icon (let me know if you know of one), and allow them to be filtered. Also I want to add language filtering since several people have asked for that. I'm not quite sure how to do the right-to-left for (ar,fa, ur, and he) since this basically right justifies things, and it's mixed in with other direction text. Ideas welcome on that front.
//Ed
PS. I'm having some issues keeping the service running. At the moment I'm not sure if its a bug in my code or something lower level in socket.io, express or node just yet...
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein meta.sj@gmail.com wrote:
Ed -- Nice. To be clear, I would still appreciate a multi-column look, because for me that is a much clearer visualization of the site's activity than looking at any single edit-size-range. It's like a sparkline: you can get both a sense of flow and a feel for the texture in the dimension of significance.
Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.
Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.
Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs?
//Ed
On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers ehs@pobox.com wrote:
Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.
Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs?
There are a few types of reverts. Some have "rv" or "rvv" or "revert" [or equivalent in the appropriate language] in the edit summary, undoing 1 edit Some are (-N) changes immediately after a (+N) change, with some other edit summary A combination of the above rolling back multiple edits. Here (-N) is larger than the previous (+M)
The first group can be identified with few false positives - and the -N/+N character-change used for confirmation.
S.
Ed,
Can we plan for a few filter options for name spaces, time zones, IP edits vs non IP edits, for IP edits, may be geolocation based IP activism on a mao, Also may be languages grouped by continent (may be tie with timezone) etc?
Regards, Jyothis.
My Malayalam Wikipedia page http://ml.wikipedia.org/wiki/User:Jyothis Metawiki page http://meta.wikimedia.org/wiki/User:Jyothis I am the first customer of http://www.netdotnet.com My toolserver tools http://toolserver.org/~jyothis
woods are lovely dark and deep, but i have promises to keep and miles to go before i sleep and *lines to go before I press sleep*
completion date = (start date + ((estimated effort x 3.1415926) / resources) + ((total coffee breaks x 0.25) / 24)) + Effort in meetings
On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers ehs@pobox.com wrote:
On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein meta.sj@gmail.com wrote:
Ed -- Nice. To be clear, I would still appreciate a multi-column look, because for me that is a much clearer visualization of the site's activity than looking at any single edit-size-range. It's like a sparkline: you can get both a sense of flow and a feel for the texture in the dimension of significance.
Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.
Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.
Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs?
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi
On Mon, Jun 20, 2011 at 2:48 AM, Jyothis E jyothis.e@gmail.com wrote:
Ed,
Can we plan for a few filter options for name spaces, time zones, IP edits vs non IP edits, for IP edits, may be geolocation based IP activism on a mao, Also may be languages grouped by continent (may be tie with timezone) etc?
Regards, Jyothis.
My Malayalam Wikipedia page http://ml.wikipedia.org/wiki/User:Jyothis Metawiki page http://meta.wikimedia.org/wiki/User:Jyothis I am the first customer of http://www.netdotnet.com My toolserver tools http://toolserver.org/~jyothis
woods are lovely dark and deep, but i have promises to keep and miles to go before i sleep and *lines to go before I press sleep*
completion date = (start date + ((estimated effort x 3.1415926) / resources) + ((total coffee breaks x 0.25) / 24)) + Effort in meetings
On Sun, Jun 19, 2011 at 5:48 PM, Ed Summers ehs@pobox.com wrote:
On Sat, Jun 18, 2011 at 7:05 PM, Samuel Klein meta.sj@gmail.com wrote:
Ed -- Nice. To be clear, I would still appreciate a multi-column look, because for me that is a much clearer visualization of the site's activity than looking at any single edit-size-range. It's like a sparkline: you can get both a sense of flow and a feel for the texture in the dimension of significance.
Understood. I'm just not sure I want to make the display that complicated at this point. The code is there for you to use as you wish though.
Reverts could show up as a thin red line between two edits, extending to the side with the word "rv", with the article title available on mouseover.
Do you have a sense of the mechanics of identifying reverts? Do they show up in an identifiable way in the IRC logs?
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi Jodi,
On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider jschneider@pobox.com wrote:
It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi
Yes, absolutely. Do you happen to know if their IRC logs are roughly the same as the main language wikipedias? Another good candidate for adding to the Issue tracker if you have time to note it down.
//Ed
Thanks for the suggestions all (keep them coming). I added the ability to filter by language, as well by whether the edit was by a logged in user, an anonymous (IP) user, or a bot. I'm not completely happy with the icons I chose so if you know of any better ones please let me know.
http://wikistream.inkdroid.org
//Ed
On Mon, Jun 20, 2011 at 9:57 AM, Ed Summers ehs@pobox.com wrote:
Hi Jodi,
On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider jschneider@pobox.com wrote:
It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi
Yes, absolutely. Do you happen to know if their IRC logs are roughly the same as the main language wikipedias? Another good candidate for adding to the Issue tracker if you have time to note it down.
//Ed
Ed,
nice job. Some minor glitches you may want to fix:
- there's a typo in the dropdown menu (All Wikpedias) - you should probably set a min-width for the control panel - when I move the slide to values greater than 0 the text is wrapped, no matter how large my browser window is (tested in FF/Safari/Chrome on Mac OS) - there is no legend explaining how the diff size is measured (I know it's trivial, but it would be helpful for people who are not familiar with Wikipedia) - for RTL languages (Arabic, Hebrew) the diff size is displayed incorrectly in Safari (it's appended to the left and, when negative, the minus sign is wrongly positioned)
HTH
Dario
On Jun 21, 2011, at 9:19 PM, Ed Summers wrote:
Thanks for the suggestions all (keep them coming). I added the ability to filter by language, as well by whether the edit was by a logged in user, an anonymous (IP) user, or a bot. I'm not completely happy with the icons I chose so if you know of any better ones please let me know.
http://wikistream.inkdroid.org
//Ed
On Mon, Jun 20, 2011 at 9:57 AM, Ed Summers ehs@pobox.com wrote:
Hi Jodi,
On Sun, Jun 19, 2011 at 11:14 PM, Jodi Schneider jschneider@pobox.com wrote:
It would be really interesting to have these visualizations for other projects (e.g. wikisource, wikiquote, ...). -Jodi
Yes, absolutely. Do you happen to know if their IRC logs are roughly the same as the main language wikipedias? Another good candidate for adding to the Issue tracker if you have time to note it down.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
On Wed, Jun 22, 2011 at 12:45 AM, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
- there's a typo in the dropdown menu (All Wikpedias)
fixed, thanks!
- you should probably set a min-width for the control panel
- when I move the slide to values greater than 0 the text is wrapped, no matter how large my browser window is (tested in FF/Safari/Chrome on Mac OS)
Hmm, is this still the case? I fixed the width of the #controls to 650px. Hopefully that'll prevent that behavior.
- there is no legend explaining how the diff size is measured (I know it's trivial, but it would be helpful for people who are not familiar with Wikipedia)
Yes, good idea, I guess I've got some real estate for that.
- for RTL languages (Arabic, Hebrew) the diff size is displayed incorrectly in Safari (it's appended to the left and, when negative, the minus sign is wrongly positioned)
Thanks, I'm not quite sure how to fix that. But I'll add it to the RTL ticket that is already in GitHub.
https://github.com/edsu/wikistream/issues/6
//Ed
- you should probably set a min-width for the control panel
- when I move the slide to values greater than 0 the text is wrapped, no matter how large my browser window is (tested in FF/Safari/Chrome on Mac OS)
Hmm, is this still the case? I fixed the width of the #controls to 650px. Hopefully that'll prevent that behavior.
min-width now works as expected, but the wrapped text issue is still there in all three browsers
D
On Wed, Jun 22, 2011 at 1:11 AM, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
min-width now works as expected, but the wrapped text issue is still there in all three browsers
Ok I made the deltaControl a bit bigger. It looks fine in my Chrome and Firefox (on Linux). If it is still a problem for you could I twist your arm into opening a ticket with the details of what browser/OS you are using, so we don't bug everyone on the list with my lack of CSS chops? :-)
https://github.com/edsu/wikistream/issues
//Ed
You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)...
Best, Dmitry On Jun 21, 2011 10:25 PM, "Ed Summers" ehs@pobox.com wrote:
On Wed, Jun 22, 2011 at 1:11 AM, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
min-width now works as expected, but the wrapped text issue is still
there in all three browsers
Ok I made the deltaControl a bit bigger. It looks fine in my Chrome and Firefox (on Linux). If it is still a problem for you could I twist your arm into opening a ticket with the details of what browser/OS you are using, so we don't bug everyone on the list with my lack of CSS chops? :-)
https://github.com/edsu/wikistream/issues
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov dchichkov@gmail.com wrote:
You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)...
Oh wow, maybe I can shut mine off now :-)
//Ed
Ed Summers, 22/06/2011 12:14:
On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote:
You may want to take a look at the wpcvn.com - it also displays realtime stream (filtered)...
Oh wow, maybe I can shut mine off now :-)
Looks like the opposite happened.
Nemo
Hmm... Somebody actually visited the site. Interesting. I've been running it over a year and I haven't seen the thing used much. Looks like it was only some weird IP change, I've updated the DNS. So it should be back up pretty soon.
Anyway the main point was to show some alternative implementation/ideas. And by the way source code is available here http://code.google.com/p/wrdese/it%27s a very lightweight Django/JQuery project and can be tweaked fairly easily...
-- Best, Dmitry
On Wed, Aug 17, 2011 at 1:19 AM, Federico Leva (Nemo) nemowiki@gmail.comwrote:
Ed Summers, 22/06/2011 12:14:
On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote:
You may want to take a look at the wpcvn.com - it also displays
realtime
stream (filtered)...
Oh wow, maybe I can shut mine off now :-)
Looks like the opposite happened.
Nemo
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Just verified, it is back up. And actual changes are also coming through [filtered by negative user ratings (calculated using some pretty old wikipedia dump)].
-- Best, Dmitry
On Wed, Aug 17, 2011 at 2:33 AM, Dmitry Chichkov dchichkov@gmail.comwrote:
Hmm... Somebody actually visited the site. Interesting. I've been running it over a year and I haven't seen the thing used much. Looks like it was only some weird IP change, I've updated the DNS. So it should be back up pretty soon.
Anyway the main point was to show some alternative implementation/ideas. And by the way source code is available here http://code.google.com/p/wrdese/ it's a very lightweight Django/JQuery project and can be tweaked fairly easily...
-- Best, Dmitry
On Wed, Aug 17, 2011 at 1:19 AM, Federico Leva (Nemo) nemowiki@gmail.comwrote:
Ed Summers, 22/06/2011 12:14:
On Wed, Jun 22, 2011 at 2:25 AM, Dmitry Chichkov wrote:
You may want to take a look at the wpcvn.com - it also displays
realtime
stream (filtered)...
Oh wow, maybe I can shut mine off now :-)
Looks like the opposite happened.
Nemo
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi all,
Just a quick heads up to let you know I added some statistics gathering to wikistream.inkdroid.org for displaying "trending" articles. Trending articles are just articles ranked by how many times they were edited in the current hour or day (relative to GMT). I added similar stats for editors and bots. Since I just deployed the code, the numbers for today aren't complete, but they should be going forward.
I wanted to store the stats from the past hour and past 24 hours using a rolling window. But this proved trickier (for me) to do w/ the Redis backend that I was already using for streaming the updates (pub/sub). It should be possible, but I thought I would make a start, and see if it was worth the extra effort. Let me know what you think, if anything comes to mind.
//Ed
The trending articles are really nice, Ed! It would be nice to add tooltips for the bot/person/(whatever the red things are) icons; those icon-based filters are a nice addition!
-Jodi
On Sat, Jun 25, 2011 at 5:38 PM, Ed Summers ehs@pobox.com wrote:
Hi all,
Just a quick heads up to let you know I added some statistics gathering to wikistream.inkdroid.org for displaying "trending" articles. Trending articles are just articles ranked by how many times they were edited in the current hour or day (relative to GMT). I added similar stats for editors and bots. Since I just deployed the code, the numbers for today aren't complete, but they should be going forward.
I wanted to store the stats from the past hour and past 24 hours using a rolling window. But this proved trickier (for me) to do w/ the Redis backend that I was already using for streaming the updates (pub/sub). It should be possible, but I thought I would make a start, and see if it was worth the extra effort. Let me know what you think, if anything comes to mind.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
This thread is pretty old, and what I'm going to say is hardly research worthy, but I thought I'd mention that I recently made the wikistream background image change based on uploads to the Wikimedia Commons :-)
http://wikistream.inkdroid.org/
If you try it out you might have to wait for a moment for a Commons upload to trigger the background to change from the default white.
//Ed
On Sat, Jun 25, 2011 at 9:55 PM, Jodi Schneider jschneider@pobox.com wrote:
The trending articles are really nice, Ed! It would be nice to add tooltips for the bot/person/(whatever the red things are) icons; those icon-based filters are a nice addition! -Jodi
On Sat, Jun 25, 2011 at 5:38 PM, Ed Summers ehs@pobox.com wrote:
Hi all,
Just a quick heads up to let you know I added some statistics gathering to wikistream.inkdroid.org for displaying "trending" articles. Trending articles are just articles ranked by how many times they were edited in the current hour or day (relative to GMT). I added similar stats for editors and bots. Since I just deployed the code, the numbers for today aren't complete, but they should be going forward.
I wanted to store the stats from the past hour and past 24 hours using a rolling window. But this proved trickier (for me) to do w/ the Redis backend that I was already using for streaming the updates (pub/sub). It should be possible, but I thought I would make a start, and see if it was worth the extra effort. Let me know what you think, if anything comes to mind.
//Ed
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
It makes the trends page unreadable. Could you add a white underlay to the tabulated text so it does not become obscured by a changing unpredictable background?
Cheers, Fae -- http://enwp.org/user_talk:fae Guide to email tags: http://j.mp/faetags
Just fixed that, thanks!
//Ed
On Sat, Oct 15, 2011 at 10:57 PM, Fae faenwp@gmail.com wrote:
It makes the trends page unreadable. Could you add a white underlay to the tabulated text so it does not become obscured by a changing unpredictable background?
Cheers, Fae -- http://enwp.org/user_talk:fae Guide to email tags: http://j.mp/faetags
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi Jyothis,
On Sun, Jun 19, 2011 at 9:48 PM, Jyothis E jyothis.e@gmail.com wrote:
Can we plan for a few filter options for name spaces, time zones, IP edits vs non IP edits, for IP edits, may be geolocation based IP activism on a mao, Also may be languages grouped by continent (may be tie with timezone) etc?
Yes, great ideas! Definitely add these ideas in the Issue tracker [1] if you get a chance.
//Ed
Il 16/06/2011 06:40, Ed Summers ha scritto:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time
It's really nice, i think that would be great having an API to use that data for other web apps (for example to get the last page that has been edited from the english wikipedia in JSON or XML format).
Good job ;)
Hello,
Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included?
Kind regards Ziko
2011/6/16 fox fox91@anche.no:
Il 16/06/2011 06:40, Ed Summers ha scritto:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time
It's really nice, i think that would be great having an API to use that data for other web apps (for example to get the last page that has been edited from the english wikipedia in JSON or XML format).
Good job ;)
-- f.
"I didn't try, I succeeded" (Dr. Sheldon Cooper, PhD)
() ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
This is a b s o l u t e l y amazing.
Cheers, Goran
On Thu, Jun 16, 2011 at 7:21 PM, Ziko van Dijk zvandijk@googlemail.comwrote:
Hello,
Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included?
Kind regards Ziko
2011/6/16 fox fox91@anche.no:
Il 16/06/2011 06:40, Ed Summers ha scritto:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time
It's really nice, i think that would be great having an API to use that data for other web apps (for example to get the last page that has been edited from the english wikipedia in JSON or XML format).
Good job ;)
-- f.
"I didn't try, I succeeded" (Dr. Sheldon Cooper, PhD)
() ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Ziko van Dijk The Netherlands http://zikoblog.wordpress.com/
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Fancy options:
- Choose individual Projects [just look at wiktionary, for instance] - Choose a color scheme or audio scheme to go with it [ rcbirds comes to mind :) ] - Add small languages - Include or ignore bots, period
On Thu, Jun 16, 2011 at 1:21 PM, Ziko van Dijk zvandijk@googlemail.com wrote:
Hello,
Congratulations; the next step would be to let choose which language versions (or other Wikimedia projects) you want to have included?
Kind regards Ziko
2011/6/16 fox fox91@anche.no:
Il 16/06/2011 06:40, Ed Summers ha scritto:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time
It's really nice, i think that would be great having an API to use that data for other web apps (for example to get the last page that has been edited from the english wikipedia in JSON or XML format).
Good job ;)
-- f.
"I didn't try, I succeeded" (Dr. Sheldon Cooper, PhD)
() ascii ribbon campaign - against html e-mail /\ www.asciiribbon.org - against proprietary attachments
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
-- Ziko van Dijk The Netherlands http://zikoblog.wordpress.com/
Wiki-research-l mailing list Wiki-research-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Options: Show summary lines and time of edit.
Another crazy idea: bullet-time on mouseover. Not sure how that would work, but the damn thing moves too fast! (Good job everybody.)
Ed Summers wrote:
I've been looking to experiment with node.js lately and created a little toy webapp that displays updates from the major language wikipedias in real time:
http://wikistream.inkdroid.orgPerhaps like you, I've often tried to convey to folks in the GLAM sector (Galleries, Libraries, Archives and Museums) just how much Wikipedia is actively edited. GLAM institutions are increasingly interested in "digital curation" and I've sometimes displayed the IRC activity at workshops to demonstrate the sheer number of people (and bots) that are actively engaged in improving the content there...with the hopes of making the Wikipedia platform part of their curation strategy.
Anyhow, I'd be interested in any feedback you might have about wikistream.
Nice, I certainly agree it is a good "screensaver" for public presentations and such.
Feature request: ability to select feed from only some wikis (for example, En Wikipedia only, or Pl Wikipedia only).
wiki-research-l@lists.wikimedia.org