Le 23/09/2016 à 23:15, Andrew Otto a écrit :
Hi all,
We’ve been busy working on building a replacement for RCStream. This new
service would expose recentchanges as a stream as usual, but also other
types of event streams that we can make public.
But we’re having a bit of an existential crisis! We had originally chosen
to implement this using an up to date socket.io server, as RCStream also
uses socket.io. We’re mostly finished with this, but now we are taking a
step back and wondering if socket.io/websockets are the best technology to
use to expose stream data these days.
The alternative is to just use ‘streaming’ HTTP chunked transfer encoding.
<snip>
Hello,
As I understand it we have a legacy system we want to replace. It uses
an old socket.io with a set of events A.
Since you "are mostly finished with" a replacement that has the latest
socket.io I would ship that now and drop/replace the legacy system. With
no new events.
From there survey people about changing the transport
layer. Which leads
me to a few questions:
- is RCStream actually used?
- how many clients?
- typology of clients (big corp like Yahoo, Google, volunteers, WMF
internal use) ...
Then survey about the change of transport. The red hearing is that if
you get mostly volunteers, it is going to be long and tedious to have
them change to the new system. AFAIK WMF still maintains an IRC server
to stream events which was supposed to be dropped by RCStream. There
are still tools and bot relying on IRC protocol with no developers able
to do the migration.
You will face the exact same problem by changing to HTTP chunks, and we
would end up with:
- IRC (legacy)
- socket.io (on a legacy / outdated infra)
- HTTP chunk
My recommendations are:
- to upgrade the current socket.io since it is apparently already done.
- Find out who are the consumers of the IRC feed and RCStream, run a
survey and figure out what would fit their need best.
- Come with a plan to DROP the old systems
And hopefully we end up with a single system from which people can build
upon and on which we can introduce new type of events.
My 0.02 €
--
Antoine "hashar" Musso