Thursday, October 7, 2010

Streamie now runs on Twitter Site Streams

The production environment of Streamie was just switched over to use the Twitter Site Stream API for backend connectivity. (The code for this currently lives in a branch).
With site streams the server only opens a single connection for every 1000 users. Twitter then sends the events of all users over this single connection. The node.js app uses a simple single process message queue to distribute the messages to the actual clients.
If you are running your own streamie server there should be no changes. Site streams are only available to privileged users. If you do not have access, streamie will transparently fall back to user streams. However, the site branch also introduces the usage of a JSON based config file for the server (instead of the ugly command line parameters).

1 comment:

jobs online said...

Nice post. I just came across your site and wanted to say that I have really enjoyed browsing your blog posts. Any way I’ll be subscribing to your blog and I hope you write again soon!