Lately I discovered Yahoo Pipes. I was actually looking for a tool to union all my feeds from twitter, this blog and flickr and make one feed. I found Atomisator, written in Python, but I needed to install it on a server, read the code, write the plugins… I was tired before having begun.
By the way, Atomisator is the typical side project developed to address a specic purpose, and then generalized in a kind of framework… without proper documentation or user interface. You see where it aims at, it is there right before your eyes … but in the end you have to do 70% of the work.
Browsing the web, I ended up creating a yahoo pipe. It is very similar to what ETLs do in enterprise data processing world (SSRS, Data Stage, Talend, etc…), It takes input in the form of connectors and apply transformations to every items or computes aggregates. It has loops, variables. It is kind of cool.
The result is here.
Feeds
Web Presence
