Pipes #4 on R/WW list of Top 10 Yahoo! Products

More great coverage of Pipes at ReadWriteWeb.

BTW, There have been a lot of new modules added in Pipes, check them out if you have not done so lately.


The best bit about Pipes

Someone told Daniel tonight that if they ever wanted to work at Yahoo! they would want to work on Pipes. I think that is the ultimate compliment.

Pipes Tech Talk @ Google

We gave a Google Tech Talk about Pipes over at the Googleplex on Monday. Many thanks to the organizers of the Google Tech Talk series for hosting us. They kindly captured the entire thing on video, did a great job on the post-production of the video and finally posted it to Google Video for your viewing pleasure:

New Pipes module: Fetch Data

Jonathan and I made a presentation about Pipes at ETech this past week. Not surprisingly, the Internet connectivity went out just at the moment I was about to give a demo of the Pipes editor. Fortunately, we had a backup video to use instead (thanks to Daniel for being paranoid and preparing it and Jonathan who insisted on  transferring it over to my laptop in the last minutes before the presentation).

We did announce a new module that should be very interesting for developers: Fetch Data. In addition to the regular Fetch module which worked with RSS and Atom feeds, the Fetch Data can work with arbitrary XML or JSON feeds.

The output of the module is still expected to be an array of records. With the help of the rename and regexp modules, it is possible to massage most data into something that can work well in Pipes. For example, you can process KML, XSPF or any other result set oriented REST response (eg: Amazon web service calls). I can’t wait to see how it is going to be used…

Crazy 72 hours

It’s been almost 72 hours since our beta launch. Needless to say, the response to Pipes has been overwhelming for everyone on the team (and our servers!). I have finally had a chance to relax/sleep after addressing some of the immediate issues.

Now we can get back to the main reason for introducing Pipes in beta: to find out what people want to do with them and use that feedback to guide our next steps.

We have already been getting a ton of feedback (thank you!), some of it things that we were aware of but didn’t get around to implementing before the beta(eg: date sorts), some of it about ideas further along on our plans (eg: external modules) and some really cool and wild ideas (eg: image processing modules,…).

I would like everyone to know that we are listening to their requests and we will try to evolve Pipes to meet their needs. It would be great if we could get your feedback through our suggestion boards so that we have it all in one place.

I was also amazed/flattered to find that there are already several Pipes tutorials and how-to posts in addition to the ones made by Brady from ORA.

Pipes Buzz!

Pipes is getting a crazy amount of coverage on the web (and our server load is going up with it). You can follow some of the buzz at these locations:

Or you can track them all using Leonard’s buzz aggregator pipe


Pipes Beta

This is my first blog post.

For the past several months, my teammates (ed, jonathan, daniel raffel, kevin) and I have been working on a project called Pipes. It is now live. Since Pipes is all about feeds, I thought that it would only be appropriate if I finally started a blog so that I could produce one too.

I am very excited to see Pipes’ vision resonating with some of the most visionary people on the web. I’d like to think that we pushed some boundarys and I am happy to see both the concept and the execution of Pipes being commented on.

Early on in the development of Pipes we recognized it’s large scope beyond simple processing of feeds. For example, would it not be cool if Pipes could be just as easily be applied to REST web services to allow truely generalized mashups?

Stay tuned for more…

ps: a hello to bradley and caterina, our project sponsors.