I’ve seen feed on feeds in my referrer logs a few times, not sure if it does quite what I want but I’ll probably have a look and see how they do things as it might give me some hints as to how to proceed.

There isn’t a CPAN module that does everything I want, at least not as far as I know. All the hard work of parsing the feeds is taken care of with XML::Feed, and a crawler that respects robots.txt can be written quite easily using LWP::RobotUA, but unfortunately the latter module doesn’t cache robots.txt files and that’s a feature that I’d like to have. Plus of course there’s all the logic such as if you get a permanent redirect on a feed URL then you want to follow the redirect and update the database to reflect the move. Weeding out dead links is also a problem, and I really want most features to be automatic rather than requiring manual intervention.

Anyway, I’ll see how it pans out in the next couple of months. Given that I’ve got exams soon I won’t be doing too much work on the site until then, and I’m waiting for a book from Amazon that will give me more information on RSS and Atom feeds in general.

I’ve already started working on university stuff, mostly because I went back to my flat yesterday morning and picked up most of the stuff. Revision is coming along slowly, and I’ve started writing some of my report for my third year project,

However last xmas I did a small draught words of my report, and I thought it was just notes, it actually turned into the main report, and was a helpfull well worthwhile thing to do, so go you!

I’m also doing a little bit of work on one of my new site ideas, feedread. Basically it’s going to be a web-based RSS reader, a bit like Bloglines and Google Reader, but you’ll also be able to “tag” feeds, like you can with links on del.icio.us.

Hmm, you realise you can tag feeds with google reader? I guess you are going for public tagging? How are you thinking of dealing with their ajaxey goodness? Is there not a cpan module which will do all you want?

Also have you seen: feed on feeds. I actually really liked feed on feeds even compared to googles ajaxy niceness. I moved to google reader because I wanted somethign more centralised after my adsl died.

Merry Christmas to you too