I'm trying to keep up with the ever increasing volume of scientific publications in my own and related fields. I've been using the Biophysical Journal's email based service for some time, but lately it has been very unreliable - often alerting me about supposedly 'new' papers that have been published in 1994 or so. Another way is to subscribe to the RSS/Atom feeds many journals provide, and I've been doing that also with Google reader, but it easily means wading through 100s of papers per week.
It's clear I need a better solution, something that first aggregates all the new papers into one big feed from the journals I am interested in, and then in a second step filters the big feed down to the few new papers that contain interesting keywords. Yahoo pipes could do that, but the LabVIEW-ish editor doesn't scale very well to a situation where you have 20+ feeds and 20+ keywords you are looking for. There's also google-mashup, but it isn't open for the public yet.
A complex solution would be to set up my own Planet, but it doesn't have web-based setup and administration so requires tinkering with config files etc. which I want to avoid.
So far I've only come up with this Thunderbird-based solution:
On the left I've subscribed to a number of journal feeds and put them in a folder of their own. On the right is a list of filters I am running. Each journal feed needs its own 'dummy filter' which does nothing but moves all the entries into the 'all papers' folder. Then I can run a filter of my own that looks for things in the subject or body of the paper. It's simple, ugly, but seems to work somehow.
Please tell me there is a simpler way to do this in Thunderbird! Or is there already a good web-based service like this around?
My requirements would be:
- able to read and aggregate: RSS/Atom etc. (whatever the journals provide)
- set up filters that look for keywords in any field or in only one field (title, author, abstract etc.)
- output an RSS feed with all papers, and the filtered papers that I can read with Thunderbird or Google-reader.
So far I haven't found anything that would do this in a pain-free way. The aggregation part is handled by most web-based services, but there aren't many that allow searching/filtering and can provide the results as a separate feed.
Something like this is already going on with 'virtual-journals' that aggregate papers across journals in one field (e.g. Virtual Journal of Biological Physics Research or Virtual Journal of Nanoscale Science & Technology). Papers get selected to these 'VJs' by their editors, but I'm thinking my aggregator+filter idea will be able to cover a broader range of journals and look for more specific search terms.