project note on how to search a blogroll: There’s one example here: http://erikbenson.com/code/search-my-blogroll.cgi and Feedster also allows you to limit your search to sites in your blogroll (which you provide in OPML format): http://www.feedster.com/advanced.php

Searching del.icio.us: http://tools.waglo.com/durl

Enter a url to retrieve information about people who delicious’ed it. del.icio.us already provides this service, Durl completes that with an RSS feed containing those results and trend history graphs.

The more i use del.icio.us, the more I like it. This doesn’t mean I’m not using Bloglines or Technorati, but I’m using them for ‘exhaustivity,’ not for ‘discovery.’

Commentary on durl

I know where the squashed philosophers came from: Oishii - popular

The real useful thing about durl is http://tools.waglo.com/durl/rss/, every url you type behind it will give you the appropriate rss. e.g. http://tools.waglo.com/durl/rss/http://www.informationlab.org/. Don’t forget the slash at the end.

Foxylicious is a free Mozilla Firefox extension developed by Dietrich Ayala that integrates your del.icio.us bookmarks into your Firefox browser’s bookmarks. + Commentary

With Foxylicious, you’re able to keep a local copy of all the online bookmarks you have in del.icio.us - all neatly grouped into the tags or categories you originally gave them.

http://chrismetcalf.net/wiki/index.php/DeliciousPlugin for wordpress 1.2 reads rss through magpierss. The latter makes it possible to read any rss tag, the former tuned it del.icio.us style Have a look at the top of our weblog for an example.

delicious clone in php - the idea might come in handy.

Ultimately i would like to link blog categories, wiki entries, del.icio.us and other tagging services together.

Richard Rogers is writing a new piece and collected some info related to using googlenews:

For scraper and visualizations devices that sit atop Google News, see
- Marcos Weskamp�s newsmap, 2004, http://www.marumushi.com/apps/newsmap/index.cfm;
- Michal Migurski�s In the News, 2004, http://news.stamen.com/ and
- Douwe Osinga�s Google News Map, 2004, http://douweosinga.com/projects/googlenewsmap. Osinga’s source code for the standalone version is available at http://douweosinga.com/projects/googlenewsmap/NewsMap.zip.

Weskamp has received a letter from Google, explaining that his project violates Google News’s terms of use; it remains online. For an effort to scrape Google News and provide an RSS feed, see Julian Bond�s Gnews2RSS, http://www.voidstar.com/gnews2rss.php. Google sent a cease and desist letter to Bonds, and according to his list posting of 30 March 2004 (http://groups.yahoo.com/group/syndication/message/4405) and an Internetnews.com item of 1 April 2004 (http://www.internetnews.com/ec-news/article.php/3334651), he decided to no longer offer Google News RSS feeds on the Web, and switched to Yahoo News, which traditionally has a more liberal policy in offering feeds (http://www.voidstar.com/node.php?id=1740). To syndicate a particular source from Google News, using the standalone version of Gnews2RSS, see also Steve Rubin’s hack at http://www.rssgov.com/archives/000129.html. Another Google News to RSS effort by Kumaraguru Gajarajan is written in python, http://www.muselog.net/googlenews/googlenews.py.

I guess the googlenews fuzz about scraping their service is because it is (and probably will always be) a beta version. In general scraping sites is ok if you don’t use it for commercial purposes. That’s why google can’t get it out of beta - otherwise they’ll have to pay big time to get the rights on all these articles.

And as Auke pointed out:
(more…)

us newspapers with rss feeds
Just what i needed!

udpate: cnn newsfeeds

�Want to understand how the search engine positioning results are determined? Then you need to know who-feeds-who.�

Search Engine Relationship Chart ™

Chuck Olsen’s Blogumentary, a documentary about blogs and bloggers, has its world premiere November 5 in Minneapolis.

GAP - Global Attention Profiles

I found these articles from the hp lab very interesting - could be used for our tool, the issuescraper:
* Implicit structure and dynamics of blogspace
* Tracking information epidemics in blogspace

I got to hp labs from this very nice article: Wetware: The Origins of Our Ideas
… In the last couple of years tools have been emerging that make it possible to trace the origin of ideas more than ever before. This is largely due to the increase in “personal publishing” with blogs and blogging tools. At the same time, the tools are almost entirely limited to the blogosphere, but its a start. …

it’s about time we come with a free software variant!!! We are working on it …

—

washingtonpost.com
‘Google With Judgment’

By David Ignatius

Tuesday, October 5, 2004; Page A25

Imagine for a moment that you could study the ebb and flow of public discussion about American politics as if it were a computer graphic. What would this database of “aggregated thought” tell you about the presidential campaign debates?

It happens that a former Republican campaign strategist named Charles M. McLean has created just such a database. His consulting company, Denver Research Group Inc., monitors more than 7,000 sources on a constant, real-time basis — giving him a window on what he estimates is about 80 percent of all original political content around the world. Using a combination of computer algorithms and human analysis, he sifts this mass of information to discern the “tonalities” that shape global events. This approach has identified key political trends one to two weeks before those changes appear in traditional poll numbers, he says.

(more…)

Google Sets Sights on Clustering, Translation
Google Inc. on Thursday gave a preview of its next steps to improve Web search, and clustering technology played a leading role.
…
With word clustering, the focus is on making the search engine better at understanding the multiple meanings of a word, Norvig said. Google started working on word clustering about three years ago.
…

other article:
As the major players in Web search duke it out, a growing number of startups are embracing a different way of retrieving and sorting search results.

Called clustering, the technology dynamically groups search results into categories as a way of solving one of the perennial problems of Web search: figuring out what the searcher is really looking for.

A new search engine named Clush this week plans to announce its arrival on the clustering scene. It follows the launch last week of a search site called Clusty from clustering-focused search company Vivisimo Inc.
…