Free Republic
Browse · Search
News/Activism
Topics · Post Article

Skip to comments.

Carnegie Mellon algorithm identifies top 100 blogs for news
EurekAlert ^ | 19-Nov-2007 | Carnegie Mellon University

Posted on 11/19/2007 12:18:18 PM PST by crazyshrink

Versatile method also helps in designing sensor networks PITTSBURGH— Being among the first to pick up on Internet news and gossip and rapidly detecting contamination anywhere in a water supply system are similar problems, at least from a computer scientist’s point of view. Both can be solved with a versatile algorithm developed by Carnegie Mellon University researchers.

Using a problem-solving method called the Cascades algorithm, Carlos Guestrin, assistant professor of computer science and machine learning, and his students compiled a list of the best 100 blogs to read to find the biggest news on the Web as early as possible, http://www.blogcascades.org/. It includes well-known blogs, such as Instapundit and Boing Boing, but also some more obscure ones like Watcher of Weasels and Don Surber.

“The goal of our system when looking at blogs is to detect the big stories as early on and as close to the source as possible,” Guestrin said. He, Andreas Krause and Jure Leskovec, doctoral students in computer science and machine learning, respectively, analyzed 45,000 blogs (those that actively link to other blogs) to compile the list, checking the time stamps to determine where news items were being posted first.

But reading even 100 blogs, many of them with numerous postings, may be more than many Web surfers can handle. Recasting the problem, the researchers used their algorithm to compile a list of blogs if a person wanted to read only 5,000 postings. This list is quite different, with “summarizer” blogs, such as The Modulator and Anglican predominating.

Similarly, Guestrin and his students used the same algorithm to determine the optimal number and placement of sensors for detecting the introduction and spread of contaminants in a municipal water supply. Their report on the blog and water system case studies, “Cost-Effective Outbreak Detection in Networks,” was presented at the Association for Computing Machinery’s International Conference on Knowledge Discovery and Data Mining earlier this year.

“Nothing demonstrates the versatility of Carlos’ algorithm better than its ability to solve these two difficult and seemingly different problems,” said Randal E. Bryant, dean of Carnegie Mellon’s School of Computer Science. “It’s a credit to Carlos’ insight and inventiveness, but also a testament to the power of computational thinking. Computer scientists increasingly are developing common methods for solving problems that apply across any number of disciplines.”

Guestrin began work on the Cascades algorithm in 2004 to find a way to balance the cost of collecting information with the need for collecting the information early and close to its source. Initially, this addressed problems in designing wireless sensor networks — a technology that potentially can monitor such important conditions as water quality, building temperature, vital signs of nursing home residents, algal blooms in lakes and the structural integrity of bridges. In all of these cases, deploying the wrong number of sensors or putting them in the wrong places wastes money and produces poor information.

The algorithm allows for near-optimal placement of sensors by exploiting a property called submodularity. Simply put, submodularity means there is a diminishing return associated with adding sensors — adding a sensor to a five-sensor network has much more impact than adding a sensor to a 10,000-sensor network. The algorithm also takes into account the property of locality — the idea that sensors that are far apart provide almost independent information.

Work by Guestrin and his group is now focusing on detecting pollution in lakes and rivers and ensuring performance quality on citywide Wi-Fi networks. “This project represents a nice blend of theoretical understanding and a lot of engineering effort to make the whole thing work,” he said. “It’s a nice theory applied to larger, real-world data. It’s cross fertilization and interdisciplinary thinking in the true Carnegie Mellon tradition.”

Work on developing the Cascade algorithm has been supported by the National Science Foundation, Intel, Microsoft, the Sloan Foundation, PITA, IBM and Hewlett-Packard.


TOPICS: Culture/Society; Miscellaneous; Philosophy
KEYWORDS:
Navigation: use the links below to view more comments.
first 1-2021-22 next last

1 posted on 11/19/2007 12:18:19 PM PST by crazyshrink
[ Post Reply | Private Reply | View Replies]

To: crazyshrink

Who needs blogs when you have FR?


2 posted on 11/19/2007 12:20:58 PM PST by xjcsa (Defenseless enemies are fun.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: crazyshrink
So, they identified the top 100, and didn’t publish a list???

*spit* Academics...

3 posted on 11/19/2007 12:23:16 PM PST by null and void (No more Bushes/No more Clintons)
[ Post Reply | Private Reply | To 1 | View Replies]

To: crazyshrink

This is what FR does every day. :)


4 posted on 11/19/2007 12:24:56 PM PST by MarineBrat (My wife and I took an AIDS vaccination that the Church offers.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: crazyshrink

http://michellemalkin.com made #5 on the list


5 posted on 11/19/2007 12:25:15 PM PST by vikingd00d
[ Post Reply | Private Reply | To 1 | View Replies]

To: crazyshrink

Anything associated with Algore is not news........or sciences, for that matter................


6 posted on 11/19/2007 12:25:37 PM PST by Red Badger ( We don't have science, but we do have consensus.......)
[ Post Reply | Private Reply | To 1 | View Replies]

To: null and void

>> So, they identified the top 100, and didn’t publish a list???

The lists are here:
http://www.blogcascades.org/


7 posted on 11/19/2007 12:26:37 PM PST by vikingd00d
[ Post Reply | Private Reply | To 3 | View Replies]

To: null and void
Follow the link in the article. A strange list...

#5 michellemalkin.com
#18 pajamasmedia.com
#36 www.captainsquartersblog.com/mt
#83 gatesofvienna.blogspot.com

but #16 Anglican.tk is your gateway to the best sites on the Internet for Anglican Prayer Beads!

8 posted on 11/19/2007 12:28:57 PM PST by omega4412 (Multiculturalism kills. 9/11, Beslan, Madrid, London, Salt Lake City)
[ Post Reply | Private Reply | To 3 | View Replies]

To: vikingd00d

woohoo...go Michelle


9 posted on 11/19/2007 12:32:05 PM PST by Doogle (USAF.68-73..8th TFW Ubon Thailand..never store a threat you should have eliminated))
[ Post Reply | Private Reply | To 5 | View Replies]

To: vikingd00d

Thanks.


10 posted on 11/19/2007 12:32:11 PM PST by null and void (No more Bushes/No more Clintons)
[ Post Reply | Private Reply | To 7 | View Replies]

To: Red Badger

It seems what this really does is point out to politicians interested in controlling public thought via the internet, where to plant things, and what websites to shut down when the truth is in danger of being released.

It is based on a program used to detect contamination in a water supply system,....a shut it off at it’s source.

The ‘truth’ is the ‘contamination’.


11 posted on 11/19/2007 12:32:40 PM PST by UCANSEE2 (- Attention all planets of the solar Federation--Secret plan codeword: Banana)
[ Post Reply | Private Reply | To 6 | View Replies]

To: omega4412

Yeah. SETIathome and Mugglenet are hot sites for current events...


12 posted on 11/19/2007 12:33:07 PM PST by null and void (No more Bushes/No more Clintons)
[ Post Reply | Private Reply | To 8 | View Replies]

To: martin_fierro

Substandard school ping.


13 posted on 11/19/2007 12:33:51 PM PST by Tijeras_Slim
[ Post Reply | Private Reply | To 1 | View Replies]

To: UCANSEE2

“In Pravda there is no news and in Izvestia no truth.” ........


14 posted on 11/19/2007 12:35:40 PM PST by Red Badger ( We don't have science, but we do have consensus.......)
[ Post Reply | Private Reply | To 11 | View Replies]

To: Red Badger

“In Pravda there is no news and in Izvestia no truth.” ........

i’m afraid you have it backwards.


15 posted on 11/19/2007 12:38:06 PM PST by tired1 (responsibility without authority is slavery!)
[ Post Reply | Private Reply | To 14 | View Replies]

To: vikingd00d

Thank you. No point in citing the study if we don’t know what the findings were.

I guess I’m out of things. Beside Michelle’s blog and maybe two others, I’ve never even heard of most of the entries.


16 posted on 11/19/2007 12:39:13 PM PST by Joann37
[ Post Reply | Private Reply | To 7 | View Replies]

To: crazyshrink

That’s a weird list all right. It definitely skews right—Michelle Malkin, Instapundit, Captain’s Quarters, My Pet Jawa, Gates of Vienna, etc. The only left-wing blog I already knew of on that list was Crooks and Liars.

And I find it very interesting that, unless I missed it, Daily Kos is not on that list at all. Considering how influential that site is with the moonbat left, I wonder if that makes their algorithm even more suspect.

}:-)4


17 posted on 11/19/2007 12:45:03 PM PST by Moose4 (Wasting away again in Nifongville.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: tired1

Pravda means “truth”, Izvestia means “news”, so there is no “truth” in the News, and no “news” in the Truth......


18 posted on 11/19/2007 12:51:44 PM PST by Red Badger ( We don't have science, but we do have consensus.......)
[ Post Reply | Private Reply | To 15 | View Replies]

To: 3catsanadog; agrace; airborne; Ayn Rand wannabe; Benrand; bloodmeridian; buzzyboop; ...
It's a 'Burgh


Thing.™

Click for Pittsburgh, Pennsylvania Forecast
Send FReepmail if yunz want on/off BPT list, 'n'at
Learn Pittsburghese!
Free Streaming 'Burgh Radio
The List of Ping Lists

19 posted on 11/19/2007 1:05:34 PM PST by martin_fierro (Tartin')
[ Post Reply | Private Reply | To 1 | View Replies]

To: Moose4

It’s not a top 100 list as far as readership. It is the top 100 list, using the algorithm these kids developed in how to find the cost effectiveness of the most and most accurate info from blogs. At least that is what I read in their paper.


20 posted on 11/19/2007 1:15:10 PM PST by crazyshrink (Being uninformed is one thing, choosing ignorance is a whole different problem.)
[ Post Reply | Private Reply | To 17 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-22 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
News/Activism
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson