Free Republic
Browse · Search
News/Activism
Topics · Post Article

To: kb2614

and Cheney's


9 posted on 10/15/2004 3:20:59 AM PDT by TeddyCon
[ Post Reply | Private Reply | To 6 | View Replies ]


To: TeddyCon

These guys probably are NOT deliberately fudging the data. Although I only have the math necessary to finish a degree in chemistry, and not the PhD in stat alot of these people have, I DO have some experience with this type of programming, having mucked around in the financial markets for years, and having worked as an environmental engineer.

Normalizaton of data (or "curve fitting") is also a real problem when you are trying to analyze data from the financial markets or environmental trends. You are looking for patterns of linear regression (is there market price behavior there that repeats itself with enough regularity that I should buy/sell, say, soybean futures at THIS point in the graph?). I call it the technological equivalent of reading chicken entrails to determine the future.
Anyway, the problem comes from the following.

1) The data is random
2) Within that random data are clear patterns

These seemingly contradictory statements have led some of the best minds and fastest computers and biggest players in the markets to crunch MOUNTAINS of data looking for a way to disprove item #1 above.

The lure is so strong that one is always tempted to look for a mathematical formula that will explain and predict the future. The problem is, that usually the formula only explains PAST patterns and is totally worthless to predict future behavior.

Though some folks who hawk environmental models have the same level of sleazy technoshysterism as the hacks bawling out their wares in Techical Analysis magazine, most of em are just blind to their own prejudiced conclusions. Therefore, they find patterns that TRULY ARE THERE, they are just curve fitted and not very useful.

Peer review is a great way to shut this stuff down as noted here.


13 posted on 10/15/2004 3:51:14 AM PDT by chronic_loser (Yeah? so what do I know?)
[ Post Reply | Private Reply | To 9 | View Replies ]

Free Republic
Browse · Search
News/Activism
Topics · Post Article


FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson