[FoRK] Big Data

[Gregory Alan Bolcer]

On 2/4/2012 5:19 AM, Koen Holtman wrote:
> In big data about humans, there is no such technical argument about how
> big the data needs to be.  There is just the assumption that more data
> inevitably leads to more knowledge, more profitable ad placement, a more
> efficient economy, etc.

For human data, there's only so many ways you can process it.  Most of 
the times more data only means more cost.  The dark matter is the space 
in between, aka the correlations.  If anyone knows anything about highly 
correlated human data, it doesn't map well to divide and conquer 
approaches.  Techniques for mapping non-d-a-cq-bd are definitely ripe 
for some IP.

Greg

-- 
greg at bolcer.org, http://bolcer.org, c: +1.714.928.5476