Top Ten Data Crunching Tips and Tricks
Subject:   Working on big data sets
Date:   2009-08-11 01:15:34
From:   Bozdag
It usually takes hours or maybe days if you want to crunch a huge volume of data. It is almost impossible to load everything on to memory. Then, what is the best practice to read and transform that data? Using a RDBMS or a special file format like HDF5 ?