Scaling has a lot of non-technical components - often people doing it wrong. That's true, sometimes I don't have time to do it right - creating a demand for an out of the box solution.
Currently I'm experimenting with http://vertica.com 's VerticaDB. It's easy to install, uses regular SQL and other RDBMS concepts, has some newer techniques for optimization out of the box (compression, joins, etc). I can't speak to scalability, but since it's designed for just these issues I'm looking for, I have high hopes.
I also looked into Hadoop/HBase - and there's promise there. Other DHTs are known to have issues with certain kinds of work.
Scaling has a lot of non-technical components - often people doing it wrong. That's true, sometimes I don't have time to do it right - creating a demand for an out of the box solution.
Currently I'm experimenting with http://vertica.com 's VerticaDB. It's easy to install, uses regular SQL and other RDBMS concepts, has some newer techniques for optimization out of the box (compression, joins, etc). I can't speak to scalability, but since it's designed for just these issues I'm looking for, I have high hopes.
I also looked into Hadoop/HBase - and there's promise there. Other DHTs are known to have issues with certain kinds of work.
Hadn't heard of Mnesia.