Open source tools help companies process data streams. To bring in complex queries and transactional capabilities, VoltDB’s John Hugg suggests adding an in-memory NewSQL data store
The benefits of big data are lost if fresh, fast-moving data from the fire hose is dumped into HDFS, an analytic RDBMS, or even flat files, because the ability to act or alert right now, as things are happening, is lost. The fire hose represents active data, immediate status, or data with ongoing purpose. The data warehouse, by contrast, is a way of looking though historical data to understand the past and predict the future.
See on www.infoworld.com