Survey: Big data solutions need to be simpler, more interactive and more automated

Tools

New types--and growing volumes--of data are presenting significant information management problems, and to add to the difficulties, the highly coveted data scientists out there want direct access to big data sources. The good news is that there are companies finding value in big data applications once they've gotten past these hurdles--this according to a newly released survey by Pentaho Corp.

Nearly half of the IT pros and business analysts (45 percent, to be exact) surveyed by Pentaho said resource availability was a top challenge in deploying big data. Skills and the complexity of big data were cited as top challenges by 43 percent and 38 percent of the participants, respectively. The study concludes that big data solutions need to be simpler, more automated, more interactive, and they also need to include self-service functionality.

Nearly half of the survey participants said they use standard relational databases in addition to NoSQL or Hadoop. The combination of legacy databases and new big data sources has prompted a need for reconciling existing storage infrastructure with new data stores.

The most popular big data application, according to the study, is customer transaction analysis, and application log analysis came in second.

For more:
- see Pentaho survey results

Related Articles:
Study: Most big data projects are never completed
Retailers cash in on unstructured data
Getting maximum value from your big data initiative