Data science moves away from big data towards containers and cloud

Share This Post

Traditional Hadoop-style big data is giving way to cloud and container solutions like Docker, according to the results of a new survey. The State of Data Science survey, carried out by Python data science platform Anaconda, among over 4,000 of its users, shows that Docker now makes up 19 percent of data science platforms, beating Hadoop/Spark with 15 percent and Kubernetes at 5.8 percent.

Big Data

This is partly due to the fact that what was ‘big data’ in 2005, when Hadoop began, now easily fits into a single server’s memory and there is now a wide range of alternatives to building a Hadoop data lake. Among other findings are that Google Cloud’s data services outrank those of Amazon Web Services and Microsoft Azure. Although Google Cloud is the third largest cloud provider, its focus on data services is paying off with the Anaconda community.

To read the entire article, please click on

More To Explore