After early problems scaling its infrastructure nearly derailed the company before it got off the ground, Twitter wound up developing some world-class systems for keeping the service alive. It announced Thursday that it is moving a key part of that system off its own infrastructure and onto Google Cloud.
Twitter’s cold storage and flexible compute Hadoop clusters will now run on Google’s infrastructure, CTO Parag Agrawal said in a blog post Thursday. Hadoop is an open-source project for organizing “big data” that is nearly ubiquitous at web-scale companies like Twitter, and companies who were early to Hadoop tended to run the compute portion and the storage portion of the software on the same machine in their own data centers.
To read the entire article, please click on https://www.geekwire.com/2018/twitter-moves-part-massive-hadoop-data-platform-google-cloud/
