Dhiraj Hegde

Conf42: Cloud Native 2021

Containing an Elephant: How we took HBase and HDFS from private data centers into Kubernetes and Public Cloud

Operating a distributed system like HBase/Hadoop FS at peta byte scale took years to master in our private data centers. This talk describes our dramatic shift towards running a mission critical stateful application on Kubernetes in Public Cloud, why we did it and the challenges we had to overcome. Salesforce runs a very large footprint of HBase and HDFS clusters in our data centers with...