← back to case studies
Regulated banking · big data · 5PiBProduction

Cloudera Hadoop big data cluster

A 300-node Cloudera Hadoop cluster managing 5PiB of banking big data, secured with Kerberos, TLS, and Vault dynamic secrets, with 70% of routine operations automated.

Cloudera / HadoopKerberosVaultBare metal
architecturescroll to pan →
Ingestbanking dataCloudera Hadoop300 nodesKerberos · TLS · Vaultsecured5PiBbig data70% opsautomated

Problem

A regulated banking environment ran 5PiB of big data on a 300-node Cloudera Hadoop cluster that had to stay secure and highly available while routine operations consumed most of the team.

My role

Operated the 300-node Cloudera Hadoop cluster: secured it with Kerberos, TLS, and HashiCorp Vault dynamic secrets, tuned performance, and automated routine operations.

What shipped

  • +300-node Cloudera Hadoop cluster operated in production
  • +Kerberos, TLS, and Vault dynamic secrets across the cluster
  • +70% of routine operations automated
  • +25% improvement in critical task processing time through tuning

Outcome

  • 5PiB of banking big data managed on a secured cluster
  • 70% of routine operations automated