Skills and Responsibilities:

  • Configure and manage Kafka topics, partitions, and replication using Kraft, if applicable.
  • Manage access controls, security configurations, and authentication protocols for Kafka clusters across regions.
  • Collaborate with other teams to ensure the integration of Kafka with other data stores and messaging systems across regions.
  • Automate deployment and management of multi-region Kafka clusters using configuration management tools.
  • Document multi-region Kafka infrastructure configurations and procedures.
  • Install, configure, and maintain Confluent Kafka clusters and associated infrastructure across multiple regions.
  • Implement and manage multi-region Kafka clusters and ensure their availability and reliability.
  • Monitor the performance of multi-region Kafka clusters and associated infrastructure, troubleshoot any issues and take corrective action to resolve problems.
  • Develop and implement backup and disaster recovery plans for multi-region Kafka clusters.
  • Work with the development team to implement Kafka mirroring, replication, and failover between regions.