Full-Time Senior Kafka Administrator

Position Summary: We are seeking a seasoned Senior Kafka Administrator to lead our distributed Kafka ecosystem. This role is responsible for configuring, managing, and troubleshooting Kafka clusters, ensuring high availability, data integrity, and security.

Key Responsibilities:

1. Kafka Cluster Configuration and Management: Design, install, configure, and manage Kafka clusters, brokers, ZooKeeper, Kafka Connect, and Kafka Streams. Optimize infrastructure for high availability, scalability, and low latency.
2. High Availability (HA) and Disaster Recovery (DR): Implement HA configurations to minimize downtime and implement DR strategies, including data replication and failover.
3. Backup and Restore Strategies: Establish and maintain Kafka backup procedures to ensure data integrity and availability. Test restore processes regularly.
4. Security and Encryption: Ensure secure Kafka environments, encrypting data at rest and in transit. Implement access control using SSL/TLS encryption and authentication (Kerberos or SASL). Monitor and address security vulnerabilities.
5. Monitoring and Optimization: Monitor Kafka cluster health and performance, tracking alerts and logs. Tune parameters for maximum throughput, latency, and reliability. Utilize monitoring tools (Prometheus, Grafana, etc.).
6. Maintenance and Troubleshooting: Perform routine maintenance (upgrades, patches), handle schema updates, and troubleshoot issues (performance degradation, replication lag).
7. Collaboration and Documentation: Collaborate with engineering, DevOps, and other teams. Document Kafka cluster configurations, procedures, and best practices.

Requirements:

• Bachelor's degree in Computer Science or related field.
• 3+ years of production Kafka administration experience.
• Solid understanding of Kafka architecture, brokers, ZooKeeper, Kafka Connect, and Kafka Streams.
• Experience with high availability and disaster recovery for Kafka.
• Proficiency in security best practices (SSL/TLS, SASL, Kerberos).
• Experience monitoring Kafka with tools like Prometheus and Grafana.
• Strong understanding of distributed systems and data flow.
• Strong problem-solving and troubleshooting skills.
• Excellent communication skills.

What is the last date for applying to the job?

Which countries are accepted for this remote job?