Apache Kafka Administrator

Bengaluru, Karnataka, India - On-site

TESCRA India

Tescra Software Pvt. Ltd. No 11, 3rd Floor, Adam Chambers, Richmond Road, Bengaluru, Karnataka 560025 India

Full-time

Mid to Senior Level (Specific years of experience not specified, but implied by the need for strong, high-quality profiles)

Job Overview

TESCRA India is seeking highly skilled and experienced Apache Kafka Administrators to join our dynamic team. This is a priority mandate to address an immediate demand for expertise in Kafka administration and operations. The ideal candidates will possess strong, high-quality profiles with proven experience in managing Kafka environments across both on-premises and cloud platforms. This role is critical to ensuring the stability, performance, and scalability of our Kafka infrastructure.

Key Responsibilities

1. Deploy, configure, and manage Apache Kafka clusters across on-premises data centers and cloud environments (AWS, Azure, GCP).
2. Administer and maintain core Kafka components including Kafka Brokers, ZooKeeper/KRaft, Schema Registry, and Kafka Connect.
3. Automate infrastructure provisioning and configuration management for Kafka using tools like Ansible.
4. Build and manage scalable cloud infrastructure for Kafka deployments utilizing Terraform.
5. Develop and maintain comprehensive monitoring dashboards using tools such as Datadog, Grafana, and Prometheus.
6. Implement robust alerting mechanisms for critical Kafka metrics including cluster health, consumer lag, throughput, storage, latency, and broker performance.
7. Enforce and implement security best practices, including authentication and authorization for Kafka clusters.
8. Manage and execute Kafka cluster upgrades, patching, scaling operations, and disaster recovery processes.
9. Troubleshoot and resolve complex Kafka and underlying infrastructure issues to ensure high availability and performance.

Educational Qualifications

1. Bachelor's or Master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Must-Have Skills

1. Extensive hands-on experience in Apache Kafka administration and operations.
2. Proven experience managing Kafka in both on-premises and cloud environments.
3. Solid expertise in infrastructure automation using Ansible.
4. Proficiency in infrastructure as code using Terraform.
5. Experience with monitoring and logging tools such as Grafana, Prometheus, Datadog, ELK stack, etc.
6. Strong understanding of Linux operating systems, networking concepts, and distributed systems architecture.
7. Demonstrated ability to troubleshoot complex Kafka and infrastructure-related issues.

Good-to-Have Skills

1. Experience with containerization technologies (e.g., Docker, Kubernetes).
2. Familiarity with other messaging queue technologies.
3. Scripting skills (e.g., Python, Bash).
4. Experience with CI/CD pipelines for infrastructure management.

Pay Rate/Salary

Competitive salary commensurate with experience and qualifications. (Specific salary range not provided in the summary.)