Data Engineer

Chennai, India - On-site

ACHNET Demo

San Ramon, CA, USA

Full-time

Mid-Senior Level (5-10 years of experience)

Job Overview

ACHNET Demo is seeking a highly skilled and motivated Data Engineer with extensive experience in AWS and Python to join our dynamic team in Chennai. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure. This role requires a strong understanding of data warehousing, ETL processes, and cloud-based data solutions to support our growing data needs and drive data-informed decision-making across the organization.

Key Responsibilities

• Design, develop, and maintain robust and scalable data pipelines using Python and AWS services.
• Implement and optimize ETL/ELT processes for data ingestion, transformation, and loading into data warehouses and data lakes.
• Develop and manage data models and schemas to ensure data integrity and efficient querying.
• Utilize AWS services such as S3, Redshift, Glue, EMR, Lambda, and Athena for data storage, processing, and analytics.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective data solutions.
• Monitor data pipeline performance, troubleshoot issues, and implement solutions for improved efficiency and reliability.
• Ensure data quality, security, and compliance with relevant regulations.

Educational Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.

Must-Have Skills

• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in Python for data manipulation and pipeline development.
• Hands-on experience with various AWS data services (e.g., S3, Redshift, Glue, EMR, Lambda, Athena).
• Expertise in designing, building, and optimizing ETL/ELT processes.
• Solid understanding of data warehousing concepts and database technologies.
• Experience with SQL and relational databases.
• Familiarity with version control systems like Git.

Good-to-Have Skills

• Experience with big data technologies (e.g., Spark, Hadoop).
• Knowledge of data orchestration tools (e.g., Airflow).
• Experience with containerization technologies (e.g., Docker, Kubernetes).
• Familiarity with data visualization tools.
• Understanding of CI/CD principles for data pipelines.

Pay Rate/Salary

Competitive salary commensurate with experience and qualifications.

Number of Openings

Multiple