Job Overview
We are seeking a highly skilled and experienced Sr Data Engineer for our client located in Bangalore. As a Sr Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure and systems. You will collaborate with cross-functional teams to ensure the availability, integrity, and accessibility of our data assets. This is a full-time position located in Bangalore, Karnataka, India, and is ideal for someone with 7 to 10 years of experience in the field.
Qualifications and Skills
Bachelor's degree in Computer Science, Engineering, or a related field.
7 to 10 years of experience in data engineering roles.
Strong proficiency in Shell Scripting, Python, and SQL.
Experience with Data Warehouse technologies such as DWL.
Knowledge of Big Data technologies and frameworks.
Familiarity with data lake concepts and implementation.
Proficiency in PySpark for data processing and analytics.
Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities.
Experience with cloud platforms (e.g., AWS, Azure) is a plus.
Roles and Responsibilities
Design, develop, and deploy scalable and efficient data pipelines and ETL processes.
Collaborate with cross-functional teams to gather requirements and ensure data solutions meet business needs.
Optimize and fine-tune data systems for performance, reliability, and scalability.
Implement and maintain data governance and security measures.
Troubleshoot and resolve data-related issues in a timely manner.
Perform data analysis to identify trends, patterns, and insights.
Stay up-to-date with industry trends and advancements in data engineering technologies.
Provide guidance and mentorship to junior data engineers.