Data Engineer
Job Title: Data EngineerLocation: BangaloreExperience: 5+ yearsEmployment Type: Full-timeJob Summary:We are looking for a Data Engineer with 5+ years of experience to design, develop, and optimize data pipelines and infrastructure. The ideal candidate will have strong expertise in Big Data technologies, ETL processes, and cloud platforms. You will work closely with data scientists, analysts, and business teams to build scalable and high-performance data solutions.
Key Responsibilities: Data Pipeline Development:
Design, implement, and maintain scalable ETL and ELT pipelines for efficient data ingestion, transformation, and loading.
Data Architecture & Modeling:
Develop data models and storage solutions that align with business requirements.
Optimize database performance and data retrieval processes.
Big Data Processing:
Work with distributed computing frameworks such as Apache Spark, Hadoop, or Kafka to process large datasets efficiently.
Cloud Data Engineering:
Deploy and manage data solutions on AWS, GCP, or Azure (e.g., Redshift, BigQuery, Snowflake).
Data Quality & Governance:
Implement data validation, quality checks, and monitoring to ensure data integrity and compliance with industry standards.
Collaboration & Optimization:
Work closely with cross-functional teams to understand data needs and provide optimized solutions.
Continuously improve and optimize existing data infrastructure for performance and cost-effectiveness.
Required Skills & Qualifications:???? Education:
Bachelors or Masters degree in Computer Science, Data Engineering, Information Technology, or a related field.
???? Technical Skills:
Programming Languages: Proficiency in Python, SQL, and Scala/Java.
Big Data Technologies: Experience with Spark, Hadoop, Hive, or Kafka.
Cloud Platforms: Hands-on experience with AWS (Glue, Redshift, S3, Lambda), GCP (BigQuery, Dataflow), or Azure (Data Factory, Synapse Analytics).
ETL & Data Warehousing: Strong knowledge of ETL processes, data warehousing concepts, and pipeline automation.
Databases: Expertise in PostgreSQL, MySQL, NoSQL (MongoDB, Cassandra), and Data Lakes.
DevOps & CI/CD: Familiarity with Docker, Kubernetes, Terraform, and CI/CD pipelines for data deployments.
Job Type
PayrollCategories
Data Engineer (Software and Web Development)
Cloud Architects (Software and Web Development)
DevOps Engineers (Software and Web Development)
Database Administrator (Software and Web Development)
Data Scientist (Software and Web Development)Must have Skills
ETL(Extract, Transform, Load) - 4 Years
Intermediate
SQL - 4 Years
Intermediate
Database development - 4 Years
Intermediate
Python - 3 Years
Intermediate
Java (All Versions) - 2 Years
Intermediate
Power BI - 3 Years
Intermediate
Tableau - 2 Years
Intermediate
AWS - 2 Years
Intermediate
Snowflake - 2 Years
Intermediate
