Browse more jobs

Data Engineer Job

Data Engineer

Physics Wallah

Bangalore, Noida

Start date

Starts Immediately

CTC (ANNUAL)

Competitive salary Competitive salary

Experience

0-5 years

0-5 years experience

Apply By

5 Sep' 24

Posted 1 week ago

Job

0 applicants

About the job

Key responsibilities:

1. Develop ETL (Extract, Transform, Load) processes to move and transform data between systems
2. Integrate data from various sources ensuring consistency and accuracy
3. Monitor system performance and identify areas for optimization
4. Align architecture with business requirements and provide solutions which fit best to solve the business problems
5. Build the infrastructure required for optimal ETL pipelines from a wide variety of data sources using SQL, AWS, and Big Data technologies
6. Evaluate and recommend new technologies to enhance data processing capabilities
7. Work closely with data scientists, analysts, and other stakeholders to understand their data needs
8. Use programming language (python, spark) and tools efficiently to collate the data
9. Identify ways to improve data reliability, efficiency, and quality
10. Use data to discover tasks that can be automated

Skill(s) required

Amazon Web Services (AWS) APIs BIG DATA ANALYTICS Data Analysis Data Analytics Kubernetes MongoDB NoSQL PostgreSQL Python SQL

Earn certifications in these skills

Learn Python

Learn Voice App Development

Learn SQL

Learn Data Analytics

Learn PostgreSQL

Other requirements

1. Ability to develop ETL (Extract, Transform, Load) processes to move and transform data between systems

2. Hands-on experience in coding languages such as Python or Scala

3. Good understanding of data engineering concepts including data warehousing, data lakes, data modeling, data quality assurance, data lifecycle management, streaming data, and metadata management

4. Strong hold on cloud-based ecosystems, preferably AWS

5. Familiarity with data pipeline orchestration tools such as Airflow or Azkaban (Airflow preferred)

6. Experience working with Spark, EMR, and Kubernetes clusters

7. Expertise in Spark jobs, shell scripts, and optimized data pipelines

8. Experience with relational SQL and NoSQL databases including PostgreSQL, Amazon Redshift, and MongoDB

9. Understanding of OOP-based data platforms and ability to develop data platform modules

10. Good understanding of backend APIs and their use cases

Salary

Annual CTC: Competitive salary

Number of openings

Editor’s note

Information above is Internshala's interpretation and paraphrasing of what we found on the shared link.

About Physics Wallah

Website

Physics Wallah is an Indian online education technology startup based in Delhi, created as a YouTube channel in 2014 by Mr. Alakh Pandey. We are the first company aiming to build an affordable online education platform for each Indian student who dreams of IIT and AIIMS but is unable to afford the existing offline/online education providers. We provide e-learning via our YouTube channel and Physics Wallah app/website by providing lectures for JEE mains and advanced level, NEET, and board exams. We are India's first most-viewed educational channel on YouTube.