Browse more jobs

Big Data Engineer Job

Applications are closed for this job. Click here to browse more jobs.

Big Data Engineer

Number Theory

Gurgaon

Start date

Starts Immediately

CTC (ANNUAL)

₹ 4,00,000 - 12,00,000 ₹ 4,00,000 - 12,00,000 /year

Experience

0-5 years

0-5 years experience

Apply By

20 Nov' 20

Posted 3 weeks ago

Job

308 applicants

About the job

Key responsibilities:

1. Develop new Hadoop base ELT/ETL models
2. Develop visualization solution on top of Hadoop results
3. Implement a data pipeline process to consume data in a secure fashion
4. Deploy Hadoop ELT/ETL in the production environment
5. Monitor Hadoop environment, ELT, and ETL
6. Handle customer projects on Cloudera Hadoop
7. Work on performance tuning of Hadoop ELTs & queries
8. Schedule advanced workflows for Hadoop
9. Work on performance tuning of large scale Hadoop architecture

Skill(s) required

Elasticsearch Hadoop Java NoSQL SQL

Earn certifications in these skills

Learn Java

Learn Voice App Development

Learn SQL

Other requirements

Experience in cleansing and transforming data on Cloudera Hadoop/Spark, SQL based databases, Impala, Pig, Hive, ELT/ETL, Real-time processing, and Hadoop Ecosystem

Experience in Oozie, Talend/Pentaho job scheduler, and Crontab scheduler

Should have set up Cloudera Hadoop architecture for at least 1-2 projects for large scale data processing

Experience on Cloudera analytics DB as a Cloudera Hadoop architect

Experience in setting layered Hadoop architecture – staging, aggregation, etc.

Experience in delivering end to end Hadoop project

Experience in SQL required

Experience in Java required

Collaborative team player

Salary

Annual CTC: ₹ 4,00,000 - 12,00,000 /year

Annual CTC breakup:

1. Fixed component: 80%

2. Variable component: 20%

Perks

Informal dress code 5 days a week Free snacks & beverages

Number of openings

About Number Theory

Website

Number Theory is a product based company. Its product suite is built on Apache Hadoop, Spark, and related ecosystem components. Number Theory's product suite comprises of NDP-NT enterprise to manage, store, and process NSP-NT enterprise streaming platform to store and process data in motion and NAI-NT artificial intelligence at scale platform to generate actionable insights using advanced AI algorithms and learn from historical and real-time decisions. The soul of Number Theory is the passion for solving real-world problems and to create knowledge.

Activity on Internshala

Hiring since October 2020

25 opportunities posted