1. Design, build, and maintain robust data pipelines to ingest, process, and transform data from various sources, including databases, APIs, and streaming platforms
2. Develop and optimize data storage solutions, including data warehouses, data lakes, and NoSQL databases, to ensure efficient data retrieval and access
3. Implement data quality checks and monitoring processes to ensure the integrity, accuracy, and reliability of the data
4. Collaborate with data scientists and analysts to deploy machine learning models and algorithms into production environments
5. Work with DevOps teams to automate deployment, scaling, and monitoring of data infrastructure and applications
6. Stay up-to-date with emerging technologies and best practices in data engineering and contribute to the continuous improvement of data engineering processes and tools
7. Provide technical guidance and support to junior team members and assist in troubleshooting and resolving data-related issues
8. Communicate effectively with stakeholders to gather requirements, provide updates on project status, and present insights derived from data analysis
Skill(s) required
Amazon Web Server (AWS)ApacheGitGitHubMicrosoft Azure
We are a technology-driven company that develops innovative solutions for our clients' problems, so they can stand out in the world and succeed. After working in the industry for over 10 years, our ambition has become to enable technological improvements in each and every sector. We work by the principle, 'let us focus on technology pieces and you can work on your business'. Together, we can change the world.