Senior Data Engineer
The company Adeva is hiring a Senior Data Engineer
Job description
Adeva is a global talent network that enables work without boundaries by connecting tech professionals with top companies worldwide.
We are seeking an experienced Senior Data Engineer with expertise in designing and managing large-scale data systems, to support a high-performance API platform that processes billions in payments for millions of users monthly. The ideal candidate will have a minimum of 5 years in Data Engineering, proven proficiency with AWS technologies, Python, and SQL optimization, and a track record of building scalable data pipelines to drive data-informed decision-making.
Responsibilities
- Design, build, and enhance robust data lakes and data pipelines on AWS to support various product and data science initiatives.
- Define and implement DataOps methodologies, ensuring best practices for data quality, version control, and efficient workflow automation.
- Develop, optimize, and maintain complex SQL queries to enable high-performance reporting and data retrieval.
- Oversee database performance, ensuring optimal functionality and availability; manage and troubleshoot issues to sustain seamless operation.
- Leverage infrastructure-as-code practices (e.g., CloudFormation, CDK, Serverless frameworks) to enhance scalability and automate deployments.
- Collaborate with cross-functional teams, empathizing with end-users to shape solutions that meet business objectives and performance standards.
Requirements
- 5+ years of experience in Data Engineering, with a strong foundation in building and managing data infrastructure.
- Advanced proficiency in Python, with expertise in designing and reviewing complex programs to meet style and security standards.
- Extensive AWS experience for data pipeline creation and ETL process management, with a focus on reliability and scalability.
- Skilled in AWS warehousing and analytics tools, including Redshift, Quicksight, and Athena, for data storage and analysis.
- Proficient in infrastructure-as-code (IaC) practices, utilizing tools like CloudFormation, CDK, and Serverless frameworks for efficient and consistent deployments.
- Strong SQL optimization skills for high-performance query development and execution.
- Hands-on experience with AWS RDS, including management and optimization of relational databases.
- User-focused mindset, with the ability to understand and incorporate end-user needs in decision-making processes.
- Exceptional analytical and problem-solving skills to develop robust and effective data solutions.
- Excellent communication skills, both written and verbal, to collaborate across teams and convey technical concepts clearly.
- Fluent in English, with strong proficiency in both written and spoken communication.
About Adeva
Adeva is an exclusive network of engineers, product and data professionals that connects consultants with leading enterprise organizations and startups. Our network is distributed all over the world, with engineers in more than 35 countries. Our company culture builds connections, careers, and employee growth. We are creating a workplace from the future that values flexibility, autonomy, and transparency. If that sounds like something you’d like to be part of, we’d love to hear from you.