Data Engineer - Databricks & PySpark

The company Adeva is hiring a Data Engineer - Databricks & PySpark

Job description

Adeva is a global talent network that enables work without boundaries by connecting tech professionals with top companies worldwide. 

We are seeking an enthusiastic Data Engineer to join a dynamic team. The ideal candidate will have a background in data engineering with hands-on experience in Databricks, PySpark, and Power BI. You will work closely with cross-functional teams to design, develop, and maintain scalable data solutions that support business intelligence and analytics efforts.

Responsibilities

  • Design, build, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data accuracy, quality, and availability.
  • Develop and maintain data models and architecture to ensure optimal performance and data storage efficiency.
  • Integrate data from various sources, transforming it into structured formats suitable for reporting and analysis.
  • Create, maintain, and optimize Power BI dashboards and reports to provide actionable insights to stakeholders.
  • Implement and maintain data governance, security, and quality controls across the data pipeline.
  • Work with big data technologies and cloud platforms to process large datasets.
  • Troubleshoot and resolve issues related to data pipelines, data transformation, and BI reporting.

Requirements

  • 3-5 years of experience in a Data Engineering field.
  • Proficiency in Databricks and PySpark for building data pipelines and performing data transformations.
  • Experience with Power BI for creating interactive dashboards and reports.
  • Strong SQL skills and familiarity with data warehousing concepts.
  • Hands-on experience working with cloud platforms such as Azure, AWS, or GCP.
  • Solid understanding of ETL processes, data modeling, and data architecture.
  • Fluent English and excellent communication skills.
  • Ability to work as part of an international, distributed team and resolve potential issues and challenges that come with remote work.

About Adeva

Adeva is an exclusive network of engineers, product and data professionals that connects consultants with leading enterprise organizations and startups. Our network is distributed all over the world, with engineers in more than 35 countries. Our company culture builds connections, careers, and employee growth. We are creating a workplace from the future that values flexibility, autonomy, and transparency. If that sounds like something you’d like to be part of, we’d love to hear from you.

💡ideas & bugs