Azure Databricks Engineer- 3+ Months- ASAP- Europe

Posted 4 hours 31 minutes ago by Global Enterprise Partners

Contract
Not Specified
Factory Jobs
Warsaw, Poland
Job Description

Global Enterprise Partners is currently looking for an experienced Azure Data Engineer to join an exciting contract project at a global Agri science client.

Strong experience with Azure, Azure databricks, Pyspark and Pandas are vital for this role.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.
  • Implement DataOps and MLOps best practices to optimize data system performance.
  • Enhance data pipelines for fault tolerance and performance improvement.

What we are looking for:

  • 5+ years experience as a data engineer
  • Proven experience in data engineering, building and maintaining data pipelines, and ETL processes
  • Proven experience building and maintaining data products within databricks
  • Hands-on experience with Databricks and its ecosystem.
  • Apache Spark: Proficient in Spark SQL, Spark Streaming, and Spark MLlib.
  • Programming: Skilled in Python, Scala, SQL, and Java.
  • Database Management: Knowledge of relational and NoSQL databases, data modelling, and query optimization.
  • Design, build, and maintain data pipelines using Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.
  • Implement DataOps and MLOps best practices to optimize data system performance.
  • Drive process improvement, buy traching, training and sharing knowledge
  • Mentor junior azure data engineers
  • Databricks Certifications: Beneficial but not required.
  • Cloud Certifications: Azure or similar are advantageous.

Contract details for the role

  • Start date: ASAP.
  • Duration: 3months + with extensions
  • Remote -Europer
  • Agreement: (40 hours per week.)
  • Rate: Please inform us of your hourly rate expectations
  • GST and freelance role

Interested? If you, or somebody else you know could be interested in the above position please apply directly with an updated CV to updated CV or contact me directly