Senior Data Engineer

Overview: 3 contract data engineers to supplement existing team during implementation phase of new data platform.

Main Duties and Responsibilities:

• Write clean and testable code using PySpark and SparkSQL scripting languages, to enable our customer data products and business applications.
• Build and manage data pipelines and notebooks, deploying code in a structured, trackable and safe manner.
• Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain.
• Data Analyse, profile and plan work, aligned with project priorities.
• Perform reviews of code, refactoring where necessary.
• Deploy code in a structured, trackable and safe manner.
• Document your data developments and operational procedures.
• Ensure adherence to data/software delivery standards and effective delivery.
• Help monitor, troubleshoot and resolve production data issues when they occur.
• Contribute to the continuous improvement of the team.
• Contribute to the team's ability to make and deliver on their commitments.
• Innovate and experiment with technology to deliver real business benefits.
• Regularly launch products and services based on your work and be an integral part of making these a success.
• Guide, influence and challenge the technology team and stakeholders to understand the benefits, pros and cons of various technical options.
• Guide and mentor less experienced developers assigned on projects.
• Promote an innovative thinking process and encourage it in others.
• Working within the agile framework at Chambers.

Skills and Experience:

• Excellent understanding of Data Lakehouse architecture built on ADLS.
• Excellent understanding of data pipeline architectures using ADF and Databricks.
• Excellent coding skills in PySpark and SQL.
• Excellent technical governance experience such as version control and CI/CD.
• Strong understanding of designing, constructing, administering, and maintaining data warehouses and data lakes.
• Excellent oral and written communications skills.
• Highly driven, positive attitude, team player, self-motivated and very flexible.
• Strong analytical skills, attention to detail and excellent problem solving/troubleshooting.
• Knowledge of agile methodology.

Person Specification:

• A passionate data engineer with a history of driving his or her own technical and professional development.
• Worked in the media, publishing, research, or a similar consumer focused industry. (Highly Desirable)
• Able to clearly communicate with business and technology stakeholders.
• Attention to Detail, focused on the finer details that make the difference.
• Delivery Focus, pragmatic and driven to get solutions live.
• Able to Lead, providing thought leadership in the data domain.
• A Proactive attitude. A self-starter who seeks out opportunities for yourself and your team.
• Awareness of industry and consumer trends.
• Awareness of and the ability to manage business and technology expectations.
• Able to build strong personal relationships and trust.
• Able to sell ideas or visions. Influence and advise stakeholders at all levels.