Lead Data Engineer

About The Role

We have an exciting opportunity for a Lead Data Engineer to join our fast-growing team and support us in building the next generation of data infrastructure that will power our growth. As Lead Data Engineer, you will lead the development of data pipelines across NHS Professionals (NHSP) with your extensive experience architecting enterprise data solutions on Azure cloud platform and SSIS.

You can demonstrate deep expertise in designing and implementing ETL pipelines using Azure services (Synapse Analytics, Data Factory, Data bricks, and SQL Database) and SSIS package development. You should have a proven track record of leading teams, migrating legacy systems to cloud, implementing data governance, and optimizing costs.

You have high proficiency in SQL, Python, Spark, and SSIS scripting, along with 6+ years of hands-on data engineering experience. Key responsibilities include architecting Azure-based data solutions, optimizing ETL processes, leading platform modernization initiatives, establishing data governance standards, managing cloud infrastructure costs, and mentoring junior engineers. The role demands strong leadership skills to drive best practices in data modeling, CI/CD implementation, and stakeholder collaboration.

In this role, you'll regularly interact with senior leadership, requiring both deep technical knowledge and polished communication skills. Your ability to translate complex technical challenges into clear, accessible explanations will be crucial for effective decision-making and stakeholder alignment.

If you possess the above experience and want to make an impact, we would love to hear from you!

About The Candidate

• Bachelor's degree in computing science, Mathematics, Engineering, or similar subjects, with relevant certification in Azure services.
• Expert-level data development skills with the ability to establish enterprise-scale data integration procedures and standards across an organization.
• Superior capabilities in data modeling, including cross-industry standardization and metadata management.
• Advanced data analysis capabilities, including complex source system analysis and data synthesis.
• Proficient in programming, testing, and building data engineering solutions using standards and tools like SQL, Python, Azure Synapse Analytics, ADF, Data bricks, Data Lake Storage, Purview, Azure DevOps, Power BI, SSIS, SSRS.
• Demonstrated experience in data innovation, adopting new tools and techniques.
• Thorough understanding of technical concepts with the ability to explain their fit into the wider technical landscape.
• Experience in establishing and maintaining data standards, keeping abreast of best practices.
• Strong problem management skills focused on investigation, resolution, and prevention.
• Effective stakeholder management and communication skills across technical and non-technical audiences.
• Proven resource management and enterprise data services delivery capabilities.

About Us

In return for your commitment, we offer:

• Generous annual leave allowance - 27 days per year, plus bank holidays
• A commitment to talent management & development
• Star of the Month! - Recognize colleagues or teams that go the extra mile, with a chance to win £100 shopping vouchers
• Pension - Up to 10% contribution if you join our stakeholder pension scheme
• Life Assurance
• Group Income Protection
• Wellbeing Programme
• Employee Assistance Programme
• Employee Engagement & discounts platform

About Us:

NHS Professionals (NHSP) runs the largest NHS flexible staff bank, placing highly skilled temporary workers in NHS Trusts to meet their needs. Owned by the Department of Health and Social Care, any surplus is reinvested into the NHS. We are proud to be the first NHS organization to gain Top Employer accreditation, reflecting our commitment to being a great place to work.