Data Engineer

On behalf of NHS CFA (Counter Fraud Authority), we are looking for a Data Engineer (Inside IR35) for a 6 Month contract based REMOTE with occasional travel to London, Newcastle or Coventry.

Purpose of Post:

The Data Engineer will oversee the development and management of data pipelines, models, and storage solutions for the Advanced Data Analytics Portfolio (DAP). Collaborating with project managers, data scientists, counter fraud experts and stakeholders, you will ensure data is accurately processed and readily prepared for analysis, supporting the design and implementation of analytical solutions and products. You will ensure that data infrastructure is secure, optimized, and scalable within a cloud environment, aligned with NHSCFA's strategic goals to drive innovation across the NHS and the public sector.

NPPV3 Clearance is an essential requirement for this role, (as a minimum you must be eligible and willing to undergo these checks).

As a Data Engineer your main responsibilities will be to:
* Develop and maintain secure, efficient, and reliable data pipelines using tools like SQL, Spark, Python, Alteryx, and Power BI.
* Build, test, and automate data architectures, ensuring robust ETL processes and data quality.
* Oversee data warehouse development, including design, documentation, and ETL solutions for multiple data sources.
* Implement workflows for data extraction, transformation, cleaning, and loading across systems.
* Optimize and automate processes, improving data delivery and scalability for large datasets.
* Maintain data security, retention policies, and compliance with information governance.
* Collaborate with data science and analytics teams to enhance system functionality and develop reusable reports.
* Support the deployment of Machine Learning models, BI tools, and other data products within the DAP.
* Apply machine learning techniques to optimize ETL processes and data engineering workflows.
* Continuously review and improve data engineering processes, ensuring they are fit for purpose and up-to-date with emerging technologies.

Knowledge and Experience:
* NPPV3 Clearance is an essential requirement for this role, (as a minimum you must be eligible and willing to undergo these checks).
* Excellent understanding of data engineering processes, data wrangling, and handling various data structures and formats (e.g., JSON, SQL, XML).
* Proficiency in the Azure tech stack, particularly Azure Data Factory, Azure Data Lakes, and Notebooks, along with Spark Framework for building data pipelines.
* Familiarity with SQL, Synapse Warehouse, and data analytics platforms like Fabric.
* Solid understanding of data transformation frameworks like Spark and best practices in data modelling.
* Skilled in programming languages such as SQL, Python, R, with experience in writing robust, automated data pipelines.
* Experience with machine learning for ETL and pipeline optimization.
* Knowledge of data lifecycle management, project management, and data warehousing methodologies.
* Proven ability to troubleshoot technical problems, deliver operational efficiencies, and drive cultural shifts through data.
* Experience with relational databases, Azure cloud services, and data science technologies (e.g., statistical analysis, machine learning, NLP).
* Familiarity with data protection legislation, particularly for counter fraud measures.

Specialist Knowledge and Skills:
* Advanced experience in developing automated, secure data pipelines and ETL processes.
* Skilled in data wrangling, feature engineering, and working with diverse data sources.
* Experience in data warehouse development, including design, ETL solutions, and optimizing large datasets.
* Knowledge of tools like Alteryx, batch processing, and indexing techniques.
* Strong data security practices and ability to manage big data architectures.
* Strategic thinker with excellent analytical and leadership skills, able to influence stakeholders and prioritize tasks under pressure.
* Proficient in root cause analysis, process optimization, and IT operations best practices.
* Strong documentation skills and a process-oriented approach.

Please be aware that this role can only be worked within the UK and not Overseas.

Disability Confident

As a member of the Disability Confident Scheme, NHS England guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all the essential criteria, we will interview the best candidates from within that group. This scheme encourages candidates with a disability and/or neurodivergence to apply.

Armed Forces Covenant

NHS England (NHS Digital) guarantees to interview veterans or spouses / partners of military personnel who meet all the essential criteria for the vacancy. In cases where we have a high volume of ex-military candidates / military spouses or partners, who meet all of the essential criteria, we will interview the best candidates from within that group.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".