Senior Data Engineer

The Infected Blood Compensation Authority seeks an ambitious Senior Data Engineer, to exploit current and emerging techniques in data ingestion, transformation and presentation to ensure we make swift payments to victims of infected blood. IBCA is responsible for administering a compensation scheme that will see millions of pages of evidence across medical records, minutes of meetings, and other data, as well as flows of information to and from government departments, health agencies and other bodies. The data landscape is complex and delivering an efficient service will rely on making data work hard on our behalf.

The Postholder will report to the Head of Data Engineering and Data Architecture with responsibility to develop and maintain the complex and sensitive nature of data within the data platform and its availability across the authority.

Job description

This role allows an unparalleled opportunity to shape and define how data is managed and applied in ensuring accurate and timely payments are paid to those infected and affected. The role will be dynamic and fast paced, as we orchestrate a picture of infected and affected people, so IBCA is able to deliver a digital service that is underpinned by quality, trustworthy data practices.

You will play a leading role in developing and maintaining the authorities data platform to support service delivery and data science to tackle the challenges IBCA will face including operational efficiency, forecasting, fraud mitigation & detection, cohort analysis, and more.

We are looking for highly motivated individuals with a drive for social impact to join the data directorate and hit the ground running, quickly getting to grips with the challenges that arise from standing up a greenfield department at pace.

Responsibilities

• Building a Data Platform.
o Work alongside Data Architecture, Insight Analysts, Delivery and Operational teams you will develop data platforms that enable the Infected Blood Compensation Authority to deliver a trusted and robust service for its users.
o You will lead and mentor a small team of data engineers, to deliver engineering pipelines and transformation of semi structured, unstructured and structured data to the highest standard, enabling delivery and evolution of the service.
o Contribute to develop the overall direction and capability of the data engineering practice bringing skills and ideas and awareness of new technologies and practices.

• Ensure data integrity and understanding.
o Transform complex data sets of structured, semi structured and unstructured data sets, to support business processes and build trust to service users.
o Ensure information is sourced and available within desired time limits and that transformations are traceable for audit.
o Transform complex data into relational patterns including those for network analysis.
o Working with Data Governance and Data Architects to build a robust RBAC data access strategy ensuring that access is monitored against this, and data access risk can be assessed.

• Working at pace without losing sight of the bigger picture:
o Manage workloads using agile methods with continuous CI/CD delivery to meet demands as the service evolves.
o Maintain Strong stakeholder relationships ensuring solutions meet legal and operational requirements.

Due to the challenging nature of this role and the complexities of setting up a greenfield department at pace, you may be asked to get involved in other areas associated with the Data Directorate.

Person specification

Essential:

Experience of designing and developing Data Pipelines transforming a mix of structured, semi-structured and unstructured data, making available for insight either in a cloud or complex on-premise environment.

Proficiently in SQL and another scripting language or ETL tool for data manipulation.

Experience of one or more Cloud Technology data platforms such as AWS, Azure or GCP and experience of technologies such as Redshift, Snowflake, Synapse or similar technologies.

Understand Data Lake, Lakehouse or Data Warehousing techniques and Data Modelling.

Worked within agile delivery environments to deliver progressive builds.

A willingness to proactively learn and support the development of others.

Desirable:

Extensive experience in evaluation and strategising platforms of one or more Cloud environments.

Understanding of Data Modelling techniques and patterns.

Exposure to health and/or social care information.

Experience of graph technologies.

An understanding of Database Administration terminology.

An understanding of access control methods ensuring those that have permission have access and those that do not are prevented access.

Additional information:

A minimum 60% of your working time should be spent at your principal workplace. Although requirements to attend other locations for official business will also count towards this level of attendance.

Technical skills

We'll assess you against these technical skills during the selection process:
Tools and technology
Understanding of the role
Team work
Data complexity
Data Integrity

Benefits

Alongside your salary of £53,400, Cabinet Office contributes £15,469 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.
Learning and development tailored to your role.
An environment with flexible working options.
A culture encouraging inclusion and diversity.
A Civil Service Pension which provides an attractive pension, benefits for dependants and employer contributions of 28.97%.
A minimum of 25 days of paid annual leave, increasing by one day per year up to a maximum of 30.

Opportunities to move to the new Infected Blood Compensation Authority (IBCA).

At the moment all IBCA roles are hosted by Cabinet Office within the Civil Service. However, once IBCA becomes operational, it is anticipated that these roles may transfer to IBCA, which is a new public body separate from the Cabinet Office and independent of the Civil Service. Roles that transfer to IBCA from Cabinet Office will maintain the same or substantially the same terms and conditions of employment that are overall no less favourable and it is anticipated that employees who move from Cabinet Office to IBCA will be able to continue to participate in the Civil Service Pension arrangements with no break in their pensionable service.

Job Types: Full-time, Permanent

Pay: £53,400.00-£59,700.00 per year

Benefits:
Company pension

Work Location: In person

Reference ID: 371445