Senior Data Engineer

The Role

The Finance Systems unit forms part of the Group Finance department, tasked with managing the Group's ERP and BI systems, developing, and promoting analytical capabilities and insights, and establishing an effective Master Data strategy.

The Senior Data Engineer, as a member of the unit's Development and Engineering team, builds and maintains optimized and highly available data pipelines and data models that facilitate data analysis and reporting. He/she demonstrates leadership in all aspects of their work, continuously striving to develop new and improved data engineering and modelling capabilities.

The Senior Data Engineer understands the ultimate business purpose of the wider Finance Systems unit and aligns their decision making and daily priorities accordingly.

You will be reporting to the Finance Systems Team Lead.

Office Location: Bangalore/Mumbai

Shift Timings: 11am - 8pm (Indian Standard Time)

What will I be delivering?

• Take ownership of, maintain, and further develop ETL pipelines and tabular data models.
• Ensure reliability and accuracy of data pipelines and data models and provide effective diagnostics tools for troubleshooting production issues.
• Gain a very deep understanding of YouGov datasets and source systems and their inter-dependencies.
• Provide technical systems enabling the unit to efficiently acquire new data sources and integrate those into the existing infrastructure.
• Support the wider technical teams as a subject matter expert for ETL, cloud and on-prem data pipelines, and tabular modelling.

What's in it for me?

• Be part of a successful, growing, global company which genuinely believes in the value of technology.
• Working with a highly skilled and motivated team.
• Access to dedicated MSDN and Azure resources for development and prototyping.
• Be one of the key players in the technological transformation of the Finance department.

What do I need to bring with me?

• Experience in solving complex problems with a high level of accuracy in a fast-paced environment.
• Have led at least medium-sized ETL and Data Modelling Projects end-to-end: from conception to prototypes, implementation, deployment, and maintenance.
• Have delivered comprehensive and audience-specific technical and conceptual documentation as part of your solutions.
• Regularly solve complex problems or problems where precedent may not exist.
• Ideally, you maintain your own technical blog, some open-source projects, or you are actively engaged in a technical community.
• Is comfortable working with virtual teams.
• Structured, analytical, and calm approach to troubleshooting.

Technical skills and qualifications

• In-depth knowledge and experience with the Power BI/Power Query ecosystem, including the DAX, TMSL, and M languages as well as a wide range of available tooling.
• First-hand practical experience with Azure Compute, Database, and Storage resources (ADF, Functions, Logic Apps, Batch, Azure SQL, Cosmos DB, Blob/Table/Queue storage, ADLS Gen2) and Azure Deployment technologies (ARM).
• Extensive experience with SQL Server and REST APIs.
• Ability to automate solutions via .Net (Core) and PowerShell scripting, both on Windows and Linux as well as in Docker containers.
• Have successfully implemented modern DevOps principles as part of ETL and/or Data Modelling solutions (Octopus Deploy, Azure DevOps).
• Consider structured and automated testing a necessary part of each technical solution and have demonstrable experience in implementing fit-for-purpose testing pipelines.

Behavioral competencies

• First and foremost, have a customer-first attitude.
• Be a self-starter with a very high degree of initiative and proactivity. Work independently with minimal guidance.
• Learn new technologies fast and enjoy sharing newly gained insights.
• Actively follow industry trends and bring fresh ideas from the outside into your daily work.
• Be a natural mentor to more junior team members and help them to grow and develop by passing on knowledge and skills.
• Communication skills, both verbal and written: Outline, explain, and defend your ideas and solutions. Convey complex ideas in a clear and understandable way, enabling cross-functional interactions with non-technical departments and stakeholders.
• Collaborate: Be effective at forming strong relationships and gaining the confidence of senior leadership.