Data Engineer

Published: Fri, 21 Feb :50:32 GMT

We are currently seeking a highly skilled and experienced Data Engineer to join our team at YLD.

Company: YLD

Location: London, Lisbon, Porto

About YLD:

At YLD, we are committed to empowering our clients to excel. We believe that great technology companies are built on a combination of exceptional design, engineering, and strategy. Our mission is to help our clients become great technology companies by equipping them with the mindset, tools, skills, and expertise they need to surpass their own expectations, revolutionize their industries, and create positive change for their customers.

Role Responsibilities:

As a Data Engineer, you will be a core member of our client's data platform team, responsible for building essential infrastructure software such as pipelines, APIs, data modeling, and event tracking. Your work will involve optimizing system performance and implementing enhancements as needed. You will also work on providing secure data access to both internal and external stakeholders.

Your role will also include selecting and implementing suitable technologies for scaling data access patterns, batch processing, and handling third-party data. Additionally, you will be responsible for supporting documentation and supplying data to researchers while considering the unique domain knowledge of the client's business. As a senior member of the team, you will also mentor and coach other engineers to support their technical growth.

Requirements:

1. Proven experience in writing highly maintainable and performant code in Python or PySpark
2. Good understanding of Cloud environments, particularly Microsoft Azure, and data orchestration systems such as Dagster or Apache Airflow
3. Familiarity with containerization platforms like Docker and container orchestration systems such as Kubernetes
4. Experience working with data lakes, particularly with Spark or Databricks
5. Understanding of common data transformation and storage formats, such as Apache Parquet
6. Familiarity with version control systems like Git and GitHub
7. Experience with VCL and BCL is a plus but not required
8. Strong problem-solving skills, able to balance innovation with practical technology choices to meet business needs
9. Comfortable working in a fast-paced production environment and effectively managing client expectations
10. Customer-focused with a strong commitment to quality
11. Experience collaborating with engineering leadership and architects to deliver high-quality solutions
12. Ability to take ownership and maintain transparency in deliverables
13. An exemplary representative of YLD's brand and protector of our reputation
14. Excellent communication skills, able to communicate complex ideas in a simple manner

In addition to the opportunity to work with a dynamic, ethical, and fun team, we also offer the following benefits:

1. Private health care coverage
2. Enhanced, fully paid maternity and paternity leave for up to 6 months
3. Company pension scheme
4. 25 days of annual holiday (excluding public holidays)
5. £2000 annual allowance for training and conferences
6. £300 annual allowance for additional hardware
7. Mental health support through the Spill app
8. Meditation and sleep support through Headspace or Calm app subscriptions
9. Bonus (based on company performance and results)
10. Company laptop
11. Generous referral schemes

Recruitment Process:

1. First interview with a member of our Talent team (30-45 minutes)
2. Technical interview with our developers (1 hour 30 minutes)

Our Values:

1. Constant growth
2. Inclusion for all
3. Honest and ethical relationships
4. Inspiring solutions
5. Team success

We are an equal opportunity employer and value diversity in all forms. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. We also believe in work-life balance and offer flexible working arrangements within our core hours.

About the Company:

We are a software engineering and design consultancy that fosters a culture of continuous learning to help our clients succeed. We are currently seeking a highly skilled and experienced Data Engineer to join our team at YLD.