Contractor Python Engineer (Data Platform Team)
Posted 10 hours 14 minutes ago by Lendable Ltd
Permanent
Not Specified
Other
London, United Kingdom
Job Description
About the role As a Contract Data Platform Engineer, you'll help shape and scale our data infrastructure, making analytics faster, more reliable, and cost-efficient. You'll work with AWS, Snowflake, Python, and Terraform, building tooling, onboarding new data sources, and optimising pipelines.You'll collaborate closely with teams across the business, ensuring our platform is secure, scalable, and easy to use. Team mission We want to maximise business value by optimising the analytics pipeline, enhancing Lendable's competitive advantage through data utilisation. This means our Data Platform is designed to streamline the efficiency of analysis in extracting insights from data, while also ensuring cost control, compliance, and security. This is a non-exhaustive list of the activities you would engage with in the role: Develop new tooling for product teams to boost their efficiency Work with the wider team in maintaining, evolving and scaling data infrastructure solutions on AWS and Snowflake. Onboard new ingestion sources and maintain the smooth running and monitoring. Ensure platform robustness through automated testing and monitoring of data pipelines aligned to the expected scaling of Lendable. Collaborate with stakeholders to translate business requirements into scalable technical solutions. Optimise existing CI/CD pipelines for faster cycle times and increased reliability. Implement security best practices for data management and infrastructure on cloud platforms. Design and deploy infrastructure as code to manage cloud resources efficiently. Assist in the troubleshooting and resolution of production issues to minimise downtime and improve user satisfaction. Skills we are looking for Must have Proficiency in software development, particularly in Python or a similar language. Solid engineering practices, including automated testing, deployment systems, and configuration as code. Experience with cloud services such as AWS, GCP, or equivalent (preference for AWS - S3, IAM, SNS, SQS, Athena, Glue, Kinesis). Familiarity with infrastructure as code, preferably Terraform. Knowledge of columnar databases, such as Snowflake. Experience in developing and optimising CI/CD pipelines, with a preference for GitHub Actions. Excellent communication skills for effective collaboration with business analysts and stakeholders, ensuring technical solutions meet business needs. Experience with data ingestion tools, like Fivetran. Experience with Data Orchestrator tools (Airflow, Prefect, etc.) Nice to have Expertise in data transformation, particularly with DBT. Exposure to data visualisation tools. Experience with Data Observability tools (Montecarlo, Great Expectations, etc.) Experience with Data Catalog tools (Amundsen, OpenMetadata, etc.) Exposure to deploying applications with Kubernetes. The opportunity to scale up one of the world's most successful fintech companies Best-in-class compensation, including equity You can work from home every Monday and Friday if you wish - on the other days we all come together IRL to be together, build and exchange ideas Our in-house chefs prepare fresh, healthy lunches in the office every Tuesday-Thursday We care for our Lendies' well-being both physically and mentally, so we offer coverage when it comes to private health insurance We're an equal opportunity employer and are keen to make Lendable the most inclusive and open workspace in London