Data DevOps Engineer AWS Python Finance London
Posted 10 hours 48 minutes ago by Joseph Harry Ltd
Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London.
You MUST have the following:
- Experience as a Senior DevOps Engineer/SRE/Python Developer in an Agile environment
- Strong experience delivering solutions in the AWS (Amazon Web Services) cloud
- Advanced ability in CI/CD DevOps tools
- Good experience with open-source Kubernetes - lower-level engineering and tweaks
- Experience working with data engineering teams
- Python
- Experience with 2 or more of the following:
- Kafka
- Airflow
- Spark
- PySpark
- Dremio
- Ignite
- DBT
- Iceberg
- Arrow
- Glue
- Athena
- Agile
The following is DESIRABLE not essential:
- Java (J2EE or Core Java)
- Golang
Role: Senior Data DevOps Engineer (AWS Python Amazon Web Services Data DevOps SRE Site Reliability Engineer Developer Software Engineer Programmer Technical Lead Front Office ECS Lambda Kafka Airflow Spark PySpark Dremio Ignite DBT Iceberg Arrow Glue Athena Docker Terraform OpenShift Kubernetes KOPS Artifactory Trading Finance Java Asset Manager Investment Manager) required by our asset management client in London. You will join a team of 6/7 Data DevOps Engineers that are operating in a central team that support a number of data engineering teams. The data engineering teams are working with a very modern tech stack that includes AWS, Glue, Athena, Airflow, PySpark, Spark, Dremio, DBT, Iceberg and Apache Arrow. The ideal candidate will come from a similar environment and have experience setting up automated processes for the data engineers.
There is a very flexible working from home policy.
Salary: £120-145k % Bonus + 10% Pension