DataOps Engineer-1

Posted 1 day 22 hours ago by Smart DCC

Permanent
Not Specified
Other
Lancashire, Manchester, United Kingdom, M21 0
Job Description

Salary Competitive

Manchester Based

(Hybrid working model, 2 days a week office based, 3 days remote)

Competitive Salary plus performance related bonus

The Role:

As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms.

Your role will include automating data workflows, improving data quality, and ensuring efficient delivery pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment.

What will you be doing?

  1. Design and implement efficient ETL processes for data extraction, transformation, and loading.
  2. Build real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools.
  3. Optimize batch processing workflows with tools like Apache Spark and Flink for scalable performance.
  4. Infrastructure Automation:
  5. Implement Infrastructure as Code (IaC) using tools like Terraform and Ansible.
  6. Leverage cloud-native services (AWS, Azure) to streamline data operations and reduce effort.
  7. Integrate cloud-based data services with data lakes and warehouses.
  8. Build and automate CI/CD pipelines with Jenkins, GitLab CI/CD, or Apache Airflow.
  9. Develop automated test suites for data pipelines, ensuring data quality and transformation integrity.
  10. Monitoring & Performance Optimization:
  11. Monitor data pipelines with tools like Prometheus and Datadog to ensure optimal performance and health.
  12. Proactively implement anomaly detection and optimize system performance and resource allocation.
  13. Collaborate with cross-functional teams to align DataOps practices with organizational goals.
  14. Apply agile methodologies, actively participating in sprint planning and retrospectives.
  15. Continuously optimize workflows and processes to increase efficiency.

What are we looking for?

  1. Advanced proficiency with databases (SQL Server, Oracle, MySQL, PostgreSQL).
  2. Expertise in building and managing data pipelines and data processing workflows.
  3. Strong understanding of data warehousing concepts, schema design, and data modelling.
  4. Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) for scalable data infrastructure.
  5. Proficiency in DevOps practices, including CI/CD pipelines, automation, and configuration management.
  6. Strong scripting skills in languages like Python, Bash, or PowerShell.
  7. Ability to collaborate with cross-functional teams (data engineers, data scientists, business stakeholders).
  8. Excellent communication skills, able to explain complex technical concepts to non-technical teams.
  9. Problem-solving mindset and a passion for optimizing and streamlining data processes.

It Would Be Great If You Also Had:

  1. A degree in a business, STEM, or related field (or equivalent experience).
  2. Experience working in regulated industries.

About the DCC:

At the DCC, we believe in making Britain more connected, so we can all lead smarter, greener lives. That desire to make a difference is what drives us every day and it wouldn't be possible without our people. Each person at the DCC brings a special kind of power to the business, and if you join us, we'll give you the means to unleash yours. Here, we depend on each other and hold each other accountable. You have the power to challenge and make change, to take the initiative and enjoy real responsibility. Whether it's doing purposeful work, helping us grow or building the career you want - we'll give you the support to do it all. Our secure network for smart meters is transforming Britain's energy system and helping the country's fight against climate change: we want you to be part of our journey.

Company benefits:

The DCC's continued success depends on our people. It's important to us that you enjoy coming to work, and feel healthy, happy and rewarded. In this role, you'll have access to a range of benefits which you can choose from to create a personalized plan unique to your lifestyle.

If there are any questions you'd like to ask before applying, please contact or complete your application, so we can learn more about you. Your application will be carefully considered, and you'll hear from us regarding its progress.

Join the DCC and discover the power of you.

What to do now

Choose 'Apply now' to fill out our short application, so that we can find out more about you.

As a Disability Confident member, DCC is committed to ensuring an inclusive and accessible recruitment process. If you require any reasonable adjustments, need a copy of this job advert in an alternative format, or have any other questions you'd like to ask before applying, please contact .