Senior Software Engineer - Data Team

Posted 22 days 1 hour ago by Intelmatix

Permanent
Not Specified
I.T. & Communications Jobs
London, United Kingdom
Job Description

About Intelmatix:

Intelmatix is a deep tech Artificial intelligence (AI) company founded in July 2021 by a group of MIT scientists with the vision of transforming enterprises to become cognitive. A cognitive enterprise is one that uses AI and Decision Intelligence in making their decisions. This leads to better business decisions with improved accuracy, reduced errors, and better outcomes across various aspects of the business.

Job Summary:

We are seeking a highly skilled and experienced Senior Software Engineer to join our dynamic Data team. The ideal candidate will have a strong background in software development with a focus on building and optimizing data pipelines, ensuring data quality, and integrating data from various sources. As a Senior Software Engineer, you will play a key role in designing, developing, and maintaining scalable data infrastructure that supports our business intelligence and analytics efforts.

Key Responsibilities:

  1. Data Pipeline Development: Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into our data warehouse.
  2. Data Quality and Governance: Implement and monitor data quality checks, ensuring accuracy, consistency, and reliability of data.
  3. Optimization: Optimize data processing workflows for performance, scalability, and cost-efficiency.
  4. Collaboration: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions that meet their needs.
  5. Innovation: Stay current with emerging technologies and industry trends in data engineering, and evaluate their potential application to our environment.
  6. Mentorship: Provide technical guidance and mentorship to junior engineers, promoting best practices in software development and data engineering.
  7. Documentation: Maintain comprehensive documentation for data pipelines, systems architecture, and processes.

Qualifications:

  1. Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  2. Experience: Minimum of 5 years of experience in software development, with at least 2 years focused on data engineering.
  3. Technical Skills:
    1. Proficiency in programming languages such as Python, Java, or Scala.
    2. Knowledge of data modeling and schema design.
    3. Strong system design skills of data-intensive applications.
    4. Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL).
    5. Experience with at least one cloud platform (e.g., AWS, Azure, Google Cloud) and its data services.
  4. Analytical Skills: Strong problem-solving skills with a keen eye for detail and a passion for data.
  5. Communication: Excellent written and verbal communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.
  6. Team Player: Ability to work effectively in a collaborative team environment, as well as independently.

Preferred Qualifications:

  1. Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
  2. Experience with AWS and its data services (e.g. S3, Athena, AWS Glue).
  3. Familiarity with data warehousing solutions (e.g., Redshift, BigQuery, Snowflake).
  4. Knowledge of containerization and orchestration tools (e.g., Docker, ECS, Kubernetes).
  5. Knowledge of data orchestration tools (e.g. Prefect, Apache Airflow).
  6. Familiarity with CI/CD pipelines and DevOps practices.
  7. Familiarity with Infrastructure-as-code tools (e.g. Terraform, AWS CDK).
  8. Experience with machine learning pipelines and MLOps.

Employee Benefits

At Intelmatix, our benefits package is designed to meet the diverse needs of our employees, reflecting our dedication to their well-being and professional growth. Depending on your office location and specific needs, our benefits may include:

  1. Comprehensive Medical Insurance for you and your dependents.
  2. In-Office Snacks Pantry.
  3. Relocation Support.
  4. Children's School Allowance.
  5. Role-Related Training Support.
  6. Wellness Programs.
  7. Salary Advance for Housing Costs.
  8. Travel Tickets.
  9. Pension Contributions.

We are committed to continuously enhancing our benefits package to adapt to the unique needs and circumstances of our valued team members, ensuring a supportive and enriching environment for everyone at Intelmatix.