Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics

Posted 3 days 19 hours ago by Flippa.com

Permanent
Not Specified
Other
Yorkshire, Wakefield, United Kingdom, WF1 1
Job Description

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics

C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior Data Engineer as we look to expand our team and support our growing roster of local and national clients.

If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process.

Who We're Looking For: Senior Data Engineer

C-4 Analytics is looking for an Experienced Senior Data Engineer with expertise in data infrastructure and architecture to help shape the future of our data-driven digital marketing platforms. As a member of our growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms.

We're not just processing data-we're transforming it into organizational intelligence. As our Data Engineering Virtuoso, you'll build enterprise-grade AI pipelines turning unstructured data into decision-making gold by creating intelligent data platforms at scale.

Your Canvas
  • Prototype the Impossible
    • Design, develop and maintain proof-of-concepts using cutting-edge technologies, then refine them into production-ready solutions.
  • Empower Through Innovation
    • Craft intuitive tools that elevate data scientists and analysts to their highest potential.
    • Collaborate with cross-functional teams to ensure that data storage and organization align with business needs and objectives.
  • Seamless Scaling & Performance Optimization
    • Implement database architecture best practices, including database sharding, replication strategies, indexing, and optimization techniques to enhance data performance.
  • Compose Data Symphonies
    • Orchestrate enterprise-grade AI pipelines for complex data flows that bring harmony to disparate sources through batch and streaming pipelines.
    • Evaluate and optimize data storage and retrieval systems based on relationships, data access patterns, cost-effectiveness, and performance requirements.
  • Blueprint Before Building
    • Design elegant solutions and document your vision so others can follow your path.
    • Provide leadership and guidance on information architecture decisions, ensuring that data is stored, organized, and accessed in the most efficient and effective manner.
Your Toolkit
  • The Languages You Speak: Python, SQL, the dialect of data.
  • Libraries Tools: Terraform, Flask, Pandas, FastAPI, Dagster, GraphQL, SQLAlchemy, GitLab, Athena.
  • Your Trusted Companions: Docker, Snowflake, MongoDB, Relational Databases (eg MySQL, PostgreSQL), Dagster, Airflow/Luigi, Spark, Kubernetes.
  • Your AWS Kingdom: Lambda, Redshift, EC2, ELB, IAM, RDS, Route53, S3-the building blocks of cloud mastery.
  • Your Philosophy: Continuous integration/deployments, (CI/CD) automation, rigorous code reviews, documentation as communication.
Preferred Qualifications
  • Familiar with data manipulation and experience with Python libraries like Flask, FastAPI, Pandas, PySpark, PyTorch, to name a few.
  • Proficiency in statistics and/or machine learning libraries like NumPy, matplotlib, seaborn, scikit-learn, etc.
  • Experience in building ETL/ELT processes and data pipelines with platforms like Airflow, Dagster, or Luigi.
What's important for us:
  • Academically Grounded: Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.
  • Seasoned Practitioner: 5+ years of experience in data engineering, with a focus on data infrastructure, architecture, and database management.
  • Code Craftsperson: Fluent in Python and SQL, expressing complex logic with elegant simplicity.
  • Database Strategist: Understanding when to deploy relational, vector, graph, or document data models. Strong understanding of database architecture principles, including sharding, replication, indexing, and optimization techniques.
  • Data Driven: Proficiency in designing and developing ETL/ELT pipelines for data integration and transformation.
  • Cloud Navigator: Confidently guiding projects through the AWS ecosystem and hands-on experience with Snowflake or similar cloud-based data warehouse platforms.
  • Dynamic Collaborator: Adept Problem-Solver with keen attention to detail. Excellent problem-solving skills, attention to detail, and the ability to work in a fast-paced, collaborative environment.
  • Infrastructure Poet: Expressing infrastructure needs as clear, reproducible code. Packaging or containerizing applications for consistency across environments.
  • Question Seeker: Finding the right questions that others haven't thought to ask.
Brownie Points
  • Visualization Artist: Creating compelling visual narratives from complex data patterns.
  • Statistical Thinker: Grounding engineering decisions in mathematical rigor.
  • Framework Explorer: Experience with web frameworks that extend data's utility.
  • Security Mindful: Navigating enterprise security with confidence and care.
Flexibility

The Senior Data Engineer may benefit from the flexibility to work in a way that suits them best. We offer the following working options:

  • Office-Based: Our modern and well-equipped office space provides a collaborative environment where you can work closely with your team, engage in face-to-face interactions, and foster a sense of community.
  • Remote: We support remote work arrangements, allowing you to work from the comfort of your own home or any location that enhances your productivity.
  • Hybrid: For those who prefer a balance between office and remote work, we offer a hybrid model.
Working at C-4 Analytics

We provide our employees with a range of benefits, including career development programs, unlimited paid time off, and additional perks.

More About C-4 Analytics: C-4 Analytics takes the guesswork out of advertising. We provide real value to our clients because we really value them as partners.