Senior Data Engineer

Senior Data Engineer

Start: ASAP
Duration: 6 months +
Location: hybrid, 2-3 days on site in Wokingham

Pay: market rate, inside IR35

Stott and May is looking for an experienced data engineer with a solid understanding of data science and expertise in LLM, RAG pipelines, and Vector stores.

Responsibilities:

1. Build data systems and RAG pipelines
2. Interpret trends and patterns
3. Conduct complex data analysis and report on results
4. Prepare data for prescriptive and predictive modelling
5. Analyse and pre-process large-scale datasets, identifying relevant variables and data cleansing requirements.

1. Experience in handling the complexities and specifics of vector data, in association with a vector database used in machine learning, AI and data analytics.
2. Experience with machine learning algorithms
3. Proficient in data visualization techniques to effectively communicate insights.
4. Familiarity with SQL, and experience working with relational databases.

1. Experience with cloud platforms (AWS, Azure or GCP)
2. Familiarity with big data techniques such as Apache Spark or Hadoop