Data Architect / Data Engineer

Reporting to

Team Leader/Manager

Role objective and overview

Work with Global Customer and Marketing Insights team to design and implement a big data architecture with the appropriate levels of scalability, flexibility, resilience, security, and automation to meet the business needs for analytics / insights.

Key result areas

1. Designing and implementing big data solutions / architectures and pipelines and selecting appropriate methods / tools / services to meet functional requirements and non-functional requirements (e.g., performance and cost-efficiency)
2. Ensuring data is managed in a controlled, sustainable, secure, and compliant way
3. Evaluating the quality of the data and identifying where in the end-to-end pipeline issues need to be addressed
4. Interpreting current business needs and anticipating future analytics / insights needs
5. Acting as data architecture / data engineering SME

Knowledge, qualifications, and experience

Essential:

1. Expertise in designing and implementing cloud-based solutions / architectures and ELT and ETL pipelines for storing, processing, and modelling structured, semi-structured and unstructured big data, ideally on Azure
2. Understanding of structured, semi-structured and unstructured data and how to model / combine data of similar and different structure
3. Understanding of relational databases and SQL, and document databases, blob storage and NoSQL;
4. Understanding of master data principles
5. Expertise in automation, CI / CD, DevOps / MLOps / DataOps and similar methodologies

Desirables

1. Expertise in data mesh / service-oriented architecture
2. Power BI (or similar) architecture, implementation planning (e.g., workspaces, security, auditing), admin, automation, and deployment (e.g., deployment pipelines, monitoring, troubleshooting), data modelling and transformation, optimisation
3. Microsoft Purview (or similar) architecture, implementation planning, admin, automation, and deployment
4. Understanding of streaming data solutions / architecture