About the role:
The Senior Data Engineer will work with a modern Azure tech stack, and proven experience in ingesting and transforming data from various internal and external systems is essential for the role. Joining a small and highly skilled team, the individual will need to be passionate about delivering best-in-class solutions for a global user base. Help design and implement new data pipelines that can adapt to business and/or technology changes. This role will be vital to the success of the programme and in establishing the organisation as data-centric.
Key Responsibilities:
The organisation seeks a highly capable, enthusiastic, and experienced individual to join the team. The primary focus will be on designing and implementing development activities to build a best-in-class Data Warehouse using cloud-native Azure technologies. The Data Engineer will handle design and development tasks across projects, ensuring the software produced is standardised, maintainable, and efficient.
Key responsibilities include:
- Providing technical expertise in designing and implementing solutions, including identifying root causes of complex data issues and developing practical, efficient, and permanent solutions.
- Conducting design, code, and test peer reviews throughout the project, offering technical guidance, and identifying potential issues.
- Advocating for efficient coding practices with extensive experience in delivering working solutions.
- Promoting and implementing agile and lean principles to ensure efficiency within the development process.
- Collaborating with Data Quality Analysts to implement appropriate testing, policies, and standards.
- Demonstrating proactive, independent behaviour while driving quality within the organisation.
Technical Skills:
- Experience in designing and developing data warehouse solutions.
- Building and configuring multistage Azure deployment pipelines.
- Advanced SQL, Python, PySpark.
- Azure Data Lake, Data Factory, Databricks, and Functions.
- Azure Data Lake Storage Gen2.
- Experience designing and building data ingestion and transformation pipelines, data lakes, data warehouses, or data marts.
Desired Experience:
- Power BI.
- Business Objects Reporting.
