An Insurance broker are looking for a Junior Data engineer to join their team. This is an exciting opportunity for a hands-on Data Engineer to be responsible for developing and maintaining scalable data products and systems that support data processing, transformation, and storage.
Responsibilities:
- Development, testing and maintenance of company data solutions and associated ETL / ELT pipelines, ensuring all source control and continuous integration practices
- Collaborate with cross-functional teams to understand and estimate data requirements, implement new data-driven solutions and design data models that support data-driven decision-making
- Develop and maintain documentation on data pipelines, data models, and data dictionaries
- Implement data quality checks, data validation, and data cleansing procedures
Skills required:
- Strong experience of the Azure data services (Azure Synapse, Azure Data Factory, Azure Databricks, Azure SQL)
- Experience with database technologies such as SQL and NoSQL databases
- Proficiency in at least one programming language such as Python or Scala
- CI/CD, Azure DevOps Pipelines and Releases
- Experience with big data technologies such as Apache Spark
- Experience with cloud platforms, preferably Azure
- Expertise in data modelling, data warehousing and ELT/ETL processes
