Data Engineer - SQL, Python, PySpark, Azure, Databricks, Lloyds, Insurance, Permanent - London

A fast-growing global Insurance broker situated in the City of London is searching for x2 Data Engineers to join their newly formed Data & Analytics team and play a pivotal role in their data transformation. At present, they're looking to transition from a program-based structure into a balanced operation through embracing agile methodologies to augment efficiency.

The Data Engineer will be tasked with creating a Lakehouse platform in Azure by managing and implementing data engineering pipelines within Azure Databricks to ingest both structured and unstructured data from the global business.

Skills Required

• Prior experience working with large datasets and a proficiency in SQL, Python and PySpark is required.
• An understanding of medallion architecture and experience working within the framework in a Lakehouse platform.
• Experience of pipeline deployment within Azure Databricks in line with the medallion architecture framework.

This is an excellent opportunity to join a well-respected fast-growing Insurance business as they look to double their size in the next three years.

Cornwallis Elt is an Employment Agency & Employment Business and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK`s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and the Recruiter Fast 50 & Hot 100 reports.
Posted Date: 09 May 2024 Reference: JSBHJOB6067_20532-1 Employment Agency: Cornwallis Elt Ltd Contact: Patrick Jordan