This job is restricted to tax residents of , but we detected your IP as outside of the country. Please only apply if you are a tax resident.
Data Engineer / 11 months / London / Start ASAP
Job Purpose and primary objectives:
The GCP Data Engineer will be responsible for expanding, optimising and supporting our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
Key responsibilities (please specify if the position is an individual one or part of a team):
Create and maintain optimal data pipeline architecture,
Assemble and automate large, complex data sets that meet functional / non-functional business requirements.
Bringing existing commercial experience to help improve the engineering capability
Operationalise data models and ML models as required by the business
Work with stakeholders of varying technical fluency to assist with data-related technical issues and support their data infrastructure needs.
Ensure our data is secure and adherent to all JLP security NFRs
Work with data and analytics experts to strive for greater functionality in our data systems.
Key Skills/Knowledge:
Experience with building and supporting secure data-pipelines
Experience with developing and deploying CI/CD pipelines
High technical capability with Python
Some experience of working with the GCP stack, in particular Cloud Composer (Apache airflow), Cloud Storage and Data-Flow (Apache beam)
An understanding, and experience of, implementing security best practices within data pipelines
An ability to work closely with analysts to define technical requirements
Be highly independent and motivated individual
Comfortable adopting new technologies and applications (essential due to fast moving cloud stack).
Experience required:
At least 3+ years of working in a data-engineering or similar role