Lead Data Engineer
£600- £700 per day
A chance to help be involved with both the architecture and build of an AWS infrastructure for a leading marketing company!
As a Lead Data Engineer you will be working for a leading marketing company who is well recognised for its data-driven roots and use of cutting-edge Big Data technologies. You will be situated in the core team of Data Engineers who work in Python. As a Lead Data Engineer you will be involved in helping maintain and build upon their AWS data platform. This is a chance to lead a team of highly skilled engineers in an agile and fast paced environment.
As a Lead Data Engineer you must be highly skilled in Python as this will be the main programming language that will drive the projects you will be working on. As a Lead Data Engineer you will help make sure the Python code is robust and have a strong idea of Software Engineering principles such as TDD. As a Lead Data Engineer having knowledge of streaming technologies such as Spark, Kafka and and Kinesis in AWS will also be very valuable in this role and there will be a focusing on streaming, especially with Spark. They are looking for a Lead Data Engineer who has worked extensively in an AWS environment therefore it is imperative you have had extensive exposure to this cloud platform and know its main components such as S3, Lambda, Athena and Glue. As a Lead Data Engineer it would be valuable to have previously led and guided teams as this will be an integral part of the role. You must also have architectural knowledge to help guide design.
In specific you can expect to be involved in the following:
- Using Python for coding/ designing
- Working in an AWS environment
- Using cutting edge big data technologies
- Leading a team and guiding them in best practices
The successful Lead Data Engineer will have the following skills and experience:
- Previously mentored teams
- Implemented best practices like TDD and pair programming
- Worked extensively with Python
- Used Redshift, Lambda functions and S3 in AWS
- Worked with Spark and Kafka for steaming purposes
- Can offer 2 days remote working
How to Apply:
Please register your interest by sending your CV to Anna Greenhill via the Apply link on this page.