This job is restricted to tax residents of , but we detected your IP as outside of the country. Please only apply if you are a tax resident.
Senior Data Engineer – Hadoop, AWS, Amazon Web Services, Big Data, Spark, Storm, Investment Manager, Asset Manager, Finance
A world-leading investment manager based in the City are looking to hire a small team of Data Engineers to build a brand-new AWS based data-lake. The team will work in conjunction with their digital department to provide a new big data analytics service for their retail investment platform.
The role is to establish Big Data platforms on an AWS infrastructure to provide analytics services. As such you will have experience across a number of Big Data technologies e.g. Hadoop, Kafka, Storm etc.
Key Requirements:
Strong knowledge and experience in AWS Stack (Kinesis, Lambda, EMR, S3, DynamoDB, RDS), Attunity
Experience in Data Model and Business intelligence
Good communication skills
Key Responsibilities:
Design, develop and deliver scalable and automated data products
Create frameworks for ingestion both real time and batch
Create frameworks and components for Data
Data Modeling for new Data Products
Create Data Catalogs for all entities on boarded and for all entities exposed for distribution
Create Re-con process for all Data Pipelines built
Leverage IAM roles & policies for service authentication
Documentation of functional logic of services
Testing (Functional & non-functional) of the pipeline
Deploy data products on cloud
Evaluate & build different frameworks for all building blocks
This is an exciting opportunity for a skilled Senior Data Engineer, particularly those who are looking to move into the financial markets industry, to join a fast-growing Investment Management institution.