Data Lake Contract Jobs

Data Engineer - Contract

4 days ago
Burns Sheehan - London, UK
Data Engineer
£450 - £500 per day
6 months
SQL - Azure
London
This is an exciting opportunity to join a cross-functional data team who have seen tremendous growth over the past 12 months. You'll be heavily involved in the re-platforming of their data architecture onto Azure and will utilise Microsoft's range of cloud technology.
The team is made up of close to twenty people consisting of Data Engineers, DBAs, and Data Scientists and they've created a culture which focuses on learning with regular demos and workshops being held by various teams.
You'll be responsible for working alongside engineers to develop greenfield Microservices on Azure whilst building ETL and real time data pipelines that meet the needs of a fast growing business.
It's important you've got experience working in a high transactional environment and have an extensive understanding of SQL Server.

Technology Stack:
MS SQL Server
NoSQL - CosmosDB
HDFS - Azure Data Lake
Azure Databricks
C#, .Net
Kafka, RabbitMQ, Event Hubs
PowerBI, Tableau
This is a great opportunity for an experienced Data Engineer to join an incredibly bright team at a crucial time.
If you think you have what it takes, please send your CV now for more information on both the role and company!

Ab Initio Developers x 2

5 days ago
Hays Specialist Recruitment Limited - Northamptonshire, UK

2 x contract jobs for Ab Initio Developers who have a good understanding of Hadoop.

Your new company
Is one of the worlds largest System Integration companies

Your new role
As a Senior developer you will be expected to possess excellent Knowledge of the Ab Initio stack and its implementation in Big Data Space (Data Lake). Technical Design and development of ETL/Hadoop and Analytics services /components. Contribute in end to end architecture and process flow. Understand Business requirement and publish reusable designs. Result oriented approach with ability to provide apt solutions. Proficient in performance improvement & fine-tuning ETL and Hadoop implementations. Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies. Can work independently with minimum supervision. Strong analytical and problem solving skills. Experience/Exposure to SQL, advanced SQL skills

What you'll need to succeed
Relevant years of Hands-on experience with Ab Initio and Hadoop technologies (HDFS, HIVE, Impala, Scala, Spark, PIG etc). Experience in Relational Databases like Oracle, SQL Server and PL/SQL. Understanding of Agile methodologies as well as SDLC life-cycles and processes. Expertise in ETL technology (Ab Initio, Hadoop).

What you'll get in return
A 9 month contract is being offered by the client and you can be based in London or Northampton.

What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now on .

Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at hays.co.uk

Last 90 Days

High rate for Data Lake in UK

Data Architect - SC Cleared New

13 days ago
ECS Recruitment Group - Fareham, UK
Data Architect - SC Cleared

The ECS Resource Group are working with a dynamic, innovative Managed Service Provider to recruit a Data Architect to work onsite with one of their end clients based in Fareham.

Their client is currently planning to move their SQL Data Warehouse (SSIS) to the new platform (looking to move to Azure Data Lake, Data Bricks and Azure Data Brick Note Books).

Skills Required;
  • Strong Azure platform expertise
  • Experience working with Azure Data Lakes/ Data Bricks
  • Architecture and Design up to High Level Design
  • Security Risk Assessment of the platform they have in Azure that uses SQL Warehouse and SSIS
  • SC Clearance is compulsory

Further details available upon application.

*By applying to this role, you are consenting to us temporarily assuming permission to process and store your details for recruitment purposes until we are able to gain full explicit consent.*

Key Words: Data Architect, Data Consultant, Azure, Data Lake, Data Brick, Azure Data Brick Note Book, HLD, High Level Design, SC, SC Cleared, SC Clearance
High rate for Data Lake in London, UK

Data Engineer - Spark/Hive/AWS (Java or Scala exposure)

21 days ago
Evermore Global - London, UK

Data Engineer - Spark/Hive/AWS (Java or Scala exposure):

- London
- Contract
- £600-£675 per day (negotiable)

Client and role:

I'm currently helping a global, award winning, digital media organisation to hire a Data Engineer. Our client are renowned for their content and their award winning digital products.

A new team has been set up which is looking to create the 'perfect’ Single Customer View in the Data Lake and use that data to drive marketing communication journeys for their customers via their campaign management tool.

You will help evolve the company's Data Lake. The Data Lake, comprising mainly AWS S3 buckets, is their long-term repository of data where disparate data sets can be joined for deeper analysis, e.g. page views, ads data, contributions data, subscription data, discussion data, identity data.

The Data Lake uses:

  • Scala.
  • AWS’ Elastic Map Reduce, on which we run Hadoop, Spark and Hive.
  • AWS Athena.
  • EC2.
  • Kinesis.
  • Cloudformation.
  • S3.
  • DynamoDB.
  • Play framework.

You will be the Data Engineer on the project and will involve the following types of responsibilities and technologies:

  • Good experience with a mixture of some of the skills mentioned above.
  • Willing to dive into a Scala or Java back-end or work with a variety of database and streaming
  • An interest in how data can drive decisions.
  • An appreciation of developing sustainable systems.
  • A willingness to provide self-service tools to the platform’s users.
  • A willingness to learn and experiment with Scala, AWS and data technologies.
  • Experience with CMS such as Braze (formerly AppBoy), would be great!
  • Any other CMS is desirable
  • Marketing domain experience or large scale ecommerce type background.

Java Developer - AWS Data Lake / Big Data

28 days ago
Cornwaliis Elt - London, UK

Java Developer – AWS Data Lake / Big Data

We are seeking an experienced full stack or server side contract Java Developer, on behalf of one of the world’s leading investment managers based in London / City.

The client is a growing global firm with a mid-sized European operation based in London, and they are part way through establishing a strategic development capability in the UK, to work in conjunction with existing teams in the US and in Asia/Pac.

In addition to Java (core Java or Spring), the other key technology requirements are AWS Data Lake / Big Data and experience with API’s. You will have strong experience with design patterns, be comfortable with Agile and will be committed to software engineering techniques such as TDD, OOD and continuous integration with an understanding of integration tools such as Jenkins or Maven.

Summary / requirements:
  • Java (deep experience, in either core Java or Spring – a recent version)
  • Full-stack or server side
  • AWS (Amazon Web Services) Data Lake / Big Data
  • Software engineering disciplines, continuous engineering / CI and tools e.g. Jenkins, Bamboo
  • Multi-threading
This is an exciting opportunity for a high performing developer to join a fast growing Investment Management institution that is undergoing high levels of change. The right candidate will rotate around a number of projects, building up their business knowledge and making use of their niche technical skills.
High rate for Data Lake in London, UK

GCP Data Engineer

1 month ago
Salt Recruitment - London, UK

GCP Data Engineer – Contract | London | 3 months with extensions

We are currently looking for GCP certified Data Engineer for a 3 months.

Provide upskilling and best practice advice on GCP Development to the data engineering team as they migrate the existing data lake feeds to GCP. This is to both help the migration effort and also build long-term capability in partners.

Work collaboratively with the engineering team to use industry knowledge to inform best practice in data-engineering (for example continuous integration etc.) and contribute to a set of pan-partnership data-engineering principles.

Unblock and anticipate technical problems as they arise to allow the team to move at a higher pace

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://www.welovesalt.com/privacy-policy/.

Job Reference: JO-1902-145479

Salary: £600 - £800 per day

Salary per: Day

Job Duration: 3 months

Job Start Date: ASAP

Job Type: Contract

Job Location: Greater London

Job Industry: Cloud Infrastructure & EUC

High rate for Data Lake in London, UK

GCP Data Engineer

1 month ago
Salt Search - London, UK

GCP Data Engineer - Contract | London | 3 months with extensions

We are currently looking for GCP certified Data Engineer for a 3 months.

Provide upskilling and best practice advice on GCP Development to the data engineering team as they migrate the existing data lake feeds to GCP. This is to both help the migration effort and also build long-term capability in partners.

Work collaboratively with the engineering team to use industry knowledge to inform best practice in data-engineering (for example continuous integration etc.) and contribute to a set of pan-partnership data-engineering principles.

Unblock and anticipate technical problems as they arise to allow the team to move at a higher pace

This job ad was posted by Salt. To find out more about Salt's Privacy Policy and how your application is processed, please visit our website https://privacy-policy/.

High rate for Data Lake in London, UK

Chief Architect (Global Tier1 Bank)

1 month ago
ShareForce - London, UK
The Chief Architect will be working within Commercial Banking for a Tier 1 Bank in the city. This part of the bank is the technology organisation that provides banking services to their corporate and business banking clients. Our client is engaged in several significant programs to transform the engagement with their customers globally. The goal for the Chief Architect is to lead the architecture of the technology needed to unlock the banks global sales potential:

Transform the sales and marketing toolsets across the global commercial banking organisation, delivering better customer insight and opportunity identification to the global salesforce as well as enabling smart automatic recommendations and useful propositions to customers and prospective customers.

Take the strategic direction of the business leads and work with the technology leads to create a compelling vision of the target state, and the incremental directional changes needed to reach that state whilst delivering tangible improvements for the bank’s customers and prospective customers

Key Responsibilities:
Lead the definition on the customer enablement & sales delivery strategy. Define and sell a vision, but with the ability to deliver incrementally and provide immediate value to the stakeholders.

Provide oversight of projects to ensure alignment to strategic architecture and correct consideration of cyber security and information handling restrictions has been factored into designs.

Provide end-to-end ownership of sales solutions delivered to meet requirements, delivering the architecture required to realise both functional and non-functional capabilities that aligns to the overall security architecture.

Create clear, concise proposals for solutions and brokering agreement across multiple stakeholders. Strong experience of working with stakeholders across multiple disciplines; business analysts, product owners, testing teams and wider technical stakeholders.

Manage a small multi-disciplinary team of architects spanning platforms, micro-service & orchestration build, and advanced data analytics and insight

Understanding the implications of local data restrictions upon global sales processes, and mechanisms for successfully mitigating that

Researching technologies and alternative solutions to problems, and present them to senior non-technical stakeholders

Understanding and explaining complex technical concepts to audiences with varied technical skillsets

Preparing and delivering presentations for c-suite engagement, reflecting strategy and opportunities in a business context

Required Skills and Experience:
Demonstrates excellent situational awareness and ability to appropriately react to a changing landscape

Performance driven nature and excellent problem-solving capability

Experience in an enterprise environment including an understanding of traditional processes and procedures and how they may impact a digital transformation.

Experience in leading the definition of Digital architecture and road-maps across a large business unit, particularly the elements related to customer engagement - marketing, sales, and the related analytics used by the sales force and omni-channel customer engagement

Experience with MS Dynamics CRM for Salesforce enablement (this is a key platform but is only one of the tools within scope of this role)

Strong knowledge Identity and Access Management, Knowledge of client-side applications and micro-services architecture.

Knowledge of analytics platforms and cloud transformations, particularly related to Google Cloud Platform, and the implementation of data lake and streaming analytics capabilities

Knowledge of machine learning and the implementation opportunities and challenges for building ML enabled analytics and recommended solutions

Experience in agile development and architecture practices

Additional Information:
Day Rate: £750-£900/day (dependent on experience)

Initial Contract Duration: 12 Months

Start Date: ASAP

Interviews: Late February

Location: Canary Wharf

Applicants must have the right to live and work in the United Kingdom and will be required to partake in pre-employment background checking
About our client....
Our client is an award-winning technology consultancy working with some of the largest financial services companies in the world. Established in 2009 as the result of a management buy-out, we count some of the world’s leading financial services companies among our customers. As a result of our success, we have embarked on an exciting period of growth, leveraging excellent customer sentiment and a people centric approach to our business to further develop our position as one of London’s leading independent technology consulting firms, competing for and winning exciting projects within the London market for payments, digitalisation and systems integration.

Azure DevOps Engineer

1 month ago
Lawrence Harvey - Reading, UK
Azure DevOps Engineer- Reading- ASAP Start

Azure Cloud- VSTS- Powershell- Data Analytics


I am excited to share with you a new asap starting role, looking to take on an Azure DevOps contractor for an initial 3 months on an exciting Data Analytics platform project, in Reading.

The role will be working in a Scrum Team to build the foundations of an DevOps Service with focus on implementing platform automation, Data Scientist and Developer self-serve, CI/CD, for analytics development on the Microsoft Azure Platform.

Essential Requirements:

  • Experience in DevOps on Azure and VSTS for Analytics Platform in Azure/VSTS.
  • Extensive experience of developing using the Azure analytics components including Data Lake Store, Power BI and Microsoft Visual Studio, Data Factory, HDInsight, Data Factory, SQL DB/DW and SSIS.
  • Fully conversant with Agile and DevOps development methodology and concepts Including CI/CD Coding, securitytesting best practice and standards.
  • Must have experience writing scripts (PowerShell) to build and deploy environments using Infrastructure-as-Code, along with VSTS experience.

To find out more about this very exciting opportunity and to register your interest, please get back to me with an updated CV and I will be in touch very soon.


Azure DevOps- Reading- ASAP Start

Azure Cloud- VSTS- Powershell- Data Analytics

Lawrence Harvey is acting as an Employment Business in regards to this position.

DATA ENGINEER

1 month ago
Spring - Nuneaton, UK

Are you looking for your next career move, a chance to become part of an established and sustained company, or just simply looking for a change, then this is a chance not to be missed!
Spring Technology is currently recruiting on behalf of one of our leading clients.

Role: Data Engineer x 2
Rate: £375 - £425 per day
Location: Warwickshire
Contract Length: 3 months (initially) with extension

Job Description:

As part of my clients business growth, there is an exciting opportunity for two Data Engineers to support a new data programme. This is a technical (hands on) role, not just a design position.

The Data Engineer will have a key role in helping to define and develop a new Data Lake to drive a new data driven business strategy. The Data Engineer will help propose and implement solutions primarily based around AWS, including:

  • designing and implementing ETL tasks.
  • identifying key data relationships.
  • cleansing data.
  • building a framework for BI developers to generate reporting solutions.
  • orchestrating the flow of data.
  • Some experience of Map Reduce and Machine Learning is desirable.

The role will involve working with colleagues, both IT and business, to help define the longer-term Data Lake strategy., with a focus on agile working and continuous delivery. The initial scope is to focus on retail data, followed by financial data. Currently AWS tools are being used, however open source solutions may be considered in the near future.

Key Skills:

  • Cloud environments.
  • ETL, data migration and cleansing.
  • Hands on Apache Spark using Python or Scala, creating data frames and applying transformations/actions.
  • Data Lakes, data analytics and working with large data sets.
  • Relational databases (particularly Oracle and PostgreSQL)
  • Working independently.
  • Agile working.
  • Customer first approach to development.

Experience:

  • Hands on experience with AWS.
  • Hands on experience with AWS Glue, Lambda and Step functions.
  • Hands on experience with SQL, Python and Scala
  • Familiarity with AWS data lake related components such as S3, Athena, Presto, QuickSight, EMR, Redshift, Kinesis etc.
  • Familiarity with structured RDBMS.
  • Familiarity with large data techniques (Hadoop, MapReduce, Spark etc.)
  • Familiarity with providing data via a micro service API.
  • Experience in analysing and cleansing data using a variety of tools and techniques.
  • Experience in working with a variety of data formats, JSON, XML, CSV, parquet etc.
  • Experience with building and maintaining data dictionaries / meta-data.
  • Experience of Linux and cloud environments.
  • Desirable, but not essential, to have retail experience.

If you are interested in the role then please apply directly to this advert or alternatively send a copy of you CV to [email protected] for consideration.
Spring acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. The Spring Group UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Spring. Our Candidate Privacy Information Statement explains how we will use your information - please copy and paste the following link in to your browser: www.spring.com/candidate-privacy-information-statement

To speak to a recruitment expert please contact Charlie Deeley

Data Engineer

1 month ago
Spring - Nuneaton, UK
:

As part of my clients business growth, there is an exciting opportunity for two Data Engineers to support a new data programme. This is a technical (hands on) role, not just a design position.

The Data Engineer will have a key role in helping to define and develop a new Data Lake to drive a new data driven business strategy. The Data Engineer will help propose and implement solutions primarily based around AWS, including:

  • designing and implementing ETL tasks.
  • identifying key data relationships.
  • cleansing data.
  • building a framework for BI developers to generate reporting solutions.
  • orchestrating the flow of data.
  • Some experience of Map Reduce and Machine Learning is desirable.

The role will involve working with colleagues, both IT and business, to help define the longer-term Data Lake strategy., with a focus on agile working and continuous delivery. The initial scope is to focus on retail data, followed by financial data. Currently AWS tools are being used, however open source solutions may be considered in the near future.

Key Skills:

  • Cloud environments.
  • ETL, data migration and cleansing.
  • Hands on Apache Spark using Python or Scala, creating data frames and applying transformations/actions.
  • Data Lakes, data analytics and working with large data sets.
  • Relational databases (particularly Oracle and PostgreSQL)
  • Working independently.
  • Agile working.
  • Customer first approach to development.

Experience:

  • Hands on experience with AWS.
  • Hands on experience with AWS Glue, Lambda and Step functions.
  • Hands on experience with SQL, Python and Scala
  • Familiarity with AWS data lake related components such as S3, Athena, Presto, QuickSight, EMR, Redshift, Kinesis etc.
  • Familiarity with structured RDBMS.
  • Familiarity with large data techniques (Hadoop, MapReduce, Spark etc.)
  • Familiarity with providing data via a micro service API.
  • Experience in analysing and cleansing data using a variety of tools and techniques.
  • Experience in working with a variety of data formats, JSON, XML, CSV, parquet etc.
  • Experience with building and maintaining data dictionaries / meta-data.
  • Experience of Linux and cloud environments.
  • Desirable, but not essential, to have retail experience.

If you are interested in the role then please apply directly to this advert or alternatively send a copy of you CV to [email protected] for consideration.

.

By applying for this role your details will be submitted to Spring. Our Candidate Privacy Information Statement explains how we will use your information - please copy and paste the following link in to your browser: www.spring.com/candidate-privacy-information-statement

Big Data Architect - digital transformation

1 month ago
Asset Resourcing Limited - Barnet, UK

(Contract) Big Data Architect: Our client is initiating a group-wide digital transformation programme and requires a Data Architect to help realise this vision. 6-10 years relevant experience is expected minimum with the following specific experience deemed ideal:

*Hands-on design, develop, implement and test of Big Data solutions from scratch in Cloud environments (AWS/Azure/GCP)
*Specific and significant experience with Azure data lake or AWS HBase / DynamoDb or Mongo / Redis / Couchbase / Hadoop / Hortonworks / Cloudera
*Targeted design for ODS, Analytics/Insight experience
*Proven ability to plan and migrate legacy SQL stored procedures and bespoke scripts and processes to Big data platform
*Organising and developing transformations on Unstructured data (myriad data sources, types, formats) across multiple formats and delivery through REST APIs
*Expertise in MapReduce, JSON, Sharding, Scaling, Entity models, Open APIs, API management
*A structured and analytical (but not theoretical) approach to problem-solving.
*Exposure to AWS Kafka or similar advantageous
*Personal traits: A "finisher"; quick learner, focussed but adaptable, thrives in fast-moving, challenging environments, good comms.

It is expected the right employment background will be from a partial blue-chip background and / or ideally technology-first companies like social media, telcos, challenger banks, etc.

High rate for Data Lake in UK

Contract Big Data Architect - digital transformation

1 month ago
Asset Resourcing Limited - Barnet, UK

(Contract) Big Data Architect: Our client is initiating a group-wide digital transformation programme and requires a Data Architect to help realise this vision. 6-10 years relevant experience is expected minimum with the following specific experience deemed ideal:

*Hands-on design, develop, implement and test of Big Data solutions from scratch in Cloud environments (AWS/Azure/GCP)
*Specific and significant experience with Azure data lake or AWS HBase / DynamoDb or Mongo / Redis / Couchbase / Hadoop / Hortonworks / Cloudera
*Targeted design for ODS, Analytics/Insight experience
*Proven ability to plan and migrate legacy SQL stored procedures and bespoke scripts and processes to Big data platform
*Organising and developing transformations on Unstructured data (myriad data sources, types, formats) across multiple formats and delivery through REST APIs
*Expertise in MapReduce, JSON, Sharding, Scaling, Entity models, Open APIs, API management
*A structured and analytical (but not theoretical) approach to problem-solving.
*Exposure to AWS Kafka or similar advantageous
*Personal traits: A "finisher"; quick learner, focussed but adaptable, thrives in fast-moving, challenging environments, good comms.

It is expected the right employment background will be from a partial blue-chip background and / or ideally technology-first companies like social media, telcos, challenger banks, etc.

High rate for Data Lake in London, UK

Security Architect

1 month ago
La Fosse Associates - London, UK

Multinational company currently require a Security Architect with Apllication Security, Cloud Secuirity & DevSecOps experience, to work with senior security leadership to build a DevSecOps function.

Responsibilities

  • Design an automated framework for Security Tool deployment and development.
  • Ensure Products, Projects and Programmes are secure by design.
  • Securing Serverless architecture.
  • Develop plans and implement systems and procedures to effectively secure company information, infrastructure, intellectual property, and users against accidental or unauthorised modification, destruction or disclosure.
  • Implement and design API Security, Container Security, AWS Cloud Security.
  • Architect & Design Big Data, Data lake for consolidation of logging and vulnerability management.
  • Work autonomously in an area of specialisation to analyse internal security and provide relevant information to internal and external customers, suppliers, and partners.

Essential experience

  • Strong Dev background
  • DevSecOps experience
  • CI/CD - Deployment pipeline experience (Jenkins, Ansible, Terraform)
  • Programming language (Python, Java etc., - Hands on experience)
  • Devops container/orchestration tools (Kubernetes, Docker, Puppet, etc)
  • AWS Deep knowledge (Native AWS Tools, Custom tools)
  • Knowledge of Azure (Azure Lambda)

Should you feel you are a good fit contact Joe 02079321657 or [email protected]

Solution Architect

1 month ago
Sanderson Recruitment Plc - South West, UK

Solution Architect / End to End Solution Designs / Data / MS Azure / Data Lakes

We are currently looking for a Solution Architect to work on a major Database / Data Warehouse overhaul of an existing system.

Wiltshire Based

3 Months +

£500 - £525 per day

We are looking for delivery focused Solution Architects to drive work within our scrum teams to build, test, maintain, change and further evolve existing and new products.

Skills Required:

  • Experience in designing solutions for BI and Analytics platforms
  • Experience of large data platforms (inc. Data Lake architectures - preferably within the Microsoft stack)
  • Experience in Best Practice Data Management platform design inc. Operational Data Store, Staging, Marts etc.
  • Experience in large/medium migrations and re-platforming activities (preferably between Oracle & Azure inc. Hybrid Architectures)
  • Awareness of Data Governance and Controls
  • Design and documentation of end-to-end Solution Architectures
  • Collaborating with and influencing key business and technical stakeholders
  • Very good knowledge of industry best practices for architecture, software development processes and lifecycles

Please call or send your CV for more information on this role.