Data Engineer (Senior) - London - £600-£650pd - 6 Months

Data Engineer (Senior) - London - £600-£650pd - 6 Months

A large retail business with a huge focus on their e-commerce platform (over a billion visits per annum) in London are looking to further strengthen their Analytics / BI team. You will typically deal with all types of Data wrangling challenges on a daily basis, loading data from a variety of both internal and external sources and create robust data pipelines. 3rd parties include AWS, Azure and other cloud providers.

You'll work closely with Data scientists and the head data architect to combine different data streams into common structures. This data is then used to create algorithms to Better understand customers buying habits. Whilst providing Big data Subject matter expertise you'll work within a larger "DevOps" function increases speed to production and sharing responsibility for operational systems.

Essential Skills:

• Apache Hadoop Ecosystem - Hive, Impala, HBase. Cloudera preferred.
• Apache Spark
• Coding Python, Scala, Java.
• Datawarehouse design & Dev (OLAP, Star schema, Kimball).
• Database Design and Dev in one or more of the following - Oracle, Microsoft SQL, Server, IBM DB2, MySQL, PostreSQL
• ETL Experience constructing data flows

Nice to have:

• Data Analytics (regression testing, clustering, decision trees, Forcasting, Statistics).
• Streaming data with Kafka or RabbitMQ
• Continuous integration and containers - Git Jenkins, Docker
• Data visualisation - PowerBI or Tableau
• Splunk or Kibana monitoring
• NoSQL development (MongoDB)
• Data security understanding with encryption and GDPR
• Agile development methodologies

Please send your CV