Title: - Sr. Big Data Engineer
Duration: 7 months
Location: - Plano, TX
Client: - Capital One
Rate: - $85/hr on W2 no benefits no vacation
Please tell the candidates they will have to complete a Glider Test.*
*
*
*
Madatory Skills :: Kafka, Spark, AWS, **
Required:
· 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python
· 2 years experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC etc..) At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps
· 3 years of experience with SQL and Shell Scripting experience
· 2 years of experience with software design and must have an understanding of cross systems usage and impact
· Must have expertise in Spark, Kafka, AWS, SQL
· Must score 70% or higher on Glider
Desired Experience:
· 2+ years of experience working with Dimensional Data Model and pipelines in relation with the same
· 2+ years experience with Amazon Web Services (AWS), Microsoft Azure or another public cloud service
· 2+ years of experience working with Streaming using Spark or Flink or Kafka or NoSQL Intermediate level experience/knowledge in at least one scripting language (Python, Perl, JavaScript)
· Hands on design experience with data pipelines, joining data between structured and unstructured data
Job Types: Full-time, Contract
Salary: $80.00 - $85.00 per hour