AWS, 2 years (Preferred)
Spark, 3 years (Required)
Python, 9 years (Required)
Carlsbad, CA (Preferred)
PySpark Developer
Location: Carlsbad, CA
Duration: 3+ months
NTT DATA's Client is currently seeking a PySpark Developer to join their team in Carlsbad, California. This role will work remotely during the Covid-19 pandemic until otherwise determined, but will eventually work on location.
Job Responsibilities Include:
Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate client's enterprise systems in our Enterprise Data Platform
Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities
Facilitate requirements gathering and process mapping workshops, review business/functional requirement documents, author technical design documents, testing plans and scripts
Assist with implementing standard operating procedures, facilitate review sessions with functional owners and end-user representatives, and leverage technical knowledge and expertise to drive improvements
Basic Qualifications:
Minimum of 9 years working experience in data integration and pipeline development using Python/PySpark
Minimum of 2 years of experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
Bachelors of Science degree in Computer Science, Computer Engineering or Electrical Engineering
Preferred Skills:
Strong real-life experience in python development especially in PySpark in AWS Cloud environment
Experience in Python and common python libraries
Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools
Databricks or Apache Spark Experience
Highly self-driven, execution-focused, with a willingness to do "what it takes” to deliver results as you will be expected to rapidly cover a considerable amount of demands on data integration
Understanding of development methodology and actual experience writing functional and technical design specifications
Excellent verbal and written communication skills, in person, by telephone, and with large teams
Strong prior technical, development background in either data Services or Engineering
Demonstrated experience resolving complex data integration problems
Must be able to work cross-functionally. Above all else, must be equal parts data-driven and results-driven.
The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.
Job Type: Contract
Pay: $1.00 per hour
Schedule:
Experience:
Location:
Work Remotely: