Chantilly VA 20151
3+ Months Contract
8-10+ years of experience in implementing ETL, Big Data, Data Warehousing solutions in large scale projects
Develop understanding of client business processes, objectives, and solution requirements. Participate in project work groups with subject matter experts and stakeholders to understand data specific needs.
Experience in data models utilizing tools like Erwin etc.
Strong working experience in designing data lake solutions utilizing Apache Nifi and other open source technology.
Experience in creating custom processes in Nifi using Java / Python. Experience in creating modular, re-usable processors within Nifi
Experience in writing Python scripts to perform data validation and transformation within Nifi
Experience in building data pipelines
Experience in consuming large amount of data from S3 from various data exchange formats like Parquet, XML, JSON, CSV etc.
Experience in Data Validation, Data Manipulation and formatting in Nifi
Experience in performance tuning Nifi processes and solutions
Strong data governance standards, including Data Quality, Data Deidentification, Master Data Management and Metadata Management
Experience in consuming web services / Rest API and for the data extraction.
Experience in creating Data solutions using AWS services like EC2, S3, IAM etc.
Experience in creating , configuring and securing S3 buckets within AWS
Experience in working in AWS GovCloud would be a plus
Experience in reporting tools like Zeppelin etc. would be a plus
Job Type: Contract
- Data Warehousing: 7 years (Required)
- Apache Nifi: 1 year (Required)
- big data: 3 years (Required)
- ETL: 5 years (Required)