Job Description
If you are passionate about data, architecture, software development, and analytics with first-hand experience with on-premise and cloud data warehousing, data integration, and API development using modern methods, collaboration, and creativity we are interested in talking to you.
our financial client is seeking a Data Engineer / ETL Developer to join our agile team in developing our next generation data platform. Our data platform will include a modern customer data platfrom, cloud data lake and cloud data warehousing. The ideal candidate will have experience developing data lakes, data warehousing, data ingestion from traditional data sources and APIs, deduplicating customer data, and a commitment to data security.
Job Responsibilities
- Design, build and maintain Big Data workflows/pipelines to process billions of records in large-scale data environments with experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines.
- Leads code review sessions to validate adherence with development standards and benchmark application performance by capacity testing.
- Experience with software testing frameworks.
- Leverages DevOps techniques and Experience with DevOps tools - GitHub, Jira, Jenkins, Crucible for Continuous Integration, Continuous Deployment and build automation.
- Develop, implement and optimize streaming, data lake, and big data analytics solutions
- Support reusable framework and data governance processes by partnering with LOBs for any code/requirements remediation
- Engage in application design and data modeling discussions also participate in developing and enforcing data security policies
Skill/Experience/Education
Mandatory Skills• Knowledge of NoSQL, RDBMS, SQL, JSON, XML and ETL skills are must. • Understanding of data transformations, cleansing, and deduplications. • Advanced knowledge of SQL (PSQL or TSQL). • Experience developing pipelines for both Cloud and Hybrid Cloud infrastructures. • Experience in AWS utilizing services such as S3, AWS CLI, and RDS. • Experience using modern ETL tools like Talend and Nifi. • Experience working in an Agile delivery environment • Ability to work independently and drive solutions end to end leveraging various technologies to solve data problems and develop solutions. • Perform unit tests and conduct reviews with other team members to ensure code is designed with high code coverage • Passionate for continuous learning, experimenting, applying and contributing towards cutting edge open source technologies and software paradigms • Ability to research and assess open source technologies and components to recommend and integrate into the design and implementation • Proven track record of customer satisfaction and delivery success and ability to establish and maintain appropriate relationships with business and IT stakeholders • Ability to work in an advisory capacity to identify key technical business problems, develop and evaluate alternative solutions and make recommendations • Extensive experience in all aspects of the software development life cycle
Location-- 100% remote work from home
Duration-- 6 months contract to hire
Thanks
Ray Santos
Sunrise Systems Inc
105 Fieldcrest Drive Suite 504 Edison, NJ 08837
(732) 395-4426
You can also find me here!!!
https://www.linkedin.com/in/rsantos4424