ETL Modernization Developer

Job Description – ETL Modernization Developer
Location: Across USA any Location – Remote
 
Only Independent Visa Holders

Role Overview
We are seeking an experienced ETL Modernization Developer to join our Data Management team supporting customer’s Enterprise AI & Data initiatives. The role involves modernizing legacy ETL/ELT pipelines, migrating large-scale data workloads, and ensuring operational readiness in a cloud-native environment. The developer will work closely with
business, application, and technical teams to deliver high-quality, governed, and production-ready data solutions.

Key Responsibilities
Assessment & Planning
Analyze existing ETL/ELT jobs, databases, and data warehouses for migration readiness.
Document requirements and migration artifacts for approval.
Design & Development
Redesign and re-engineer legacy IBM DataStage jobs into modern frameworks (Databricks Spark on AWS preferred).
Develop, test, and deploy ETL pipelines using Python, Unix scripting, and cloud-native tools.
Implement CI/CD pipelines for automated build, test, and deployment.
Testing & Validation
Conduct parity checks, unit testing, functional testing, UAT, and performance testing.
Ensure schema validation, data quality, regression, and performance test coverage.
Execution & Cutover
Support migration cutover, go-live, and post-migration stabilization (hypercare).
Coordinate with application teams for redeployment and complete testing.
Decommissioning
Plan and execute decommissioning of legacy DataStage jobs and artifacts.
Knowledge Transfer & Training
Deliver operational readiness documentation and conduct KT sessions with Customer engineers.
Provide training support for application and business teams.
Required Skills & Experience

Technical Skills
Strong experience in IBM DataStage development.
Experience in Databricks, Delta Lake, Unity Catalog, Photon
Proficiency in PySpark, SQL, Shell Scripting and Python.
Hands-on experience with Databricks Spark (DBX) on AWS for job verification and pipeline development.
Familiarity with AWS services such as Glue, Lambda, Redshift.
Knowledge of CI/CD tools (GitLab, ADO, JIRA) and automated testing frameworks.
Automated ETL Testing tools, PyTest and XML/JSON parsing.

Domain Knowledge
Expertise in ETL/ELT migration and modernization.
Understanding of large-scale DB/DWH workloads and complex pipelines.
Experience in hypercare support and KT with application teams.

Soft Skills
Strong communication and collaboration skills to work with cross-functional teams.
Ability to document requirements, test plans, and operational readiness artifacts.
Problem-solving mindset with focus on quality and continuous improvement.

This is a remote position.