Azure Databricks Infrastructure Engineer
Boost your chances before you apply.
Cayuse Holdings
King Of Prussia, PA, US
Summary
The engineer will execute the migration of Azure Databricks environments between Azure tenants while minimizing risk and business disruption. Responsibilities include planning migration waves, rebuilding workspaces, and ensuring security and identity compliance throughout the transition.
Job Description
Overview
Job Title: Azure Databricks Infrastructure EngineerLocation: King of Prussia, PA
Job Type: Independent Contract (Contractor / Non-Employee)Start Date: ASAP
Pay Rate: $68-72/hr 1099 / C2C
We are seeking an experienced Azure Databricks Infrastructure Engineer to execute migrations of Azure Databricks environments between Azure tenants. The successful candidate will have deep expertise in Databricks, Azure cloud services, identity and access management, networking, data engineering, and platform modernization.
This role is responsible for executing a migration strategy that minimizes risk, downtime, and business disruption.
The ideal candidate will combine strong technical capabilities with consulting skills and be comfortable interacting with architects, platform teams, security organizations, and business stakeholders.
Responsibilities
Key Responsibilities
Migration Planning
- Analyze tenant-specific dependencies, networking requirements, DNS, Private Endpoints, and identity integrations.
- Define migration waves and cutover strategies.
- Databricks Migration Execution
- Migrate Databricks workspaces between Azure tenants.
Rebuild or migrate:
- Workspaces
- Compute policies
- Job schedules
- Repositories
- Workflows
- Secret scopes
- Access controls
- Migrate notebooks, libraries, packages, and configuration artifacts.
- Validate Unity Catalog and data governance configurations.
- Implement infrastructure-as-code and automation where applicable.
- Security and Identity
Migrate and validate:
- Microsoft Entra ID integrations
- Managed identities
- Service principals
- RBAC assignments
- Databricks groups and permissions
- Coordinate Key Vault migration and secret rotation activities.
- Ensure compliance with Principle of Least Privilege (PLP).
- Support security reviews and governance approvals.
- Data Migration
- Assess and migrate associated datasets and storage integrations.
- Validate Delta Lake tables, metadata, and schemas.
- Develop rollback and recovery procedures.
- Automation and DevOps
- Develop Infrastructure-as-Code solutions using:
- Terraform
- Bicep
- ARM Templates
- Automate migration and validation activities wherever possible.
Qualifications
Required Technical Skills
- Azure
- Azure Databricks
- Microsoft Entra ID
- Azure Virtual Networks
- Private Endpoints
- Azure Key Vault
- Azure Storage Accounts
- Azure Data Lake Storage Gen2
- Azure Monitor
- Log Analytics
- Azure Policy
- Azure RBAC
- Databricks
- Workspace administration
- Unity Catalog
- Delta Lake
- Databricks Repos
- MLflow
- Cluster management
- Cluster policies
- Secret scopes
- Databricks REST APIs
- Automation
- Terraform
- Azure DevOps
- GitHub Actions
- PowerShell
- Azure CLI
- Databricks CLI
Required Experience
- 10+ years of Azure cloud experience.
- 7+ years of Azure Databricks administration and engineering experience.
- Demonstrated experience migrating Azure resources across tenants.
- Experience with large-scale data platform migrations.
- Experience designing secure cloud landing zones.
- Experience implementing Infrastructure as Code.
- Experience working in regulated enterprise environments.
Preferred Qualifications
- Azure Solutions Architect Expert
- Databricks Administrator Certification
- Databricks Solution Architect Certification
- Experience with Unity Catalog migrations
- Experience with mergers, acquisitions, divestitures, or tenant-to-tenant transformations
Cayuse Holdings through its subsidiaries employs over 600 amazing people who are based all around the United States, with a few locations overseas. Cayuse is owned by the Umatilla Indian Reservation – with a US-based delivery center in Pendleton Oregon. Founded initially in 2006, through a joint venture with Accenture, this company has significantly expanded its operations and contracts to include delivery in many locations beyond Oregon.
Our company vision is to Grow the Company and Grow the People, enabling career development, economic growth and development for both our company and that of our tribal owners. We provide competitive benefits, including remote work for many of our positions, and excellent wellness and 401K matching programs.
Company size
501-1,000 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Pendleton, OR
Cayuse Holdings through its subsidiaries employs over 600 amazing people who are based all around the United States, with a few locations overseas. Cayuse is owned by the Umatilla Indian Reservation – with a US-based delivery center in Pendleton Oregon. Founded initially in 2006, through a joint venture with Accenture, this company has significantly expanded its operations and contracts to include delivery in many locations beyond Oregon.
Our company vision is to Grow the Company and Grow the People, enabling career development, economic growth and development for both our company and that of our tribal owners. We provide competitive benefits, including remote work for many of our positions, and excellent wellness and 401K matching programs.
Company size
501-1,000 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Pendleton, OR
