Databricks Data Engineer
Boost your chances before you apply.
Elevate Government Solutions
Washington, DC, US
Summary
Design, build, and maintain scalable batch and streaming data pipelines using PySpark and Databricks. Implement data quality frameworks, optimize Spark performance, and manage data lineage for federal client systems.
Job Description
This position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above.
Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology.
We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.
Responsibilities and Duties
- Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLT
- Implement Medallion architecture (bronze/silver/gold) for data curation and quality
- Build ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)
- Design data models (dimensional or domain-specific) supporting downstream analytics
- Build and consume APIs for data integration with downstream systems
- Optimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)
- Implement data quality checks and pipeline monitoring
- Document data flows and lineage for maintainability
Required Experience, Skills and Qualifications
- 5+ years data engineering experience, 2+ years on Databricks
- Strong PySpark and SQL for production-grade transformations
- Experience with both batch and streaming data processing
- Solid grounding in data modeling and data architecture principles
- Python proficiency and Git-based CI/CD workflow experience
- Familiarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspective
- Experience with DLT or Workflows orchestration a plus
Education Requirement
- 4 year Bachelor's Degree in Computer Science/Eng or related (highly preferred)
Benefits
- Health Insurance
- 401k match
- Unlimited Vacation
- 11 Federal Holidays
- Remote work
- Training
- Mentoring/Coaching
Elevate Government Solutions is a full-service technology solutions provider. Our experts have wide ranging experience supporting public sector agencies (Federal, State, and Local) and private sector entities in the creation, deployment and maintenance of critical solutions. We are based in Washington, DC and capable of serving clients across the country and around the globe in unclassified and classified domains. Our offerings include the full spectrum of technology and management consulting services including assessment, design, development, deployment, maintenance, and training.
Founded
2017
Company size
11-50 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Washington, District of Columbia
Elevate Government Solutions is a full-service technology solutions provider. Our experts have wide ranging experience supporting public sector agencies (Federal, State, and Local) and private sector entities in the creation, deployment and maintenance of critical solutions. We are based in Washington, DC and capable of serving clients across the country and around the globe in unclassified and classified domains. Our offerings include the full spectrum of technology and management consulting services including assessment, design, development, deployment, maintenance, and training.
Founded
2017
Company size
11-50 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Washington, District of Columbia
