Lead Data Engineer
Apply Now
Full-time
Remote
13d ago
Location:
US
Company:
The hiring company provides data engineering services across various clients, emphasizing technology and project delivery in the data science field.
Summary:
The Lead Data Engineer will oversee data engineering projects, focusing on data extraction, processing, and integration. Candidates should have extensive experience in data engineering technologies and project delivery.
Requirements:
Technology: Hadoop, PySpark, Kafka, AWS
Hard Skills: Data Engineering, Data Analysis, Hadoop, Python, Kafka, ETL Design, Data Modeling, Data Processing
Credentials: bachelor’s, master's
Job Description:
Lead Data Engineer
Job Duties :
- 10+ Years experience working in Data Engineering and Data Analysis.
- Hands on Experience in Hadoop Stack of Technologies ( Hadoop ,PySpark, HBase, Hive , Pig , Sqoop, Scala ,Flume, HDFS , Map Reduce).
- Hands on experience with Python & Kafka .
- Good understanding of Database concepts , Data Design , Data Modeling and ETL.
- Hands on in analyzing, designing, and coding ETL programs which involves Data pre-processing , Data Extraction , Data Ingestion , Data Quality ,Data Normalization & Data Loading.
- Working experience in delivering projects in Agile Methodology and hands on in Jira.
- Experience in Client Facing Roles with good communication & thought leadership skills to co-ordinate deliverables across the SDLC .
- Good understanding of Machine Learning Models and Artificial Intelligence preferred.
- Good understanding of Data Components , Data Processing & Data Analytics on AWS is good to have .
- Experience with data modeling tools like Erwin is good to have.
- Master's/bachelor’s in computer science or equivalent fields
