Data Engineer
Columbia, MD
Job Id:
140393
Job Category:
Job Location:
Columbia, MD
Security Clearance:
No Clearance
Business Unit:
Piper Companies
Division:
Piper Enterprise Solutions
Position Owner:
Gianna Migliarese
Piper Companies is seeking an Data Engineer to join an established Healthcare organization located in Maryland. This position is HYBRID. The Data Engineer will design, develop, and maintain a data analytics platform solution, focusing on creating new use cases through Databricks programming within the healthcare data domain.
Requirements of the Data Engineer:
- Design, build, and maintain large, complex data processing pipelines that meet business requirements.
- Ensure the quality of deliverables by developing automated controls and performing unit, integration, and user acceptance testing.
- Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
- Troubleshoot and perform root cause analysis on data pipeline issues.
- Collaborate with source system owners and business owners to incorporate changes into data pipelines.
- Create comprehensive documentation of data workflows, processes, and infrastructure.
Qualification of the Data Engineer:
- 4+ years of experience in data integration.
- Advanced programming skills in PySpark, Python, Spark SQL.
- Thorough understanding of Data Lakes, raw/enriched/curated layer concepts, and ETL within the Azure framework.
- Proven experience in building complex data pipelines for lakehouse/data warehouses using Agile methodology.
- Experience in architecture, design, and implementation using Databricks and Azure Data Factory.
- Experience working with Databricks (preferred).
- 4+ year college degree (required).
Compensation for the Data Engineer:
- Hourly Rate: $45-$55 per hour
- Comprehensive benefit package: Medical, Dental, Vision, 401k, PTO. Sick leave as required by law.
This job opens for applications on 4/21/25. Applications for this job will be accepted for at least 30 days from the posting date.
Keywords: Data Engineer, Data Developer, Data Manager, Pyspark, Python, Apache Spark, Azure, Azure Data Lake 2, Azure Data Factory, Spark, Databricks, Python, Spark SQL, Data Lakes, Data warehouse, Data Pipelines, Agile Methodology, Data Processing Pipeline, Troubleshooting, Automation, Unit testing, Integration Testing
#LI-GM1 #LI-Hybrid