Data Engineer

Piper Companies is seeking a Data Engineer to join an established healthcare organization. This position is hybrid with one day a week on site in Columbia, Maryland. It is a 6 month contract-to-hire opportunity.

Requirements of the Data Engineer:

• Design, build, and maintain large, complex data processing pipelines that meet business requirements.
• Ensure the quality of deliverables by developing automated controls and performing unit, integration, and user acceptance testing.
• Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
• Troubleshoot and perform root cause analysis on data pipeline issues.
• Collaborate with source system owners and business owners to incorporate changes into data pipelines.
• Create comprehensive documentation of data workflows, processes, and infrastructure.

Qualification of the Data Engineer:

• 4+ years of experience in data integration.
• Advanced programming skills in PySpark, Python, Spark SQL.
• Thorough understanding of Data Lakes, raw/enriched/curated layer concepts, and ETL within the Azure framework.
• Proven experience in building complex data pipelines for lakehouse/data warehouses using Agile methodology.
• Experience in architecture, design, and implementation using Databricks and Azure Data Factory.
• Experience working with Databricks (preferred).
• 4+ year college degree (required).

 Compensation for the Data Engineer:

• Rate: $45-$55 per hour during contract
• Comprehensive benefit package: Medical, Dental, Vision, 401k, PTO. Sick leave as required by law.

This job opens for applications on 4/18/25. Applications for this job will be accepted for at least 30 days from the posting date.

#LI-AO1 #LI-HYBRID