Senior Data Engineer

Piper Companies is seeking a Senior Data Engineer to support a growing client in the healthcare industry in the DMV area. The Senior Data Engineer role will be fully remote. The Senior Data Engineer role is best suited for a seasoned data professional with strong experience building scalable data platforms, modern ingestion frameworks, and working within AWS and Databricks environments.

Responsibilities of the Senior Data Engineer include:

• Architect, build, and maintain scalable data pipelines leveraging AWS and Databricks to support healthcare data initiatives.

• Develop and optimize ingestion frameworks utilizing API integrations, CDC, and event-driven processing with PySpark and Spark Structured Streaming.

• Create and manage transformation workflows using SQL, Python, and dbt to ensure high-quality, reliable datasets.

• Collaborate closely with analytics, product, and business teams to deliver actionable data solutions and reporting capabilities.

• Monitor, troubleshoot, and enhance data platform performance, ensuring reliability and data quality across systems.

Requirements of the Senior Data Engineer include:

• 5+ years of experience in data engineering or backend engineering with a strong focus on data platforms and pipeline development.

• Prior healthcare industry experience and familiarity with healthcare data systems or regulatory environments.

• Expertise in AWS, Databricks, SQL, and Python, with hands-on experience in distributed data processing.

• Experience with modern ingestion patterns (API, CDC, event-driven pipelines) and orchestration tools such as Airflow or Databricks Workflows.

• Strong understanding of data architecture, performance tuning, and building production-grade data systems at scale.

Compensation for the Senior Data Engineer include:

• $160,000 - $180,000 annually

• Full Comprehensive Benefits: Health, Vision, Dental, PTO, Paid Holiday and Sick Leave if Required by Law.

• Hybrid work flexibility

• This job opens for applications on 07/08/2026. Applications for this job will be accepted for at least 30 days from the posting date.

Keywords: Senior Data Engineer, Data Engineer, AWS, Databricks, SQL, Python, Healthcare, DMV, dbt, PySpark, Data Pipelines, CDC, Airflow

#LI-BM4

#LI-REMOTE