Lead Data Engineer
Remote
Job Id:
138927
Job Category:
Job Location:
Remote
Security Clearance:
No Clearance
Business Unit:
Piper Companies
Division:
Piper Enterprise Solutions
Position Owner:
Mark McMullen
Piper Companies is seeking a Lead Data Engineer to join one of the nation’s leading transportation logistics firms. The Lead Data Engineer will focus on data engineering within the logistics and parcel space, emphasizing Databricks and Azure experience, with some legacy experience in SAP data services.
Responsibilities of the Lead Data Engineer include:
- Utilize Databricks for data processing and analytics.
- Implement and maintain a governance framework.
- Support the AI team by understanding and integrating AI components.
- Develop and manage ML Ops processes.
- Use Azure Data Factory (ADF) for data integration and orchestration.
- Collaborate with team members to architect and implement technical solutions.
- Ensure data quality and integrity across various systems.
- Provide technical leadership and mentorship to junior team members.
- Stay updated with the latest industry trends and technologies.
Qualifications for the Lead Data Engineer include:
- Extensive experience with Databricks.
- Strong understanding of governance frameworks.
- Experience supporting AI teams and understanding AI components.
- Knowledge of ML Ops processes.
- Proficiency with Azure Data Factory (ADF).
- Legacy experience with SAP data services is preferred.
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
- Bachelor’s degree in a technical field or equivalent experience.
Compensation for the Lead Data Engineer includes:
- Salary: $130,000 - $150,000
- Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays
This job opens for applications on 2/28/25. Applications for this job will be accepted for at least 30 days from the posting date.
Keywords: #LI-MM1 #LI-REMOTE
Lead Data Engineer, Data Engineering, Brokerage, Databricks, Governance Framework, AI Support, ML Ops, Azure Data Factory, SAP Data Services, Technical Leadership, Data Quality, Data Integrity, Technical Solutions, Hybrid Position