Senior Data Engineer
Remote
Job Id:
141910
Job Category:
Job Location:
Remote
Security Clearance:
No Clearance
Business Unit:
Piper Companies
Division:
Piper Enterprise Solutions
Position Owner:
Johnny Tran
Piper Companies is seeking a Senior Data Engineer, to join a leading shipping and logistics organization. The Senior Data Engineer will be responsible for building robust & scalable code to transform and deliver data for reporting & analytics.
Responsibilities of the Senior Data Engineer include:
- Utilize advanced knowledge of Azure Databricks to design, develop, and deploy solutions for reporting and analytics.
- Construct real-time streaming pipelines using tools like Streamsets and Qlik.
- Manage data movement and orchestration through Azure Data Factory.
- Partner with internal customers and stakeholders to gather requirements, build robust models, and deploy solutions.
- Create and maintain data management frameworks to properly tag and manage curated data assets.
Qualifications for the Senior Data Engineer include:
- 10+ years of experience in data strategies, data analysis, database architecture and management, development, or administration.
- Strong skills in Azure Data Factory, Databricks, SQL, Python (PySpark), and/or Scala.
- Proven experience in building ETL processes and data warehouse transformation processes.
- Hands-on experience designing and delivering solutions using the Azure Data Analytics platform, including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, and Azure Stream Analytics.
- Experience with Apache Kafka and event-based data processing.
- Bachelor's degree in Computer Science
Compensation for the Senior Data Engineer include:
- Salary: $160,000 - $165,000
- Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays
This job opens for applications on May 14, 2025. Applications for this job will be accepted for at least 30 days from the posting date.
#LI-JT2 #LI-REMOTE
Keywords: Senior Data Engineer, Azure Databricks, Data Analytics, Real-Time Streaming, Azure Data Factory, ETL Processes, Data Warehousing, Python (PySpark), Scala, SQL, Apache Kafka, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics, Database Architecture, Data Management, Big Data, Cloud Services, Data Transformation, Data Pipeline.