The Senior Data Engineer will lead the design, development, and optimization of OCP’s cloud-based data architecture in Azure. This role is accountable for building scalable, automated data pipelines, integrating diverse clinical, financial, and operational data sources, and ensuring data quality and consistency across the enterprise. The Senior Data Engineer sets technical standards, drives innovation in automation, and positions OCP to scale as the organization grows through acquisitions and additional data sources.

 Key Responsibilities

Pipeline Architecture & Development

• Design and maintain scalable ETL/ELT pipelines using Azure Data Factory, Synapse, and Data Lake.
• Develop reusable ingestion and transformation frameworks to onboard new practices and acquisitions with minimal downtime.
• Engineer high-performance solutions for large, complex data sets, balancing batch and real-time ingestion.
• Optimize workflows to reduce latency, improve resiliency, and control cloud costs.

Cloud Platform Leadership

• Own the technical design and ongoing evolution of OCP’s Azure-based data environment.
• Define and enforce standards for architecture, storage, and orchestration to ensure enterprise-grade scalability.
• Partner with infrastructure and security leaders to align architecture with compliance, resiliency, and disaster recovery requirements.
• Anticipate growth and design data environments to accommodate new systems, acquisitions, and emerging technologies.

Data Integration & Modeling

• Integrate diverse data sources including EHR, practice management, financials, clinical, marketing, and HR systems.
• Develop and maintain dimensional and semantic models that support enterprise-wide reporting and analytics.
• Partner with business and clinical stakeholders to ensure models align with operational and strategic needs.
• Enable analysts and business teams by delivering clean, well-structured data sets that reduce manual manipulation.

Data Quality, Security & Governance

• Implement automated monitoring and validation to proactively identify and resolve data quality issues.
• Collaborate with governance leaders to define standardized metrics, rules, and master data across divisions.
• Maintain transparency through documentation of all data flows, transformations, and dependencies.
• Enforce HIPAA, privacy, and security controls across pipelines and environments.

Collaboration, Leadership & Innovation

• Mentor junior engineers and analysts, providing technical guidance and code reviews.
• Serve as subject matter expert for data engineering best practices, tool selection, and performance tuning.
• Collaborate with analytics, finance, operations, and clinical leaders to prioritize and deliver new capabilities.
• Continuously evaluate new Azure capabilities, open-source tools, and automation techniques to advance OCP’s data maturity.

Preferred Qualifications

• Experience working with healthcare data (EHR, claims, financial, clinical outcomes).
• Familiarity with Power BI data modeling and semantic layer integration.
• Exposure to advanced Azure capabilities (Databricks, machine learning pipelines, streaming architectures).
• Proven experience driving data governance and compliance practices in healthcare or regulated environments.

Physical Requirements:

• Ability to sit and work at a computer for extended periods.
• Occasional light lifting of office equipment (e.g., laptop, monitors) if needed.
• Occasional travel to market locations or corporate offices may be required.

Compliance:

• Adhere to all internal safety, security, and confidentiality standards.
• Maintain full compliance with HIPAA and other regulatory frameworks.