Note: The job is a remote job and is open to candidates in USA. Avanciers Inc. is seeking a highly skilled Senior Data Engineer/Solution Architect in the Healthcare Domain to join their team for a long-term contract role. The primary responsibilities include defining scalable architectures, leading data analysis, and ensuring compliance with governance standards while collaborating with various engineering teams.
Responsibilities
- Define and implement scalable, cost-optimized end-to-end Lakehouse architectures using Azure Databricks, Delta Lake (Medallion pattern), ADF, and ADLS
- Guide engineering teams on Spark optimization and pipeline design patterns
- Lead complex data profiling and create rigorous Source-to-Target Mapping (STM) documents
- Define canonical models, business rules, and dimensional schemas across healthcare domains (Claims, Member, Provider)
- Enforce data governance, quality SLAs, and metadata tracking using Unity Catalog or Purview
- Ensure absolute architectural compliance with HIPAA, HITRUST, and RBAC standards
- Collaborate with Data, Platform, and AI/ML engineering teams to standardize CI/CD, DataOps, and MLOps practices
- Act as the strategic bridge between business stakeholders, SMEs, and technical teams
- Translate ambiguous intake requirements into technical blueprints and lead architecture reviews (ARB)
Skills
- Azure Databricks Mastery: Deep hands-on experience with PySpark, Delta Lake, and Azure Data Factory (ADF)
- Advanced SQL: Expert-level capability in writing and optimizing complex queries for data validation and profiling
- Data Modeling: Proven expertise in OLTP, OLAP, dimensional modeling, and semantic layer design
- DevOps/DataOps: Strong experience with Git and Azure DevOps CI/CD pipelines
- US Healthcare Expertise: Deep understanding of healthcare data structures, financial coding standards, and use cases (Payment Integrity, Risk Adjustment)
- Advanced Standards: Familiarity with FHIR, HL7, and AI/ML data architectures (feature stores)
Company Overview
Company H1B Sponsorship