Note: The job is a remote job and is open to candidates in USA. Microsoft is a technology company that empowers every person and organization on the planet to achieve more. They are seeking a Senior Data Engineer to serve as the technical lead for Product Engineering Partnership, focusing on telemetry, experimentation data infrastructure, and analytics. The role involves collaboration with product engineering teams to ensure data-driven decision-making and continuous improvement of Global Skilling products.
Responsibilities
- Own telemetry contracts and instrumentation that ship with Global Skilling products (e.g., Microsoft Learn, ASN, Skilling Catalog)
- Design and operate experimentation data infrastructure, including A/B testing pipelines, metric definitions, and significance tooling
- Build catalog and content management data integrations across the Global Skilling product surface
- Lead semantic model design for product analytics in partnership with Reporting and Analytics teams
- Build and maintain external (end-customer) reporting pipelines for ASN and partner-facing products
- Operate Insights and Analytics feedback loops, including pipelines that surface usage patterns, customer feedback, and product signals to engineering teams
- Mentor Data Engineer II (DE II) engineers on telemetry design, experimentation practices, and product–engineering partnership approaches
- Partner with Microsoft-wide alignment forums to align WISE telemetry standards with broader Microsoft frameworks
- Provide on-call leadership for product-tier pipelines (severity levels 1–3)
- Embody our Culture and Values
Skills
- Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of experience in business analytics, data science, software development, data modeling, or data engineering
- OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years of experience in business analytics, data science, software development, data modeling, or data engineering
- OR equivalent experience
- Ability to meet Microsoft, customer, and/or government security screening requirements may be required for this role. These requirements include, but are not limited to, the following specialized security screenings: Microsoft Cloud Background Check — this position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter
- 5+ years of experience building production data systems on Azure (ADLS, Synapse, Fabric, or Databricks) or comparable cloud platforms
- Demonstrated experience instrumenting product telemetry and owning end-to-end data contracts with product engineering teams
- Experience with experimentation platforms, A/B testing data, or feature-flag analytics infrastructure
- Demonstrated distributed systems fundamentals; experience with PySpark, SQL, and pipeline orchestration
- Experience mentoring mid-level engineers
- Master's degree in Computer Science, Engineering, or related technical field
- Experience with Microsoft internal data platforms (Cosmos, Scope, Conform, Aria)
- Experience with catalog and content management data systems (e.g., Microsoft Learn, ASN, credential catalogs)
- Experience building external or end-customer reporting (e.g., ASN partner reporting)
- Experience designing semantic models for product analytics and decision support
- Experience with AI-driven telemetry discovery (e.g., agent-assisted instrumentation, anomaly detection, intelligent feedback loops)
Benefits
- Certain roles may be eligible for benefits and other compensation.
- Find additional benefits and pay information here:
Company Overview
Company H1B Sponsorship