Note: The job is a remote job and is open to candidates in USA. Egen is a fast-growing and entrepreneurial company with a data-first mindset, seeking a Lead Data Engineer to architect and build modern, cloud-native data platforms on Google Cloud. The role involves leading the design of data pipelines, driving data quality practices, and mentoring engineers while solving complex data challenges.
Responsibilities
- Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone
- Design and build unified batch and streaming pipelines that handle high-volume, mission-critical workloads
- Lead infrastructure-as-code practices, ensuring environments are repeatable, secure, and version-controlled
- Implement open table formats to enable cross-cloud and cross-engine data interoperability
- Establish automated data quality, metadata, and lineage practices across the data estate
- Partner with data scientists, analysts, and product teams to translate business needs into reliable data products
- Mentor engineers, review designs, and raise the bar on engineering standards
Skills
- 7+ years in data engineering, with at least 2 years in a lead or senior individual contributor capacity on Google Cloud-based platforms
- BigQuery (Advanced): Deep knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning
- Streaming & Batch Pipelines: Strong hands-on experience building unified pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub
- Infrastructure as Code: Production experience developing and managing cloud infrastructure with Terraform
- Open Table Formats: Working knowledge of Apache Iceberg, including its role in enabling cloud and engine interoperability (e.g., across BigQuery, Spark, Snowflake)
- Data Governance: Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination
- Experience leading or mentoring data engineering teams
- Familiarity with CI/CD for data pipelines (Cloud Build, GitHub Actions)
- Exposure to multi-cloud or hybrid data architectures
- Background in regulated industries (healthcare, financial services) where governance and lineage are critical
Benefits
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Company Overview
Egen is a technology services company with leading capabilities in cloud, data engineering, analytics, AI, and platform engineering. It was founded in 2000, and is headquartered in Naperville, Illinois, USA, with a workforce of 501-1000 employees. Its website is https://egen.ai.Company H1B Sponsorship
Egen has a track record of offering H1B sponsorships, with 5 in 2026, 59 in 2025, 50 in 2024, 60 in 2023, 111 in 2022, 49 in 2021, 79 in 2020. Please note that this does not guarantee sponsorship for this specific role.