Note: The job is a remote job and is open to candidates in USA. Inclusively is partnering with an insurance technology company to hire a Data Engineer / Sr. Data Engineer (Big Query). The role involves building and enhancing data solutions and AI initiatives, working closely with data architects and engineers to optimize data architecture and accessibility of large-scale datasets.
Responsibilities
- Code BigQuery procedures, functions, and other database objects by applying expert knowledge in BigQuery SQL and ANSI SQL
- Implement scalable and efficient data models within our data lake, with a focus on BigQuery
- Manage and optimize data storage, partitioning, and clustering strategies to ensure high performance and reliability of our data infrastructure
- Develop and implement features and enhancements in BigQuery, leveraging your expertise in SQL and cloud-based data warehousing technologies
- Collaborate with cross-functional teams to understand requirements and deliver solutions aligned with business objectives, security requirements, and guidelines for data governance
- Develop documentation for the team to support design discussions
- Ensure data integrity and quality by implementing robust data validation and error-handling mechanisms
- Identify and implement improvements across the full lifecycle of data management, from ingestion to ETL processes and final reporting layers, to increase productivity on the team
- Continuously build knowledge of industry trends and advancements in data engineering and big data technologies
- Support delivery by sharing comprehensive feedback in code reviews and guidance about alignment with standards when solving complex problems
- Assess opportunities and risks of various solutions to provide insights and input needed for technical decisions as we continuously build for scalability and security while maintaining high velocity
- Share advanced knowledge prior experience building data infrastructure and managing unstructured data
- Support with continuous improvement of internal processes and documentation to champion a principles-based approaches to design, implementation, and testing
Skills
- 3+ years of experience in modeling, building, and maintaining data solutions in cloud-based environments
- Proficiency in SQL and Python to manipulate, store, manage, or retrieve data assets
- Knowledge of Agile frameworks, ideally Scrum, and tools like Jira and Confluence
- Demonstrated analytical and problem-solving skills and detail orientation
- Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience
- 8+ years of experience in modeling, building, and maintaining data solutions in cloud-based environments
- Proven impact with BigQuery and cloud-based data warehousing solutions
- Advanced knowledge of data modeling, data warehousing, and big data architecture
- Experience managing and optimizing BigQuery and Google Cloud Platform data services
- Advanced knowledge of SQL and Python with the proven ability to manipulate, store, manage, or retrieve data assets
- Ability to communicate with global team members to clarify requirements, confirm priorities, and deliver solutions within committed timelines
- Advanced analytical and problem-solving skills, with a detail-oriented mindset
- Knowledge of data sharing frameworks and governance best practices, including data privacy, security, and compliance standards
- Experience in optimizing cloud-based data solutions for cost efficiency, including monitoring and managing resource usage in BigQuery and GCP
Company Overview