Note: The job is a remote job and is open to candidates in USA. BNSF Railway is one of the largest U.S. railroads transporting the nation’s freight across 28 western states and 3 Canadian provinces. They are seeking a Senior Data Engineer to design and optimize real-time data pipelines, manage large-scale data warehouses, and collaborate with various teams to enhance data solutions.
Responsibilities
- Design and implement data streaming solutions to process real-time data efficiently
- Develop and maintain robust data pipelines for both real time and batch processing including data extraction, transformation and ETL processes to ensure seamless data flow across systems
- Create and manage large scale data warehouses to ensure efficient data access and retrieval in support of business intelligence and analytics needs
- Develop certified datasets by integrating data from diverse data sources to ensure data accuracy, consistency and reliability
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective data solutions
- Optimize data workflows, monitor data pipelines and troubleshoot issues to ensure high performance, reliable and scalable data flows
- Ensure data security and compliance with industry standards and regulations
- Stay current with industry trends and advancements in data engineering, data science and machine learning
- Write efficient and well documented code ensuring unit tests documentation for all data solutions
- Implement data engineering solutions into data platforms or production systems by leading the solution design, development, testing, and monitoring
- Demonstrate operational excellence by monitoring, troubleshooting, and resolving production issues, including participating in a 24/7 on-call rotation
Skills
- Minimum 6 years experience in software engineering, data engineering, database management or relevant experience
- Proficiency in programming languages such as Python, SQL, Java
- Strong understanding of data warehousing concepts including dimensional modeling and star schema
- Experience with ETL processes and tools including cloud based solutions
- Familiarity with database management systems (e.g., SQL, NoSQL) and modern lakehouse technologies (eg. Apache Iceberg, Delta Lake, Apache Trino)
- Experience with data streaming technologies (e.g., Apache Kafka, AWS Kinesis, Apache Flink and Apache Spark)
- Experience in data engineering, with a focus on data streaming, data pipelines, data orchestration tools, datamart creation, and certified datasets
- Experience in DevSecOps standards, source control systems and tools like Jenkins, GitHub
- Excellent problem-solving skills and attention to detail
- Strong communication and collaboration skills
- Intellectual curiosity and ability to thrive in a team environment that is constantly changing
- Demonstrated ability to learn new technical concepts and to adapt to new technologies quickly
- Ability to communicate in a clear, concise, professional oral or written manner, to be understood by technical and non-technical colleagues
- Bachelor's degree or higher in Computer Science, Information Technology or a related field
- Prior experience with Data Engineering tools and architectures
- Experience in Rail, Shipping, Airline, Logistics, Warehousing, Supply Chain, or other Transportation industries or experience in a High-Tech industry
- Experience working in an Agile environment (Scrum, Kanban, SAFe)
- Experience with cloud platforms
- Proficiency in using Jupyter for collaborative data analysis
- Experience with open-source technologies and tools
- Have knowledge of geospatial data transformation and spatial libraries
Benefits
- An industry-leading 401(k) and renowned Railroad Retirement program.
- A range of robust health care options for you and your dependents (including domestic partners), including medical, dental, vision, telemedicine, mental health, cancer support, and high-quality care network options.
- Health care spending accounts (HSA) with employer contributions, as well as life and disability insurance, provided at no cost.
- Family benefits includingparental, pediatric and family building support, adoption and surrogacy reimbursement, and dependent care spending account (with employer match).
- Access to discounts on travel, gym memberships, counseling services and wellness support.
- Annual bonus (Incentive Compensation Program)
- Generous leave / time off policies.
Company Overview
Company H1B Sponsorship