Data Engineer London, England
Job description
This is a 12 month fixed-term position
Snapshot
By being the first in-house machine learning team of LNER, we are pioneering the innovation within the British railway industry. Our work impacts millions of customers and improve the quality of their travel experience
About Us
We are the London Northeast Railways, transporting our customers from all the way from Inverness and Aberdeen up to London for already a century. We are on the mission to rebuild and transform the entire customer journey experience.
The Role
As a senior data engineer of LNER's ML Team, you will be designing and implementing data ingestion services for the internal and external data sources. You will prepare the datasets for building machine learning applications and support all members of ML Team with your data management skillset. You will maintain the feature store for the data scientists to build their models, the metadata related to the machine learning applications and various versions of the datasets for the machine learning experiments. You will oversee the data ingestion and preparation part of the production pipeline including online streaming of the large-scale data volumes. You will share your knowledge and experience with wider LNER audience.
About You
- Expert in data modelling, data warehousing and building scalable data pipelines.
- Strong commercial experience as a data engineer working on a wide variety of projects, within an in-house function.
- Proficient in SQL, Python, AWS, Big Query: capable of writing, tuning, testing, and troubleshooting the code.
- Expert in the data modelling and fully tested ETL pipeline development.
- Excellent data management practice, such as datasets versioning, dictionary keeping, data documentation.
What Helps to Stand Out:
- Previous experience in building distributed systems for data extraction, ingestions and processing multiple resources.
- Previous experience in leading medium to large-scale data warehousing and analytics using AWS. technologies such as Redshift, S3, EC2, Kafka, Glue, Athena, and other big data technologies
- Proficient in Python, Scala or Spark plus but not essential.
- Proficient in Unix environment.
- Previous experience with working with data scientists strong plus but not essential.
What you'll get:
- Free travel on LNER + 75% off other companies' tickets (for you & dependents)
- Discounted international train tickets (after one year's service)
- 50% discount on LNER tickets for friends & family
- Generous pension scheme
- Annual cycle to work schemes
- Discount, savings and cashback scheme from top retailers
- Health & wellbeing schemes and discounts
- Host of training opportunities to help further your career
- Rewards & awards to recognise when you shine
What we believe:
To be the most loved, progressive and responsible train operating company, we must make a meaningful difference – always doing what's right for our customers, our people, the communities and destinations we serve, the future of the industry we lead and the environment we cherish.
We know that our people are the beating heart of everything we do. We are committed to creating an inclusive, engaged culture that supports everyone at every stage of their journey – and ensures that when you're at LNER, you can always be you. No wonder most people never want to leave!
Diversity and inclusion
We are passionate about creating a diverse and inclusive workforce, representative of the communities we serve, and are creating ways to inspire diverse talent to join LNER.
Developing our people
We are focused on creating a learning culture, to support our people to be the best they can be at work by providing them with the tools and resources to navigate their development and career journey.
Health & wellbeing
To create a culture where our people can perform at their best, the physical health and mental wellbeing of our people is of paramount importance to us.
What next?
As we say, we have fantastic opportunities for ambitious people from all sorts of different backgrounds, so now is the time to join the team at LNER – without delay!
Start your journey here
