Data Engineer London, England
Job description
Our Mission
Trainline is the leading independent rail and coach travel platform selling rail and coach tickets to millions of travellers worldwide. Via our highly rated website and mobile app, people can seamlessly search, book and manage their journeys all in one place. We bring together millions of routes, fares and journey times from 270+ rail and coach carriers across 45 countries. We offer our customers the best price for their journey and smart, real time travel information on the go. Our aim is to make rail and coach travel easier and more accessible, encouraging people to make more environmentally sustainable travel choices.
Introducing the Data Engineering team at Trainline
Data Engineering are at the core of our data Team, thanks to the numerous pipelines and tables we output we power high impact dashboards, empower users to self-serve via SQL and enable cool machine learning models and real time data products.
As a Data Engineer, you will be involved in high impact engineering that will drive key decisions and give data science key tools to enable insights that will drive new business insights.
Data Engineers work along side Machine learning engineers, BI Developers and Data Scientists in cross-functional teams with key impacts and visions. Using your skills with SQL & Python to build data models you will be working in sprints to deliver high impact tables by ingesting and transforming data from the data lake in AWS.
As a department we strive to give our Data Engineers have high levels of autonomy and freedom to innovate and continually refine their technical and soft skills with clear progression plans and training opportunities with Data Camp.
As a Data Engineer at Trainline, you will...
You will be key to making our data lake more accessible and insightful breaking down the barriers to access by working on data marts and designing data models that even the most basic SQL users can use.
Your typical day will look like this:
- Connect with team at standup to catchup on the latest.
- Build data pipelines with Athena or Spark
- Use SQL to transform data into meaningful insights
- Build and deploy infrastructure with Terraform
- Implement DDL, DML with Iceberg
- Do a code review for your peers
- Orchestrate your pipelines with DAGs on Airflow
- Participate in SCRUM ceremonies (standups, backlogs, demos, retros, planning)
- Do some pair programming to pick up some Machine Learning and BI skills
- Secure data with IAM and AWS Lake formation
- Deploy your changes with Jenkins and GitHub actions
We'd love to hear from you if you have...
- 3+ years of experience as a Data Engineering using SQL and Python.
- Previous experience with data lakes in AWS, Glue Catalog and Athena
- Good understanding of Spark, optimisation and performance tuning
- Capable of using popular data modelling tools to create a diagram of proposed tables to enable discussion
- Good communicator and comfortable with presenting ideas and outputs to technical and non technical users
- Worked on Apache Airflow before to create DAGS.
- Ability to work within Agile, considering minimum viable products, story pointing and sprints.
Additional Information
But why should you join?
You will be working in a high performing and collaborative multi-cultural team. We have over 42 nationalities across our 5 offices in London, Paris, Edinburgh, Barcelona and Milan who work closely together.
We want our people to stretch their minds, abilities, and share their knowledge. Each year we hold The Trainline Tech Summit, which provides Trainliners with an opportunity to stand up and share their story, learnings, or new skills with their colleagues in a safe environment.
We've always paid special attention to flexible working as we value a strong work/life balance. The pandemic has taught us that a balance between remote working and being in a collaborative office environment leads to productive teams.
Our Culture
Coaches Over Heroes
We prioritise the focus on being one team over elevating the heroics of an individual, for us the true heroes are those who are excellent at nurturing, coaching and generous in sharing their knowledge with others.
Well-being
Everything that we do takes into account the morale of every member of our team, their opportunities for growth and for participation in exciting challenges.
Mentoring and Learning
We have a mentoring community that is constantly growing, we provide people with mentors or buddies from various teams.
Trust
We hire awesome people capable of making smart decisions - empowerment is a great enabler of agility. It is within a supportive team that you will feel the strength to thrive and try new things knowing that everyone will be there for you along the way.
We value open expression at Trainline, we believe it’s the diversity of experience, backgrounds and perspectives of our employees that makes us who we are. We encourage everybody to play a part in changing the way people travel across the world.
