Data Engineer London, England
Job description
At a glance:
Flexible Working: This is a hybrid working role, therefore your time will be split between working from home and the London or Bracknell Head Office. This is determined by the needs of your team and may mean that you do not come into the office for weeks or months at a time unless you choose to. If you choose to work remotely, you should be aware that you will need to come into the office.
Salary range: £47,100 - £69,500
Contract type: Permanent
What’s the role about?
As the UK’s most successful omni-channel retailer, E-Commerce is a key part of Our Business - we run two of the busiest websites in the UK, driving a significant proportion of our sales. Our Engineering practice includes 60+ teams, working on everything from Cloud Platforms to Mobile Apps, from E-Commerce functionality to Machine Learning.
Our Engineers work collaboratively and share knowledge, and learning is extremely important to us. We support our Engineers to continuously improve their skills and keep abreast of the latest technologies.
Find out more about being a Software Engineer in the Partnership, and the technology we use.
What you’ll be doing?
This is an opportunity to join our John Lewis Partnership Data Platform (PDP) team working as a Data Engineer.
You will be using your excellent Data Engineering skills and experience in designing, implementing and supporting secure cloud-based data platforms , ensuring high-quality delivery outcomes across our data landscape.
The vision for PDP is to embed data-driven decision making and analytics at scale, across the Partnership. We recognise the importance of data, and are backing a significant investment in developing the platform.
We are transforming our in-house Data Engineering capability, which has been at the heart of a move to a cloud-native data platform, to become Product delivery focused. Recent successes have been the PDP underpinning customer experience and loyalty outcomes such as myJL Rewards and the relaunch of myWaitrose.
As a Data Engineer you will participate in the shaping and delivery of data solutions to meet the needs of a wide variety of users from across the Partnership."
You will have a passion for using technology to deliver outstanding and innovative software solutions, and will have a track record of working in teams delivering complex, performant, high quality software. We want you to thrive in a fast-paced environment and have a focus on quality, ensuring the delivery aligns with the needs of the business, whilst also being supportable and maintainable. You will be a champion for exceptional data DevSecOps for our Partners and customers.
What you’ll already have:
Expert skills in building cloud-based data pipelines using data orchestration and workflow platforms. We use Airflow/Cloud Composer with Python but you may have experience of different orchestration/workflow tools or programming languages.
Advanced SQL skills, with a deep understanding of how to write performant SQL and debug problems
Experience with a cloud-based relational Data Warehousing product
Data transformation tools, preferably DBT
Cloud-Based data platforms, preferably Snowflake or Big Query
Designing secure data pipelines and fixing security/performance issues
Identification of data quality issues
Deploying to at least one major Cloud Platform such as AWS, GCP or Azure
Continuous Integration/Continuous Delivery
TDD, pair programming.
Agile development methods such as Scrum or Kanban
What else you could bring:
Containerisation, Kubernetes
Event-driven design
Gitlab CI, Jenkins, Circle CI, Jira
Data orchestration and workflow technologies such as Airflow
Visualisation & reporting tools such as Tableau or Looker
ETL tools such as Apache Beam or AbInitio
Knowledge or experience of DataVault (DV2)
Data Visualisation
Understanding of Data Management Concepts
Where will you be working?:
We have opportunities at both our John Lewis Head Office in London Victoria and Waitrose Head Office in Bracknell, Berkshire.
We have a blended hybrid approach of working from our offices and a home/remote UK location. You are contracted to a Partnership office location. If you choose to work remotely you should be aware that from time to time, you will need to come into the office. This decision is made within your team and may mean that you do not come into the office for weeks or months at a time unless you choose to.
What benefits do we offer you?:
We believe in rewarding our Partners for their time and energy. Find out about the benefits of working for the Partnership..
For internal use only:
#LI-JLPGR
#LI-HYBRID
#LI-HEADOFFICE
