Senior Data Engineer London, England
Job description
Form of Employment: Permanent
Start Date: Immediate
Location: Waterloo, Hybrid (2-3 days per week)
Role Summary
Aubay is seeking a Senior Data Engineer to join our Global Energy client's data engineering team within their Trading and Shipping department. In this role you will focus on delivery of complex data management solutions by leveraging industry best practices. You will be working with the project team to build the most efficient data pipelines and data management solutions that helps business to derive value from their data.
Our client's project that you will be working on seeks to protect and grow $500m per annum by leveraging their full, industry-leading data flow advantage in Crude and Products. To achieve this, our client are rebuilding their approach to fundamental analytics from the ground up to strengthen their trading bias. They harness the data available internally, along with all relevant external market data, and make use of cutting-edge technology to deliver human-centred, digital products that give their Analysts and Traders an advantage in the market.
A key element of this role is to work along with Trading and Supply teams to deliver an enterprise solution in data engineering area. This will mostly include green field implementation of data analytics solutions delivering high value to our client's customers.
Role Accountabilities
- As a data engineer, you will responsible for effectively handling data and deriving value out of it.
- Responsible for providing innovative solutions that are best in class but also quick to market.
- Drive effective best practices across multiple initiatives and teams and be innovative and influential in managing constraints.
- Understands the business vision from the data solutions and works with all project stakeholders to enable that.
- Works alongside multiple other project team members to drive towards the common goal.
- Helps the business analysts to create data mapping documents that define the end to end pipeline.
- Builds and delivers data pipelines that ingests data (structured and unstructured) from multiple sources into the target data lake.
- Builds the data management layer in line with the business needs and standards defines.
- Triages problems in the pipelines or data layers and effectively fixes them based on the priority.
- Automates data loading during initial or incremental loads.
- Supports the run and maintain team during critical issues and helps them in faster resolution.
Required Skills and Experience
- 4 + years of IT industry experience, with at least 2 years within Big Data technologies.
- Interest and passion in Big Data technologies and appreciates the value that can be brought in with an effective data management solution.
- Have previously worked on real data challenges and handled huge volume, velocity and variety of data.
- Strong understanding of infrastructure concepts and have previously worked with multiple cloud tenants.
- Proficient with data warehousing and traditional ETL technologies.
- Strong experience in writing stored procedure, functions and triggers in SQL.
- Strong experience on Azure ecosystem and has worked with data management on Databricks, ADF, Blob Store, ADLS etc.
- Strong coding experience in Spark – primarily PySpark. Must be able to effectively churn out complex transformation requirements with ease.
- Solid programming skills and Python experience.
- Implement complex data processing algorithms in real time in and efficient manner using Spark and other technologies.
- Worked with both structured and unstructured data – basics of NLP.
- Knowledge on latest database technologies like MongoDB, Cosmos, Cassandra etc.
- Knowledge on data analytics area using visualization and data modelling tools.
- Excellent analytical & problem-solving skills, willingness to take ownership and resolve
- In this role, you will have no direct reports. Must be able to demonstrate you are self-driven and can independently handle your workload.
About Aubay UK – Ahead of Innovation!
Aubay UK is a recognised InSourcing Partner for client-side deployment delivered across London. Our team, based in Canary Wharf, specialises in hiring IT professionals within London’s Energy and FinTech sectors, helping our clients to expand their operations with top-tier talent who are experts in their fields. We work exclusively with clients who are globally recognized as Energy Super Majors/Financial Services and innovative FinTech players.
Aubay UK is the most recently started branch of Aubay Group www.aubay.com. Aubay Group is an international Digital Services Company, listed on a Euronext Stock Exchange, who have been operating for 21 years in the European market and working alongside some of the biggest names in the Banking, Finance, Insurance, Energy, IT/Digital, Manufacturing, Transport and Telecoms sectors. With over 7,000 employees across 7 countries and 16 offices in England, France, Belgium, Luxembourg, Italy, Spain, and Portugal, Aubay Group generated revenues of €435 million in 2019.
What Aubay UK Offers
At Aubay UK, people are at the heart of our business. We offer a competitive remuneration package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client. Other benefits include:
● 25 Days Annual Leave + Bank Holidays
● Pension scheme
● Work from home opportunities
● Access to Udemy training platform and conferences
● Perkbox employee discount scheme
● Discount on winter sports holiday at www.aero1607.com
● Opportunity to work directly for the client at the end of assignment
Our Client
Our client is one of the Super Major global energy companies with around 84,000 employees across 70+ countries who are working to power progress through cleaner energy solutions.
Specialties: Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading.
You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.
You will be working remotely initially and thereafter onsite with the client.
This role requires you to be based in the UK and have the right to work in the UK. This role is not eligible for visa sponsorship.
Aubay UK is proud to be an equal opportunity employer. All aspects of employment decisions will be based on merit, competence, performance, and business needs.
Job Type: Full-time
Salary: £80,000.00-£100,000.00 per year
Benefits:
- Referral programme
- Store discount
- Work from home
Schedule:
- 8 hour shift
- Monday to Friday
Application question(s):
- Do you require visa sponsorship by your employer to work in the UK?
This role is not eligible for sponsorship - all candidates who require sponsorship unfortunately cannot be considered
- Please include a link to your LinkedIn profile.
Work Location: Hybrid remote in LONDON
Reference ID: 214
