£60k-£75k

Global Energy Company

Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading

Energy

80000+ Employees

Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.

Role Summary

Required Skills & Experience

• 4+ years of IT industry experience, including a minimum of 3 years of experience in Big Data technologies
• Deep interest and passion for Big Data technologies, recognizing their value in effective data management solutions
• Able to handle large volumes, velocity, and variety of data in real data challenges
• Understanding of infrastructure concepts and ability to work with multiple cloud tenants
• Proficiency in data warehousing and traditional ETL technologies
• Strong experience in writing stored procedures, functions, and triggers in SQL
• Expertise in the Azure ecosystem, particularly with data management on Databricks, ADF, Blob Store, and ADLS
• Strong coding experience in Spark, primarily PySpark, and confidently able to handle complex transformation requirements
• Solid programming skills and experience with Python
• Able to implement complex data processing algorithms efficiently and in real-time using Spark/PySpark and other relevant technologies
• Experience working with both structured and unstructured data, including basic knowledge of Natural Language Processing (NLP)
• Knowledge of the latest database technologies such as MongoDB, Cosmos, and Cassandra
• Able to apply understanding of data analytics using visualization and data modeling tools
• Excellent analytical and problem-solving skills, taking ownership of technical challenges and driving them to resolution
• Exceptional communication and stakeholder management skills
• Possess an industry certification in Data Engineering

Key Role Responsibilities

• Understanding the business vision from the data solutions and collaborating with all project stakeholders
• Working alongside multiple other project team members to drive towards the common goal
• Assisting the business analysts in creating data mapping documents that define the end-to-end pipeline
• Building and delivering data pipelines that ingest data (structured and unstructured) from multiple sources into the target data lake
• Building the data management layer in line with the business needs and defined standards
• Tackling problems in the pipelines or data layers and effectively resolving them based on priority
• Automating data loading during initial or incremental loads
• Supporting the run and maintain team during critical issues and aiding in faster resolution
• Effectively handling data and deriving value out of it.
• Providing innovative solutions that are best in class but also quick to market.
• Driving effective best practices across multiple initiatives and teams and be innovative and influential in managing constraints.