Data Engineer

LOCATION

Waterloo, London

Hybrid SALARY

£60k-£75k

TECHNOLOGIES USED Azure Databricks SQL Python OUR CLIENT

Global Energy Company

SPECIALTY

Upstream/Downstream, Bio-Fuels, Integrated Gas, New Energies, Chemicals, Energy and Trading

INDUSTRY

Energy

COMPANY SIZE

80000+ Employees

AUBAY'S TAKE

Our client is one of the Super Major global energy companies with who are working to power progress through cleaner energy solutions. You will have the opportunity to work in a challenging but rewarding environment that is fast paced and changing fundamentally, and work towards transforming the business of a Super Major energy company to meet the ambition to be a net-zero emissions energy business by 2050, whilst delivering a world class business case that has a strong societal license to operate. In your role you will be expected to enact change and deliver value globally across business lines and geographies.

EMPLOYEE TESTIMONIAL Because you are not a direct employee right away, you have the flexibility to land in the company, understand how the business operates, and see what opportunities are available that interest you and have those conversations internally. I was presented with my current opportunity because of Aubay and its model which made it easier to get in the door and land the position I wanted within [a Global Energy Company]'s business. BENEFITS FROM AUBAY At Aubay UK, people are at the heart of our business. We offer a competitive remunerations package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client. 25 Days Annual Leave Perkbox Discount Scheme Work From Home Opportunities Pension Scheme Opportunities to Work Directly with our Client Training Opportunities Discount Holidays at I'Aero Chalet

HAVE QUESTIONS?

Contact Camelia

Email - clungu@aubay.com

Role Summary

Aubay is looking for an experienced Big Data Engineer to join our global client in the Energy industry. You will be responsible for tackling complex data challenges, handling large volumes of data, and implementing efficient data processing algorithms. A key element of the role is to work alongside the Trading and Supply teams in delivering an enterprise solution in the data engineering area, which will include green field implementation of data analytics solutions delivering high value to customer. You will collaborate with multiple cloud tenants and utilise a range of tools and technologies, including Azure ecosystem, Databricks, ADF, Blob Store, ADLS, Spark, PySpark, SQL, and Python. Required Skills & Experience

• 4+ years of IT industry experience, including a minimum of 3 years of experience in Big Data technologies
• Deep interest and passion for Big Data technologies, recognizing their value in effective data management solutions
• Able to handle large volumes, velocity, and variety of data in real data challenges
• Understanding of infrastructure concepts and ability to work with multiple cloud tenants
• Proficiency in data warehousing and traditional ETL technologies
• Strong experience in writing stored procedures, functions, and triggers in SQL
• Expertise in the Azure ecosystem, particularly with data management on Databricks, ADF, Blob Store, and ADLS
• Strong coding experience in Spark, primarily PySpark, and confidently able to handle complex transformation requirements
• Solid programming skills and experience with Python
• Able to implement complex data processing algorithms efficiently and in real-time using Spark/PySpark and other relevant technologies
• Experience working with both structured and unstructured data, including basic knowledge of Natural Language Processing (NLP)
• Knowledge of the latest database technologies such as MongoDB, Cosmos, and Cassandra
• Able to apply understanding of data analytics using visualization and data modeling tools
• Excellent analytical and problem-solving skills, taking ownership of technical challenges and driving them to resolution
• Exceptional communication and stakeholder management skills
• Possess an industry certification in Data Engineering

Key Role Responsibilities

• Understanding the business vision from the data solutions and collaborating with all project stakeholders
• Working alongside multiple other project team members to drive towards the common goal
• Assisting the business analysts in creating data mapping documents that define the end-to-end pipeline
• Building and delivering data pipelines that ingest data (structured and unstructured) from multiple sources into the target data lake
• Building the data management layer in line with the business needs and defined standards
• Tackling problems in the pipelines or data layers and effectively resolving them based on priority
• Automating data loading during initial or incremental loads
• Supporting the run and maintain team during critical issues and aiding in faster resolution
• Effectively handling data and deriving value out of it.
• Providing innovative solutions that are best in class but also quick to market.
• Driving effective best practices across multiple initiatives and teams and be innovative and influential in managing constraints.