1. Home
  2. Careers
  3. Jobs at bp
  4. Big Data Lead, Cybersecurity

Big Data Lead, Cybersecurity

Big Data Lead, Cybersecurity

  • Location United States - Texas - Houston
  • Travel required Negligible travel
  • Job category IT&S Group
  • Relocation available No
  • Job type Professionals
  • Job code 137886BR
  • Experience level Senior
Apply Search all jobs at bp

Job summary


At bp, we’re reimagining energy for people and our planet. With operations working across almost every part of the energy system, we’re leading the way in reducing carbon emissions and developing more sustainable methods for solving the energy challenge.
We’re a diverse team of engineers, scientists, traders and business professionals determined to find answers to problems that must be solved. But we know we can’t do it alone. We’re looking for people who share our passion for reinvention to bring a new point of view, collaborative spirit, and to challenge our thinking in our ambition to achieve net zero!

Role Synopsis

The goal of the Security Data Service is to empower its customers to understand and improve the security posture of BP by providing a consolidated, easy to use data platform for reporting and analytics.
We are looking for a Big Data Information Security Engineering Lead with strong technical expertise, who is interested in joining our team to create and manage our data infrastructure and tools, including collecting, storing, processing and analyzing a range of security data and data systems.
As a key member of this team, you will be working as part of the small empowered, customer-centric agile squad to deliver a consolidated and easy to use data platform for reporting and analytics.

Key Accountabilities

  • Collect and process raw data at scale for a variety of projects and initiatives.
  • Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
  • Build ingestion pipelines and ETL jobs to consume data feeds from security source systems (e.g. Azure feeds, O365, AD, Syslog, APIs).
  • Designing and implementing Continuous Integration / Continuous Delivery (CI/CD) solution using BP standards for the squad.
  • Creation and managing of data pipelines, transformation, and efficient storage.
  • Build monitoring and alerting mechanisms for data pipelines and transformations.
  • Managing infrastructure for Big Data and data pipelines.
  • Build flexible data solutions that support the ingestion, or the consumption needs of our data lake and its customers.
  • Lead conversations around how we can derive more value out of our data and enable operational excellence.
  • You will be a pivotal member of the squad and can shape and support the success of this service.

Essential Education

  • Focus on experience rather than education.
  • Advanced knowledge of Azure data engineering concepts.
  • AWS Foundational knowledge.

Essential Experience & Job Requirements

  • Extensive experience of developing using the Azure analytics components including Data Lake, Power BI, Data Factory, Azure Data Explorer, Azure Synapse, Data Warehouse, and Databricks.
  • Fully conversant with Agile and DevOps development methodology and concepts as applied to data driven analytics projects. Including CI/CD Coding, security testing best practice and standards.
  • Experience in DevOps in Azure cloud environments.
  • Experience with designing, building, and operating analytics solutions using Azure cloud and serverless technologies.
  • Data Management experience e.g. data profiling, large volume data handling.
  • Experience in automated data driven testing.
  • Advanced knowledge of scripting Languages like Python, Scala, or PowerShell (at least one of them).
  • Advanced knowledge of database programming including relational (SQL, Maria) and nonrelational (NoSQL, MongoDB, Cassandra) databases.

Desirable Criteria & Qualifications

  • Experience with security related data sets.
  • Experience with Machine Learning Models.
  • Object Oriented Programming knowledge is a plus.


At bp, we support our people to learn and grow in a diverse and challenging environment. We believe that our team is strengthened by diversity. We are committed to fostering an inclusive environment in which everyone is respected and treated fairly.
There are many aspects of our employees’ lives that are important, so we offer benefits to enable your work to fit with your life. These benefits can include flexible working options, a generous paid parental leave policy, and excellent retirement benefits, among others!
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Apply Search all jobs at bp