1. Home
  2. Careers
  3. Jobs at bp
  4. Staff Data Engineer - dataWorx

Staff Data Engineer - dataWorx

Staff Data Engineer - dataWorx

  • Location India - Maharashtra - Pune
  • Travel required Yes - up to 10%
  • Job category IT&S Group
  • Relocation available Yes - Domestic (In country) only
  • Job type Professionals
  • Job code 126346BR
  • Experience level Senior
Apply Search all jobs at bp

Job summary

Role Synopsis

“dataWorx” is the name for the data team that is responsible for all data within these area:
  • Production & Projects including Health, Safety, Environment & Carbon
  • Refining & Operations
  • Wells & Subsurface
  • Business Services including Finance, Procurement, People & Culture, Performance Management
  • Strategy & Sustainability
The dataWorx team is looking for outstanding data engineers to power this transformation and unlock the value of our digital assets to power our journey to net zero emissions and build a new, sustainable bp.

Key Accountabilities
  • Leads, grows and develops a team of data engineers that writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp
  • Creates positive engagement and drives an inclusive work environment with team and stakeholders through the quality of interactions and collaboration across multiple business entities
  • Effectively works with cross-disciplinary collaborators and stakeholders across multiple business entities
  • Architects and designs reliable and scalable data infrastructure
  • Advocates for and ensures their team adheres to software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation)
  • Responsible for deploying secure and well-tested software that meets privacy and compliance requirements
  • Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they oversee, responsible for defining and maintaining SLAs
  • Actively contributes to improve developer velocity
  • Actively mentors others
Essential Education

Bachelor or master’s degree in computer science, Engineering, Information Systems or in another quantitative fields

Job Requirements
  • Years of experience: 15 to 18 years with minimum of 12 to 15 years relevant experience
  • 10+ years of deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • 5+ years of experience leading, growing and developing a data engineering team of around 7-30 people
Desirable Criteria
  • Deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Hands on experience with:
      • Databricks and using Spark for data processing
      • Configuring Delta Lake on Azure Databricks
      • Python, Scala, SQL
      • C#, ASP.NET, MVC, .NET Core, .Net Framework (4.6) JSON, and API development (optional)
      • Azure Data Factory
      • Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB
      • Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs
      • Designing data solutions in Azure incl. data distributions and partitions, scalability, disaster recovery and high availability
      • data governance, security, and privacy
  • Understand a broad spectrum of technology in order to provide detailed technical design which meets customer requirements
  • Experience architecting solutions in the cloud
  • Advanced hand-on experience with different query languages
  • Experience designing and implementing large-scale distributed systems
  • Stakeholder management and ability to lead large organizations through influence
Additional Information
Key Behaviours
  • Empathetic: Cares about our people, our community and our planet
  • Curious: Seeks to explore and excel
  • Creative: Imagines the extraordinary
  • Inclusive: Brings out the best in each other

Role Synopsis

“dataWorx” is the name for the data team that is responsible for all data within these area:
  • Production & Projects including Health, Safety, Environment & Carbon
  • Refining & Operations
  • Wells & Subsurface
  • Business Services including Finance, Procurement, People & Culture, Performance Management
  • Strategy & Sustainability
The dataWorx team is looking for outstanding data engineers to power this transformation and unlock the value of our digital assets to power our journey to net zero emissions and build a new, sustainable bp.

Key Accountabilities
  • Leads, grows and develops a team of data engineers that writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp
  • Creates positive engagement and drives an inclusive work environment with team and stakeholders through the quality of interactions and collaboration across multiple business entities
  • Effectively works with cross-disciplinary collaborators and stakeholders across multiple business entities
  • Architects and designs reliable and scalable data infrastructure
  • Advocates for and ensures their team adheres to software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation)
  • Responsible for deploying secure and well-tested software that meets privacy and compliance requirements
  • Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they oversee, responsible for defining and maintaining SLAs
  • Actively contributes to improve developer velocity
  • Actively mentors others
Essential Education

Bachelor or master’s degree in computer science, Engineering, Information Systems or in another quantitative fields

Job Requirements
  • Years of experience: 15 to 18 years with minimum of 12 to 15 years relevant experience
  • 10+ years of deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • 5+ years of experience leading, growing and developing a data engineering team of around 7-30 people
Desirable Criteria
  • Deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Hands on experience with:
      • Databricks and using Spark for data processing
      • Configuring Delta Lake on Azure Databricks
      • Python, Scala, SQL
      • C#, ASP.NET, MVC, .NET Core, .Net Framework (4.6) JSON, and API development (optional)
      • Azure Data Factory
      • Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB
      • Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs
      • Designing data solutions in Azure incl. data distributions and partitions, scalability, disaster recovery and high availability
      • data governance, security, and privacy
  • Understand a broad spectrum of technology in order to provide detailed technical design which meets customer requirements
  • Experience architecting solutions in the cloud
  • Advanced hand-on experience with different query languages
  • Experience designing and implementing large-scale distributed systems
  • Stakeholder management and ability to lead large organizations through influence
Additional Information
Key Behaviours
  • Empathetic: Cares about our people, our community and our planet
  • Curious: Seeks to explore and excel
  • Creative: Imagines the extraordinary
  • Inclusive: Brings out the best in each other

Role Synopsis

“dataWorx” is the name for the data team that is responsible for all data within these area:
  • Production & Projects including Health, Safety, Environment & Carbon
  • Refining & Operations
  • Wells & Subsurface
  • Business Services including Finance, Procurement, People & Culture, Performance Management
  • Strategy & Sustainability
The dataWorx team is looking for outstanding data engineers to power this transformation and unlock the value of our digital assets to power our journey to net zero emissions and build a new, sustainable bp.

Key Accountabilities
  • Leads, grows and develops a team of data engineers that writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp
  • Creates positive engagement and drives an inclusive work environment with team and stakeholders through the quality of interactions and collaboration across multiple business entities
  • Effectively works with cross-disciplinary collaborators and stakeholders across multiple business entities
  • Architects and designs reliable and scalable data infrastructure
  • Advocates for and ensures their team adheres to software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation)
  • Responsible for deploying secure and well-tested software that meets privacy and compliance requirements
  • Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they oversee, responsible for defining and maintaining SLAs
  • Actively contributes to improve developer velocity
  • Actively mentors others
Essential Education

Bachelor or master’s degree in computer science, Engineering, Information Systems or in another quantitative fields

Job Requirements
  • Years of experience: 15 to 18 years with minimum of 12 to 15 years relevant experience
  • 10+ years of deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • 5+ years of experience leading, growing and developing a data engineering team of around 7-30 people
Desirable Criteria
  • Deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Hands on experience with:
      • Databricks and using Spark for data processing
      • Configuring Delta Lake on Azure Databricks
      • Python, Scala, SQL
      • C#, ASP.NET, MVC, .NET Core, .Net Framework (4.6) JSON, and API development (optional)
      • Azure Data Factory
      • Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB
      • Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs
      • Designing data solutions in Azure incl. data distributions and partitions, scalability, disaster recovery and high availability
      • data governance, security, and privacy
  • Understand a broad spectrum of technology in order to provide detailed technical design which meets customer requirements
  • Experience architecting solutions in the cloud
  • Advanced hand-on experience with different query languages
  • Experience designing and implementing large-scale distributed systems
  • Stakeholder management and ability to lead large organizations through influence
Additional Information
Key Behaviours
  • Empathetic: Cares about our people, our community and our planet
  • Curious: Seeks to explore and excel
  • Creative: Imagines the extraordinary
  • Inclusive: Brings out the best in each other

Apply Search all jobs at bp