1. Home
  2. Careers
  3. Jobs at bp
  4. Staff Data Engineer

Staff Data Engineer

Staff Data Engineer

  • Location India - Maharashtra - Pune
  • Travel required Yes - up to 10%
  • Job category IT&S Group
  • Relocation available Yes - Domestic (In country) only
  • Job type Professionals
  • Job code 134490BR
  • Experience level Senior
Apply Search all jobs at bp

Job summary

Digital Customers & Markets (DCM) works with customers & products (C&P), gas & low carbon energy (G&LCE), trading & shipping (T&S) and regions, cities & solutions (RC&S), and focus on enabling and delivering amazing customer experiences that generate value for bp in current and new markets.
DCM Intelligent operations (IO) bridges the gap between bp’s physical and digital worlds to release value and enable world-class operations through deployment of new and emerging digital solutions. Our SMEs and partners work closely with our business units to ensure safe, efficient, and optimized operations and great customer experiences.
At DCM IO we have embarked on a very exciting journey with a pipeline of leading-edge programmes of work in the field of automation, Internet of Things (IoT) and Edge Vision to name a few. We are building platforms for the future and products focused on these technologies and more. We plan to build a Centre Of Excellence (COE) in Pune that will build and house essential digital capabilities, innovative solutions, toolsets required to deliver products for our customers thereby driving bp’s digital agenda.
Digital Customers & Markets (DCM) works with customers & products (C&P), gas & low carbon energy (G&LCE), trading & shipping (T&S) and regions, cities & solutions (RC&S), and focus on enabling and delivering amazing customer experiences that generate value for bp in current and new markets.
DCM Intelligent operations (IO) bridges the gap between bp’s physical and digital worlds to release value and enable world-class operations through deployment of new and emerging digital solutions. Our SMEs and partners work closely with our business units to ensure safe, efficient, and optimized operations and great customer experiences.
At DCM IO we have embarked on a very exciting journey with a pipeline of leading-edge programmes of work in the field of automation, Internet of Things (IoT) and Edge Vision to name a few. We are building platforms for the future and products focused on these technologies and more. We plan to build a Centre Of Excellence (COE) in Pune that will build and house essential digital capabilities, innovative solutions, toolsets required to deliver products for our customers thereby driving bp’s digital agenda.
Staff Data Engineer will be part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers, product owners and Portfolio managers.

Key Accountabilities

  • Set data standards, co-design data schemas, ensure quality at the source and write code to (semi-)automate manual data processes wherever possible
  • Work with business partners to coordinate data remediation plans to ensure data sets meet business requirements
  • Create advanced and reusable scripts and automation to wrangle data sets for use.
  • Leverage knowledge of data models and business processes in at least one data domain.
  • Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
  • Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
  • Accountable for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
  • Identify opportunities for code re-use and productionize it into data management software systems in your immediate business entity / enabler area.
  • Advocate for coding best practices across your immediate team (e.g. unit tests, checks code into git, code review);
  • Awareness of new external trends with respect to building scalable, re-usable data management software systems
  • Collaborate with Data Engineers to build new tools and approaches to automate data ingestion, data integration, manipulation and quality control, where needed
  • Creating and code management of data pipelines and automation templates
  • Provide insight of industry and technology trends and best practices; you advocate for data management best practices (which also include best practices on decommissioning and archiving data) in your immediate areaDesigning data storage
  • Upskill team in data manipulation best practices.
  • Play active role in building DCM COE

Essential Education:
Bachelor or master’s degree in computer science, Engineering, Informatics, Information Systems or in another quantitative fields
Essential Experience and Job Requirements:
Years of experience: 12 to 15 years with minimum of 8 to 9 years relevant experience

Required Criteria
  • Deep and hands-on experience (typically 5+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Development experience in one or more object-oriented programming languages (e.g. Py-spark, Python, Java, C++)
  • Experience designing and implementing large-scale distributed data pipelines on AWS/Azure cloud (preferably AWS)
  • Hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Advanced data modeling and dimensional modeling knowledge
  • Advanced SQL knowledge
  • Deep knowledge and hands-on experience in technologies across all data lifecycle stages
  • Experience of working in relational and non-relational data bases
  • Experience using Azure DevOps , GitHub
  • Continuous learning and improvement mindset

Desirable criteria
Preferred Criteria
  • Energy domain data expertise
  • Experience of working with Azure / AWS IoT services

Apply Search all jobs at bp