Senior Data Engineer
North Oil Company
Doha
منذ 20 ساعات

ACCOUNTABILITIES

Technical role responsible for operating and ingesting data into NOC data repositories (e.g. Digital Data Platform, Data warehouse etc) to ensure the availability of data for data visualization, data analytics and digital use cases by designing, building and reviewing data integration pipelines.

Maintain close alignment with the data governance, data architecture, data security and overall IS strategy.

Continuous collaboration with the various NOC business entities to ensure the data governance practices are applied on the data repositories (e.g. Data Quality).

JOB DIMENSIONS

All NOC Enterprises Data (structured and unstructured) for more than 100 Data Domains, 650 Data Families and 100 Data Sources

On premise and cloud data hosting

Data application solutions and services, implementation, operation and monitoring

Oil and Gas data for Production petroleum operations and subsurface data

Data and Information Governance and Master Data Management

Support data and information security and controls implementation

ACTIVITIES

Main technical focal point leading and implementing data integration and load to Digital Data Platform (DDP) to support data analytics, data visualization and digital use cases

Main technical focal point responsible for implementing data architecture to deliver business requirements

Design, develop & monitor data integration pipeline to Microsoft Azure to fulfill business data requirements following Data Governance, Data Architecture and Data Security principles

Implementing and maintaining data lakes, databases & data warehousing solutions on Cloud and on 1 premises to deliver data to digital and enterprise business use cases, where the design shall be carried out in alignment with the data architect and business requirements

Direct involvement in the Data management lifecycle, from producing data integration mapping specifications, design and validation through to development and production deployments

Develop, construct, test and maintain data integration architectures including migrating on premises Integration pipelines to Cloud based.

Design and implement data solutions and technologies to support NOC activities in alignment with the data architect, Digital Project group and data governance

Identify ways to improve data reliability, performance, efficiency and quality

Deploy complex analytical algorithms, machine learning and statistical methods using programming languages and tools

Support data analytics through preparing and developing descriptive, diagnostic, predictive and prescriptive modeling

Use data to discover patterns and tasks that can be automated

Develop data set processes and data acquisitions

Contribute to the design, development, implementation and maintenance of complex data systems and solutions.

Drive initiatives in collaboration with IS teams especially data architect, data analysts and the various business entities to deliver solutions that maximizes the value of data.

Evaluate and recommend innovative solutions to mature NOC’s data operations and overall data management

Build and maintain effective working relationships with key entities and stakeholders in NOC and other parties as needed.

Support NOC to define new requirements, participating in End user meetings to derive and define the business requirement, propose cost effective solutions for data analytics and familiarize the team with the requirements, specifications, design targets & techniques to support task performance and delivery.

Review & Propose industry best tools & technology for ever changing business rules and data set from data engineering point of view,.

Conduct Proof of Concepts (POC) with new tools & technologies to derive convincing benchmarks and deliver value based solution in Quick time.

CONTEXT & ENVIRONMENT

North Oil Company (NOC) Information Solutions (IS) supports various office places as well as onshore and offshore installations

Al Shaheen Oil Field (ALS) involves complex control systems requiring high availability and reliability for business continuity

North Oil Company (NOC) is a newly setup organization operating a giant brown field which requires Information Solutions (IS) as well as the other support functions to quickly develop the required maturity.

As a result of the transition from MOQ to NOC there is a large legacy of data to be organized and protected

QUALIFICATIONS & EXPERIENCE REQUIRED

Bachelor’s degree from an accredited university in Information Management or Computer Science or an engineering / business related equivalent.

Deep experience in petroleum operations data and good understanding of the related data sources

Full understanding of Data Discovery, Data Visualization, Data Warehousing, Data Governance (e.g. datalogging, profiling, ownership / stewardship, Data Quality ..etc)

Solid track record implementing and maintaining data lakes, databases &data warehousing solutions

Strong experience in database technologies and techniques (e.g. SQL, NoSQL, Oracle,etc)

A must have strong hands-on experience designing, developing, deploying, testing and maintaining in Informatica suit (IICS, Lake house management, CDQ MDM, EDC, IDQ, Axon and MDM)

A Must have technical experience in Informatica Intelligent Cloud Services. (IICS) including Cloud Mass Ingestion (CDMI) and Cloud Data Integration (CDI)

A Must have strong hands on experience on Azure data services (ADLS, Azure Synapse, Azure SQL, Azure Databricks ..etc)

A Must have strong hands-on knowledge on Informatica administration activities which includes creating connections, upgrades, secure agent installation.

Ability to understand and work with Microsoft Common Data Model (CDM) & Rest API.

Identify and understand architectural pieces, provide direction and technical expertise in design, development and systems

Able to make quick decisions and solve technical problems to provide an efficient environment for project implementation.

Able to make quick decisions and solve technical problems to provide an efficient environment for project implementation.

Awareness of data integration patterns, data modeling and data architecture

Strong experience in programming Languages (e.g. Python, SQL ..etc)

Strong knowledge in ETLs, APIs, algorithms, data structures and business intelligence tools (Power BI)

Ability to regularly learn and adopt new technology

Expert in SQL and data analysis and shell scripting, ability to debug and fix data issue

Ability to communicate across all levels of the organization and work with diverse project teams

5 years of experience in Data and Information Management for Oil and Gas Upstream operations is an advantage.

5+ years of experience in Data Integration Projects

Good Knowledge of Applications Architecture and Information Security Principles

Fluent English both spoken and written

بلغ عن هذه الوظيفة
checkmark

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

تقديم
بريدي الالكتروني
بالضغط على "استمر" ، أعطي موافقة neuvoo على معالجة بياناتي وإرسال تنبيهات إلي بالبريد الإلكتروني ، على النحو المفصل في سياسة خصوصية لـneuvoo . يجوز لي سحب موافقتي أو إلغاء الاشتراك في أي وقت.
استمر
استمارة الطلب