Senior Data Engineer
Qatar Duty Free
Location Doha, Qatar
منذ 3 يوم

We have embarked on a major digital transformation and we are looking for tech professionals like you, who are keen to use modern technologies to change how millions of users connect, explore, and transact on our digital channels.

We want you to bring fresh ideas from all domains, including data engineering, large-scale system design, UI development, mobile applications and so on.

You should be talented, versatile, enthusiastic and display leadership qualities.Let’s talk about our vision to you. Qatar Airways is a global leader with innovative products that are recognized by the industry.

Digital and analytics is a key part of enabling our bright future. We embarked on a journey to re-engineer how we deliver digital products and make technology a core business differentiating capability and we need you to carry out this vision.

Hence, if you are looking for a fast pace work environment where you can gain a once in a lifetime transformation experience, and have the opportunity to make multi-billion dollar impact then reach out to us and tell us how you can be a leader in our team

About Your Job :

Inthis role, you should be an expert in the architecture of highly scalable andoptimized data pipelines with state-of-the-art monitoring.

  • You should excel inthe data engineering to build Data-as-a-Service platform by identifying datasources, seamlessly extracting and streaming data to a data lake, carry outcomplex data transformation and processing;
  • and provide a clean, secure andconsistently highly scaling data & analytics architecture.

    Key Responsibilities :

  • Architect, design, construct, install, test andmaintain highly scalable and optimized data pipelines with state-of-the-artmonitoring and established baseline pipeline architecture.
  • Build the optimal data extraction &transformation mechanisms for various kinds of data.
  • Implement the optimal technology for storingdata in the data lake; based on size, complexity and needs from business teams
  • Ensure optimal maintenance process for the datain the lake; in terms of real time needs; data analysis needs and dataarchiving / long term data retention.
  • Bring together large, complex and sparse datasets to meet functional and non-functional business requirements and use avariety of languages, tools and frameworks to marry data
  • Design and implement data tools for analyticsand data scientist team members to help them in building, optimizing and tuningof use cases.
  • Co-ordinate design activity of the assignedproject deliverable, within a programme of change, acting as custodian of thesolution designs for the entire technology stack.
  • Takes full responsibility for the technicalintegrity of solution designs, ensuring that common technical elements arerecognized and that work is not unnecessarily duplicated
  • Architect, design and build data warehousesolutions.
  • Design routines for cleansing and harmonizationof data from a variety of data sources.
  • Design data catalogues, metadata to providesearch ability and governance (including Records Management) for structured andunstructured data.
  • Identifies and manages reference data.
  • Design and develop business intelligencedashboards using data visualization tools.
  • Design, develop, test and publish REST APIsbased on big data lake store.
  • Review functional and non-functionalrequirements for the deliveries assigned and recommend / develop technologyframeworks.
  • Ensures quality control activities (includingNFR testing) are carried out satisfactorily. Attends quality reviews asappropriate
  • Conduct root cause analysis of reportedincidents and assess framework and infrastructure requirements / changes andsubmit finding.
  • Conduct pro-active performance and fine tuningfor early detection and rectification of slow response, application errors,tuning, and implement corrective and preventive actions.
  • Drive high performance and accountability forsuperior results and employee engagement. Provide staff with timely, candid andconstructive performance feedback;
  • develop employees to their fullest potentialand provide challenging opportunities that enhance employee career growth;recognize and reward employees for accomplishments.

  • Promote, train, support, and advocate DataArchitecture best practices, such as, master data management, data modelling,data modernization etc.
  • Establish the department or teams objectivesand priorities to align with and support business objectives.
  • Regularly evaluate the department or teamobjectives, plans, procedures, practices, and makes appropriate changes ifneeded.
  • Recruit,train and develop team members to create a high quality data engineeringcapability.
  • About you :

    The applicant should have a Bachelor’sDegree or equivalent (Degree in engineering, computer applications, commerce,or business administration).

    You must have minimum 7 years of data engineering experience. Should have excellent verbal and writtencommunications skills.

    Also possess good analytical, interpersonal skills and aproven team player.

    REQUIRED

  • Overall 7+ years of data engineering experience with minimum 4+ years hands-onexperience and proficient with big data using technologies like Hadoop / Hive,Hyperscale PostgreSQL, Java / Scala, Spark, Kafka, SQL and NoSQL, Python, azurecloud-based data engineering solutions (ex : Azure Data Factory, Azure Data LakeStore, Azure Databricks, Azure HDInsight)
  • Hands-on experience on data tools striim,streamsets, NiFi.
  • Hands-on experience with ETL tool Informatica
  • Hands on experience in architecting Data &Analytics solution
  • Hands-on experience in data modelling, datavisualization, and pipeline design & development
  • Hands on experience with data warehouseplatforms (ex : Snowflake, Azure Data Lake Analytics)
  • Strong solution design skills to buildscalable, resilient and sustainable solutions to address business requirements.
  • Very good command of English language.
  • PREFERRED

  • Experience with elasticsearch
  • Experience with cloud-based data-warehousingsystem Snowflake
  • Experience with data virtualization, semanticlayer tool dremio
  • Experience with visualization tools - Tableau,Power BI
  • Knowledge of airline domain
  • Knowledge of agile / lean developmentmethodologies
  • بلغ عن هذه الوظيفة
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    قدِّم طلب ترشيحك
    بريدي الالكتروني
    بالضغط على "واصل" ، أعطي موافقة neuvoo على معالجة بياناتي وإرسال تنبيهات إلي بالبريد الإلكتروني ، على النحو المفصل في سياسة خصوصية لـneuvoo . يجوز لي سحب موافقتي أو إلغاء الاشتراك في أي وقت.
    واصل
    استمارة الطلب