We have embarked on a major digital transformation and we are looking for tech professionals like you, who are keen to use modern technologies to change how millions of users connect, explore, and transact on our digital channels.
We want you to bring fresh ideas from all domains, including data engineering, large-scale system design, UI development, mobile applications and so on.
You should be talented, versatile, enthusiastic and display leadership qualities.Let’s talk about our vision to you. Qatar Airways is a global leader with innovative products that are recognized by the industry.
Digital and analytics is a key part of enabling our bright future. We embarked on a journey to re-engineer how we deliver digital products and make technology a core business differentiating capability and we need you to carry out this vision.
Hence, if you are looking for a fast pace work environment where you can gain a once in a lifetime transformation experience, and have the opportunity to make multi-billion dollar impact then reach out to us and tell us how you can be a leader in our team
About Your Job :
Inthis role, you should be an expert in the architecture of highly scalable andoptimized data pipelines with state-of-the-art monitoring.
You should excel inthe data engineering to build Data-as-a-Service platform by identifying datasources, seamlessly extracting and streaming data to a data lake, carry outcomplex data transformation and processing;
and provide a clean, secure andconsistently highly scaling data & analytics architecture.
Key Responsibilities :
Architect, design, construct, install, test andmaintain highly scalable and optimized data pipelines with state-of-the-artmonitoring and established baseline pipeline architecture.
Build the optimal data extraction &transformation mechanisms for various kinds of data.
Implement the optimal technology for storingdata in the data lake; based on size, complexity and needs from business teams
Ensure optimal maintenance process for the datain the lake; in terms of real time needs; data analysis needs and dataarchiving / long term data retention.
Bring together large, complex and sparse datasets to meet functional and non-functional business requirements and use avariety of languages, tools and frameworks to marry data
Design and implement data tools for analyticsand data scientist team members to help them in building, optimizing and tuningof use cases.
Co-ordinate design activity of the assignedproject deliverable, within a programme of change, acting as custodian of thesolution designs for the entire technology stack.
Takes full responsibility for the technicalintegrity of solution designs, ensuring that common technical elements arerecognized and that work is not unnecessarily duplicated
Architect, design and build data warehousesolutions.
Design routines for cleansing and harmonizationof data from a variety of data sources.
Design data catalogues, metadata to providesearch ability and governance (including Records Management) for structured andunstructured data.
Identifies and manages reference data.
Design and develop business intelligencedashboards using data visualization tools.
Design, develop, test and publish REST APIsbased on big data lake store.
Review functional and non-functionalrequirements for the deliveries assigned and recommend / develop technologyframeworks.
Ensures quality control activities (includingNFR testing) are carried out satisfactorily. Attends quality reviews asappropriate
Conduct root cause analysis of reportedincidents and assess framework and infrastructure requirements / changes andsubmit finding.
Conduct pro-active performance and fine tuningfor early detection and rectification of slow response, application errors,tuning, and implement corrective and preventive actions.
Drive high performance and accountability forsuperior results and employee engagement. Provide staff with timely, candid andconstructive performance feedback;
develop employees to their fullest potentialand provide challenging opportunities that enhance employee career growth;recognize and reward employees for accomplishments.
Promote, train, support, and advocate DataArchitecture best practices, such as, master data management, data modelling,data modernization etc.
Establish the department or teams objectivesand priorities to align with and support business objectives.
Regularly evaluate the department or teamobjectives, plans, procedures, practices, and makes appropriate changes ifneeded.
Recruit,train and develop team members to create a high quality data engineeringcapability.
About you :
The applicant should have a Bachelor’sDegree or equivalent (Degree in engineering, computer applications, commerce,or business administration).
You must have minimum 7 years of data engineering experience. Should have excellent verbal and writtencommunications skills.
Also possess good analytical, interpersonal skills and aproven team player.
Overall 7+ years of data engineering experience with minimum 4+ years hands-onexperience and proficient with big data using technologies like Hadoop / Hive,Hyperscale PostgreSQL, Java / Scala, Spark, Kafka, SQL and NoSQL, Python, azurecloud-based data engineering solutions (ex : Azure Data Factory, Azure Data LakeStore, Azure Databricks, Azure HDInsight)
Hands-on experience on data tools striim,streamsets, NiFi.
Hands-on experience with ETL tool Informatica
Hands on experience in architecting Data &Analytics solution
Hands-on experience in data modelling, datavisualization, and pipeline design & development
Hands on experience with data warehouseplatforms (ex : Snowflake, Azure Data Lake Analytics)
Strong solution design skills to buildscalable, resilient and sustainable solutions to address business requirements.
Very good command of English language.
Experience with elasticsearch
Experience with cloud-based data-warehousingsystem Snowflake
Experience with data virtualization, semanticlayer tool dremio
Experience with visualization tools - Tableau,Power BI
Knowledge of airline domain
Knowledge of agile / lean developmentmethodologies