Data Engineer - Doha, دولة قطر - Qatar Airways
وصف
About Your Job:
In this role, you will create reliable architectures for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis.
You will design, implement, maintain a full suite of real-time and batch jobs that fuels our cutting edge data analytics platform to provide real-time intelligence to our businesses.
Key Responsibilities:
- Be a full stack data engineer to build highly scalable, high quality data products.
- Create and maintain optimum data pipeline architecture for ingestion, storage, processing & transformation of data for building data products for analytics
- Ensure data product is complete, cleansed and rules have been defined for outliers
- Ensure Audit, Balance & Control are implemented for Consistent, Complete & Comprehensive Data Quality and Data Integrity management
- Ensure compliance to data strategy and governance and integrate organization's data management processes in to data product development.
- Accountable for implementing modernday security controls for sensitive data products
- Write automated unit test cases for data products and integrate to CI/CD pipeline
- Develop data quality routines
- 24 / 7 support of data products developed
- Identifies and manages reference data
- Build solutions which are scalable, resilient and sustainable to address business requirements.
- Tackle challenges and solve complex problems on a daily basis
Be part of an extraordinary story
Your skills. Your imagination. Your ambition. Here, there are no boundaries to your potential and the impact you can make.
You'll find infinite opportunities to grow and work on the biggest, most rewarding challenges that will build your skills and experience.
You have the chance to be a part of our future, and build the life you want while being part of an international community.
Our best is here and still to come. To us, impossible is only a challenge. Join us as we dare to achieve what's never been done before.Together, everything is possible
Qualifications:
About you:
Skill Sets:
Required
- 4+ years handson data engineering experience in working with big data using technologies such as Hadoop, Spark, Kafka, Python, Scala, Azure Data Factory, Azure Data Lake Store, Azure Databricks.
- Handson experience in data modelling, data pipeline design & development
- Strong technical knowledge of performance tuning and query optimization on large data sets.
Preferred
- Experience with Data flow diagrams, Data dictionary, Database normalization theory techniques, Entity relation modelling and design techniques.
- Experience in Datawarehouse concepts.
- Knowledge about data virtualization, semantic layer tool dremio.
- Knowledge of airline domain.
- Knowledge of agile/lean development methodologies.
About Qatar Airways Group
Our story started with four aircraft. Today, we deliver excellence across 12 different businesses coming together as one. We've grown fast, broken records and set trends that others follow. We don't slow down by the fear of failure. Instead, we dare to achieve what's never been done before.
So whether you're creating a unique experience for our customers or innovating behind the scenes, every person contributes to our proud story.
المزيد من الوظائف من Qatar Airways
-
Sales Agent Al Maha Services
Dukhan, دولة قطر - منذ يوم
-
Cargo Interline Partnerships Manager
al-Jumayliyah, دولة قطر - منذ أسبوع
-
Software Engineer
Doha, دولة قطر - منذ 6 أيام
-
Executive Sous Chef Product Development
al-Jumayliyah, دولة قطر - منذ أسبوع
-
Electrical Technician
Dukhan, دولة قطر - منذ يومين
-
Training Manager
Doha, دولة قطر - منذ 6 أيام