- Python programming skills, with a focus on code reuse, parallelization, and ensuring reliable pipeline functionality
- Skills in workflow management frameworks (Airflow) with the ability to define and run complex DAGs.
- Extensive SQL skills, including DML and DDL (ALTER TABLE, GENERATE_ARRAY, LEAD, ...) and query performance optimization
- PySpark knowledge for ad-hoc Spark jobs, window functions, and Spark SQL for aggregate and join operations
- Understanding of Data Warehousing and Data Lake concepts, dimensional approach, ability to follow appropriate indexing, partitioning, and other optimizations to support efficient data retrieval
- 2+ years of experience with cloud providers or proficiency in using Databases/Cloud Storage APIs Responsibilities
- Create new batch/streaming pipelines for newly appearing databases
- Participating in integrated storage layer creation, investigating linkage between services
- Improve/expand pipelines with new tables or fields according to business requests
- Participate in technical debt management, redefine tables partitioning, create summarised tables and proceed migration, create metadata
- Use SQL and business context understanding skills to help engineers, BI analysts, and product managers get insights Our Stack
- GCP platform
- BigQuery
- Databricks
- AWS streaming services
- Tableau, Redash
-
Data Engineering
منذ 5 أيام
Talent Pal Qatar, دولة قطرWe are seeking a Cloud Developer for a renowned construction company in Doha. This is a full-time position based in Doha, Qatar. · **Responsibilities**: · - Develop and maintain database architectures using MSSQL. · - Implement ETL (Extract, Transform, Load) processes using tools ...
-
Data Engineer
منذ 3 أيام
Orbis International Dukhan, دولة قطر## Role Responsibilities: Design, develop,and maintain robust data pipelines, ETL processes, and datawarehouses Collaborate with data scientists and analysts tounderstand data requirements and ensure data availability andquality Implement data integration solutions using SQL, Pyt ...
-
Data Engineer
منذ 3 أيام
Orbis International Dukhan, دولة قطر## Role Responsibilities: Design, develop, and maintain robust data pipelines, ETL processes, and data warehouses Collaborate with data scientists and analysts to understand data requirements and ensure data availability and quality Implement data integration solutions using SQL, ...
-
Staff Data Engineer
منذ 5 أيام
Talent Pal Qatar, دولة قطرAbout Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees r ...
-
Middle Data Engineer
منذ 5 أيام
Talent Pal Qatar, دولة قطرMain responsibilities will include creating pipelines with complex ETL logic, making performance optimizations, investigating cases in collaboration with BI and Data Science team Our workflow emphasizes adaptability, collaboration, and focus on delivering value to customers and t ...
-
Sr. Data Engineer
منذ يوم
Talent Pal Qatar, دولة قطر**Technical Lead**: · - Qualification: Bachelors in science, engineering or equivalent · - Responsibility: · - Project Planning and Setup: · - Understand the project scope, identify activities/tasks, task level estimates, schedule, dependencies, risks, and provide inputs to Modul ...
-
Senior Data Engineer
منذ يوم
Talent Pal Qatar, دولة قطر**Job summary**: · Design and build data pipelinesOrganize and manage diverse dataMentor junior team members · This job has been sourced from an external job board. ...
-
Middle Data Engineer
منذ 4 أيام
شركة سنونو Dukhan, دولة قطرPosition Overview We lookfor experienced engineer to join our everyday activity and platformdevelopment. Main responsibilities will include creating pipelineswith complex ETL logic, making performance optimizations,investigating cases in collaboration with BI and Data Science tea ...
-
sr data engineer
منذ 4 أيام
COGNIZANT Dukhan, دولة قطرTechnical LeadQualification :Bachelors inscience , engineering or equivalentResponsibility :Project Planningand Setup : · • Understand the project scope, identifyactivities/ tasks, task level estimates, schedule, dependencies,risks and provide inputs to Module Lead for review. · ...
-
sr data engineer
منذ 4 أيام
COGNIZANT Dukhan, دولة قطرTechnical LeadQualification :Bachelors in science , engineering or equivalentResponsibility :Project Planning and Setup : · • Understand the project scope, identify activities/ tasks, task level estimates, schedule, dependencies, risks and provide inputs to Module Lead for review ...
-
Senior Manager, Data Engineering
منذ يوم
Talent Pal Qatar, دولة قطر**Job Purpose Summary**: · The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensur ...
-
Data Cloud Engineer Azure
منذ 5 أيام
Talent Pal Qatar, دولة قطرData Cloud Engineer Azure · **Job Location**: Qatar · **Job Details**: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object fun ...
-
Data Cloud Engineer Azure
منذ يوم
Talent Pal Qatar, دولة قطر**Data Cloud Engineer Azure**: · Job Location: Qatar · Job Details: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object functi ...
-
Senior Manager, Data Engineering
منذ 5 أيام
Talent Pal Qatar, دولة قطرJob Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data ...
-
Freelance Job: Azure Data Engineer
منذ 5 أيام
Talent Pal Qatar, دولة قطرRequirement Azure Data Engineer · - Experience 6+ yrs · - Project Timing 2 PM - 11 PM (2 nd shift) · - Skills · - Databricks, SQL, Pyspark · - Databricks Certification · - Good to have · - Good comm's and problem solving skills · - Relevant experience in Azure data engineering: 4 ...
-
Data Engineer
منذ 4 أيام
NOVEL OVERSEAS CORPORATION Al-Jumayliyah, دولة قطر& Experience : The data engineer isresponsible for designing, developing, and maintaining theinfrastructure and systems required for data storage, processing,and analysis. They play a crucial role in building and managing thedata pipelines that enable efficient and reliable data ...
-
Data Engineer
منذ يومين
NOVEL OVERSEAS CORPORATION al-Jumayliyah, دولة قطر& Experience : The data engineer is responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable d ...
-
Data Engineer
منذ يومين
Dautom Umm Bab, دولة قطرClient Introduction: In this role, you will have the opportunity to work closely with one of our esteemed clients. This client is a global leader in the Real Estate industry known for its commitment to quality and innovation. They have chosen Dautom as their trusted partner for t ...
-
Data Engineer
منذ 4 أيام
Dautom Umm Bab, دولة قطرClient Introduction: Inthis role, you will have the opportunity to work closely with oneof our esteemed clients. This client is a global leader in the RealEstate industry known for its commitment to quality and innovation.They have chosen Dautom as their trusted partner for their ...
-
Data Engineer
منذ 4 أيام
Binance Al-Jumayliyah, دولة قطرQualifications: Skilled in Java or Golang,Python, more than one programming language Knowledge in Spark/Hadoop/ HBase /Hive/Flink Experience in troubleshooting and tuning,studying component source code is preferred SQL skills Stronglearning ability and problem solving ability, ab ...
Middle Data Engineer - Dukhan, دولة قطر - شركة سنونو
وصف
Position Overview We look for experienced engineer to join our everyday activity and platform development.Main responsibilities will include creating pipelines with complex ETL logic, making performance optimizations, investigating cases in collaboration with BI and Data Science team.
Our workflow emphasizes adaptability, collaboration, and focus on delivering value to customers and teammates.We look at the entire development process and optimize it as a whole, involving a culture of continuous platform and personal improvement.
Skills Required
