RwandAir Limited |
Type: Job
Published: 2025-01-23 | Deadline: 2025-02-02
Job Title: Data Engineer
Reports to: IT Manager Software Services
Department: IT Services
Duty Station: Kigali International Airport (KIA)
Job Purpose
This role will be responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis and decision making. Responsibilities include building real-time and batch data ingestion pipelines, setting up of data catalogues, data warehouses, data cleansing, data transformation, data processing and data visualization to provide real-time intelligence to businesses.
Key Duties and Responsibilities:
- Construct, deploy, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices.
- Develop software programs or use tools to bring together large, complex and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data.
- Design and implement data tools for analytics and data scientist team members to help them in building, optimizing and tuning of use cases.
- Develop and manage data warehouses to ensure the availability, performance, scalability and security of production data warehouse.
- Develop software programs or use tools for cleansing and harmonization of data from a variety of data sources.
- Defines data catalogues, metadata to provide search ability and governance (including Records Management) for structured and unstructured data.
- Implement best practices in management of data, including master data, reference data, metadata, data quality and lineage in assigned areas.
- Develop business intelligence dashboards using data visualization tools.
- Conduct and own Root Cause Analysis (RCA) of reported incidents in operational systems through code, log and configuration reviews and ensure timely code, configuration or infrastructure fixes.
- Develop REST APIs from the existing dataware house as the source for application consumption.
- Build solutions which are scalable, resilient and sustainable to address business requirements.
- Works closely with a team of frontend and backend software engineers, business solutions architects and analysts.
- Perform other department duties related to his/her position as directed by his or her direct supervisor.
Desired Profile: Required education, Experience, and Abilities;
- BSc degree in Computer Science, Engineering or relevant field with a minimum 2-3 years of hand-on experience in data management.
- At least 3+ years of Python, SQL and Java development experience.
- At least 2+ years of experience with schema design and dimensional data modelling
- Hands-on experience in working with big data using technologies like Hadoop/Hive, Hyperscale PostgreSQL, Java/Scala, Spark, Kafka, SQL and NoSQL, azure cloud-based data engineering solutions
- Hands on experience with data ingestion tools (ex: striim, streamsets, NiFi, Flume, Dropbase).
- Hands-on experience in data modelling, data visualization, and pipeline design & development.
- Hands on experience with data warehouse platforms (ex: Snowflake, Azure Data Lake Analytics).
- Strong technical knowledge of performance tuning and query optimization on large data sets.
Preferred
- Experience with cloud-based data-warehousing system Snowflake.
- Experience with ETL tool Informatica.
- Experience with data visualization tools like Tableau, PowerBI
- Knowledge of agile/lean software development methodologies.
- Very good command of English language
How to Apply:
- An application letter addressed to the Chief HR & Administration Officer;
- Recent Curriculum Vitae;
- Copies of Notarized Degree/Diploma certificates;
- Relevant certificates;
- Copies of academic papers;
- A photocopy of the Passport/National ID;
- Three referees;
The deadline for submitting application documents (Only PDF Format) is February 02, 2025. Please apply via the link: https://erecruitment.rwandair.com/