Data Quality Manager

Job Purpose

At Emirates Group our Analytics Centre of Excellence (ACoE) is a centralised unit that provides data and analytics support to Emirates Group businesses. This allows our businesses to make better decisions by using data and analytics to understand our customers, operations, and markets. The ACoE is an essential part of Emirates Group's digital transformation strategy. The unit is helping Emirates Group to become a more data-driven organization and to make better decisions by using data and analytics.

The Data Quality Manager is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics (ED&A) space. The role involves the design, testing, and support of technical data and analytic solutions and products that support Emirates Airlines and the Emirates Group businesses. with a focus on quality for complex technical solution design and efficiency in delivering data products and analytical solutions. The position demands expertise in the respective technology profiles, and involves collaboration with business stakeholders, product owners, delivery leads, architects and site reliability engineers to orchestrate quality and automation enablers, practices and KPIs to drive quality across the function. The Data Quality Engineer leverages his technology/leadership skills for talent development, and to drive continuous improvement in the form of improved practices and automation frameworks.

In this role, you will:

• Design the overarching quality vision for the ED&A function in conjunction with the Data Governance team, and lead teams in developing test strategies and test plans validating the core business problem and translating them into tests around code functionality, data quality, performance, and security.
• Implement and practice fit-for-purpose estimation techniques, to promote iterative delivery, both at the sprint/story level and the initiative/epic level. Help the program team in refining estimates, with optimal assumptions and inter-dependency understanding. Mentor and coach engineers on effective estimation techniques.
• Lead the quality aspects in discovery phases and technical designs for medium to large data and analytical solutions across multiple teams. Carry out effective technical design reviews to ensure the quality & automation patterns are used by the team.
• Research, design, prototype, build and drive test automation and data quality observability platforms to validate data products of larger scope and complexity running across different data platforms validating the solutions before releasing and while running in production.
• Demonstrate & mentor good coding principles and exercising good judgement in designing and building solutions. Conduct solution design reviews for peers. Ensure solutions adhere to published data privacy and cybersecurity principles.
• Ensure solutions being built are tested for being stable, scalable and maintainable. Enable test automation and ensure CI/CD pipelines are in good health. Implement monitoring of data applications and track product quality, performance and stability. Drive corrective, adaptive, preventative and perfective actions to maintain solution reliability and quality.
• Define strategic direction and implement mocking and test data generation capabilities. Liase with teams across the organization to manage cross dependencies for generating / mocking test data for exploratory analysis and running tests.
• Provide technical leadership to members of the cross-functional team to address areas of inefficiency and resolve technical issues. Identify activities resulting in optimal resource utilization, cost reduction, technical debt remediation, service improvement and reuse value. Partner with architects and product owners to prioritize and implement such activities.
• Champion development of best quality practices and modernization techniques. Partner with Enterpise Data & Analytics leadership team and Enterprise Architects for developing and implementing said practices, as well as promoting solution reusability, process automation, built-in-quality, test-driven development, agile delivery and timely root cause analysis. Drive and work as key contributor in building and adopting quality engineering playbooks for the relevant technologies, and ensuring adherence to said playbooks, as well as other published coding standards data technology blueprints.
• Mentor and coach quality engineers on efficient testing practices and guide less senior data quality engineers through their career development. Build fit-for-purpose on-boarding guides and robust feedback mechasnisms to ensure optimal experience for data engineering talent and continuous improvement. Help identify any skills gaps and support staff movements and rotations.
• Manage multiple assigned teams, with accountability for hiring top talent, defining development goals, and measuring performance. Contribute and support building a scalable data quality engineering team model. Identify any skills or resources gaps and assist data program leaders in closing those gaps. Work with partner and/or offshore teams to accelerate delivery.

Qualification

To be considered for this role, you must meet the below requirements:

• Qualifications: Degree in a relevant field such as Computer Science, Computational Mathematics, Computer Engineering or Software Engineering (Specialization or electives in a Data & Analytics field, e.g. Data Warehousing, Data Science, Business Intelligence, a nice-to-have).
• Experience: Minimum 8+ years of leading quality efforts and providing support for enterprise analytic applications such as Data Lake and Data Warehouse (including using the Big Data stack and Microsoft Azure cloud infrastructure)Knowledge & Skills:

• Experience in Data Engineering experience with focus on quality & automation (Fewer years experience will be considered for Masters degree holders).
• Experienced operating in a leadership role building the right culture and practices around quality and developing trustworthy data assets.
• Experience working with batch and real-time data ingestion experience with designing and coding quality validations across pipelines handling massive quantities of data (structured and unstructured), securely and in a timely fashion.
• Seasoned in building data quality platforms for highly complex data architectures performing automated checks running in a CI and in production for data observability.
• Understanding of data architecture concepts such as data modelling, Big Data storage, Lambda architecture, data vault and dimensional modelling.
• Experience in building resuable components.
• Experience in introducing new technologies and practices.
• Experience designing monitoring and alerting solutions for data pipelines and data repositories.
• Experience and knowledge of a wide variety of testing methods and tools covering functional, performance, regression, system integration, smoke testing of Big Data, ETL (Extract-Transform-Load) Business Intelligence applications and pipelines.
• Operates with efficiency and automation in mind; experience building reliable, re-usable automation frameworks (e.g. CI/CD).
• Strong SQL querying skills required.
• Experience working with partner and/or offshore teams is preferred.
• Experience coaching and mentoring less senior talent; experience directly managing staff is preferred.
• Airline industry experience a nice-to-have.
• Strong people management skills with a proven ability to hire and grow teams of Data Quality engineers.
• Strong organizational, planning, and follow-up skills and ability to hold others accountable.
• Experience participating in data/analytics product evlautions and proof-of-concepts.
• Operates with a ?You Code It, You Own It? mindset (i.e. supports the products they build).
• Demonstrated problem-solver; able to design and document complex solutions independently.
• Team player; able to collaborate with other senior resources to remove blockers, solve complex design problems and debug/resolve issues.
• Good communicator; strong influencing skills for participating in decision-making forums, stakeholder management or socializing data/analytics strategies.
• Able to deliver solutions (and associated value) iteratively.
• Is accountable and displays positive attitude.
• Self-starter and has passion for exploring and learning new technologies, especially those in the Enterprise Data & Analytics space.
• Technology Domain Key Technologies/Tools.
• Big Data :Hadoop, Spark, Scala, Hive, H-Base, Sqoop, Oozie, Apache Nifi, Airflow, HDFS, ADLS (Gen 2), Azure Data Factory (ADF), DataBricks, Kafka, Elasticsearch, AVRO / PARQUET file formats.
• Data Analysis, Modelling and Reporting : Snowflake, SQL, Data Vault 2.0, MicroStrategy, Power BI.
• Cloud Technologies :Microsoft Azure and Cloudera technology stacks.
• Integration and Messaging :Streaming (e.g. Spark Streaming), SnapLogic, TIBCO, Kafka.
• CI/CD :GIT Bitbucket, Azure DevOps, Jenkins, JIRA, Confluence.
• Automation :Java, Selenium, AppDynamics, HP Load Runner, Jmeter, Python, Automation Anywhere.At Emirates, we're committed to providing our employees with opportunities to grow and develop in their careers. So if you're looking for a challenging and rewarding opportunity, apply today and join our team!

Salary & benefits

Join us in a management role and enjoy an attractive tax-free salary. On top of our generous travel benefits, including discounted flights and hotel stays around the world, this managerial role also has an excellent leave and healthcare package. That’s on top of transport benefits, life insurance and more. Find out what it’s like to live and work in our fast-paced, cosmopolitan home city in the Dubai Lifestyle section of our website www.emirates.com/careers