Arabic.AI
Data Engineer
🇸🇦 Riyadh, Saudi Arabia🏢 On-site
PythonSQLSparkDatabricksBigQueryTalendInformaticaNiFi
At a Glance
- Category
- 💻 Technology
- Level
- Mid-Level
- Type
- Full-time
You will build and look after the pipelines that move data from the client's operational systems into the warehouse, and the data models that everything downstream depends on. Ingestion, processing and modelling, plus the documentation that goes with them. You will also do the analyst work that keeps the numbers honest.
What you will do
- Profile new sources before you build: databases, APIs, files, open data, structured and unstructured.
- Build, schedule and monitor ingestion and processing pipelines in the tools the client already uses, and extend them where it makes sense.
- Design and build the warehouse models (star schemas, conformed dimensions) that dashboards and machine-learning use cases sit on.
- Put data-quality checks and lineage capture into every pipeline, and keep the conceptual, logical and physical model documentation current.
- Work with business owners to reconcile figures and define KPIs, and help write the monthly progress report. What you need
- Strong Python and SQL, used in production
- Spark (Databricks or Hadoop) and BigQuery, and comfort with both data-lake and warehouse patterns
- Hands-on experience with at least two of Talend, Informatica, NiFi and Denodo
- Extracting and capturing changes from MS SQL Server, Oracle, MySQL and PostgreSQL
- Ingesting from APIs, files (SFTP, Excel, CSV) and open data, in batch and streaming
- Dimensional modelling: star schemas, conformed dimensions, slowly changing dimensions, and the ability to document models at conceptual, logical and physical level
- Orchestration, monitoring, retries, data-quality checks and lineage
- Profiling, reconciliation, defining KPIs with business users Good to have
- dbt, Airflow, Dataflow, Iceberg
- Google Professional Data Engineer or Databricks certificatio
Requirements
- •Strong Python and SQL skills used in production
- •Experience with Spark (Databricks or Hadoop) and BigQuery
- •Comfort with data-lake and warehouse patterns
- •Hands-on experience with at least two of Talend, Informatica, NiFi, and Denodo
- •Experience extracting changes from MS SQL Server, Oracle, MySQL, and PostgreSQL
- •Experience ingesting from APIs, files (SFTP, Excel, CSV), and open data in batch and streaming
- •Dimensional modelling skills (star schemas, conformed dimensions, slowly changing dimensions)
- •Ability to document models at conceptual, logical, and physical levels
Nice to Have
- •dbt
- •Airflow
- •Dataflow
- •Iceberg
- •Google Professional Data Engineer certification
- •Databricks certification
Responsibilities
- •Profile new sources (databases, APIs, files, open data, structured and unstructured)
- •Build, schedule, and monitor ingestion and processing pipelines
- •Design and build warehouse models for dashboards and machine-learning use cases
- •Implement data-quality checks and lineage capture into every pipeline
- •Maintain conceptual, logical, and physical model documentation
- •Work with business owners to reconcile figures and define KPIs
- •Assist in writing monthly progress reports
Related Jobs4 similar jobs
Browse Similar
Stop — Check First
- Check your CV before Arabic.AI passes on it
- Get every weak line rewritten
- Download a CV written for the Gulf
Free check in 60 seconds. Fixes $5.88 one-time, only if you want them.
GCC Info
Company
Arabic.AI focuses on developing artificial intelligence solutions tailored for the Arabic language. They aim to advance NLP and AI capabilities for Arabic content.