Hadoop engineer
At a Glance
- Category
- 💻 Technology
- Level
- Mid-Level
- Experience
- 5+ years
- Type
- Full-time
What's Your Score?
- See the score your CV gets before you apply to Jobs for Humanity
- Get every weak line rewritten
- Download a CV written for the Gulf
Free check in 60 seconds. Fixes $5.88 one-time, only if you want them.
Company Description
Kanz is partnering with Kanz 123 to build an inclusive and just employment ecosystem. Therefore, we prioritize individuals coming from all walks of life.
Company Name: Kanz 123
Job Description
Design, build, and optimize Hadoop-based data processing pipelines to ensure reliable, scalable, high-performance batch analytics.
Key Performance Indicators
• Improve job runtime and throughput
• Design scalable HDFS data storage
• Develop efficient MapReduce pipelines
• Implement data reliability and monitoring
• Reduce operational incidents and recovery time
Qualifications
Required Qualifications
- 5+ years building Hadoop data pipelines
- Strong HDFS and MapReduce fundamentals
- Hands-on experience with Hive or Pig
- Experience with YARN and cluster operations
- Familiarity with security (Kerberos) and permissions
- Experience with Hadoop monitoring tools such as Ambari or Cloudera Manager
- Strong Linux experience for troubleshooting and operational support
Requirements
- •5+ years building Hadoop data pipelines
- •Strong HDFS and MapReduce fundamentals
- •Hands-on experience with Hive or Pig
- •Experience with YARN and cluster operations
- •Familiarity with security (Kerberos) and permissions
- •Experience with Hadoop monitoring tools such as Ambari or Cloudera Manager
- •Strong Linux experience for troubleshooting and operational support
Responsibilities
- •Design, build, and optimize Hadoop-based data processing pipelines
- •Improve job runtime and throughput
- •Design scalable HDFS data storage
- •Develop efficient MapReduce pipelines
- •Implement data reliability and monitoring
- •Reduce operational incidents and recovery time
Related Jobs4 similar jobs
Browse Similar
- See the score your CV gets before you apply to Jobs for Humanity
- Get every weak line rewritten
- Download a CV written for the Gulf
Free check in 60 seconds. Fixes $5.88 one-time, only if you want them.
Jobs for Humanity is a global organization focused on connecting companies with diverse talent, including individuals with disabilities. They aim to foster inclusive employment practices worldwide.