Big Data Administrator\/ Admin \/ Hadoop Admin
Lancesoft Europe
- الإمارات
- دائم
- دوام كامل
1. Role Management
Assign specific roles to hosts in the cluster, which determines the Cloudera services running on each node:
Balancer: Balances data blocks across nodes.
DataNode: Manages storage and retrieval of data blocks.
NameNode: Manages metadata and namespace for HDFS.
SecondaryNameNode: Periodically merges namespace image with edit logs
2. Monitoring and Performance Tuning
Use Cloudera Manager to monitor cluster health, resource usage, and service performance.
Tune configurations for optimal performance and resource utilization.
Set up alerts and dashboards for proactive issue detection.
3. Security and Access Control
Implement authentication and authorization using LDAP/Active Directory.
Manage user roles and permissions across Cloudera services.
Ensure data encryption and secure communication between nodes.
4. Disaster Recovery
Test and validate disaster recovery policies.
5. Troubleshooting and Support
Diagnose and resolve issues related to service failures, performance bottlenecks, and data inconsistencies.
Work with Cloudera support and internal teams to escalate and resolve complex problems.
6. Upgrades and Patching
Plan and execute upgrades of Cloudera Manager and cluster components.
Apply patches and hotfixes as needed to maintain system stability and security.
7. Documentation and Compliance
Maintain detailed documentation of cluster architecture, configurations, and operational procedures.
Ensure compliance with organizational and regulatory standards for data management. Enable Skills-Based Hiring No