Overview:

As a Cloudera administrator, you will be responsible to set up, shape, administer, and test the applications related to Hadoop platforms. You will be part of a team of DevOps engineers focusing on the day-to-day tasks of managing and maintaining On-Prem and Cloud environments, and will be hands-on involved with CI/CD process and monitoring application servers. Candidate must be comfortable working in an agile environment.

Responsibilities:

In this job you will:

Install Cloudera-Hadoop from ground up with SDLC cycle methodology including Dev, Test, Cert, Production and Disaster Recovery
Plan capacity planning, infrastructure planning and version fix to build Hadoop Cluster
Implement Hadoop security like Kerberos, Cloudera Key Trustee Server and Key Trustee Management Systems
Enable Sentry for RBAC (role-based access control) to have a privilege level access to the data in HDFS
Perform upgrades to Cloudera Manager, CDH along with support for Linux Server Patching
Provide infrastructure and support to software developers to rapidly iterate on their products and services and deliver high-quality results. This includes infrastructure for automated builds and testing, continuous integration, software releases, and system deployment
Design and implement Backup and Disaster Recovery strategy based out of Cloudera BDR utility for batch applications and Kafka mirror maker for real-time streaming applications
Align with development and architecture teams to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
Develop kafka into Hadoop to enable real-time streaming applications
Monitor and coordinate all data system operations, including security procedures, and liaison with infrastructure, security, DevOps, Data Platform and Application team
Ensure proper resource utilization between the different development teams and processes
Design and implement a toolset that simplifies provisioning and support of a large cluster environment
Align with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
Apply proper architecture guidelines to ensure highly available services
Review performance stats and query execution/explain plans; recommend changes for tuning
Create and maintain detailed, up-to-date technical documentation
Solve live performance and stability issues and prevent recurrence