Job responsibilities
- Able to manage large scale Ambari Hadoop cluster environments, handling all Hadoop environment builds, performance tuning and ongoing monitoring.
- Coordinate with Development, Network, Infrastructure, and other organizations necessary to get work done
- Provide Level 3 Support for Hadoop platform issues.
- Monitor cluster health and perform tuning activities
- Debug day to day job issues in Hadoop platform and provide solutions.
- Perform root cause analysis on failed components and implements corrective measures
- Provide ongoing information to leadership, customers, and peers regarding enhancements, innovations and solutions
- Perform Tuning and increase Operational efficiency on a continuous basis.
- Work with cross functional teams to set up production environment and enable solutions for business.
- Interact with business users to answer their queries and solve their problems.
- Able to help and Guide L1 support engineers to fix day-to-day Operational issues.
- Perform data migration, upgrades and database/tool maintenance etc.
- Develop scripts to automate reports and maintenance activities.
- Strong knowledge on UNIX/Linux skills
- Monitor health of Hadoop cluster and Generate Performance Reports and Monitor and provide continuous improvements.
Skills and qualifications
- Bachelor/ Master’s Degree
- Certifications in Hadoop, Linux, Cloud technologies
- 4+ years work experience in a similar role
- Knowledge of Bigdata Architecture & Administrator’s role
- Expertise in installing Hadoop Cluster and its related components
- Configuration and Performance Tuning of Hadoop Cluster
- Manage, Maintain, Monitor and Troubleshoot Hadoop Clusters
- Data Ingestion, Data Access & Data storage using Hadoop Big Data tools like HBase, Flume, Kafka, Nifi, ElasticSearch
- Application Deployment using JAVA & Python APIs
- Cluster Connectivity, Security, Backup and Disaster Recovery
- Strong knowledge on LDAP related tasks/activities
- Good Scripting knowledge in Bash, Python, Anaconda, Ansible
- Knowledge on Automation/DevOps Tools Github, Jenkins, Docker, Kubernetes
- Knowledge on Kibana, Talend, Graphana, Control-M
- Excellent communication skills
- Ability to work independently with a strong attention to detail
- Ability to work well in a global team environment