Halliburton US Houston: IT Hadoop System Administrator in Houston, Texas
US Houston: IT Hadoop System Administrator
Date: Oct 1, 2016
Location: Houston, TX, US, 77032
We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the global energy industry.
You will build and enhance the tooling needed to deploy and operate Hadoop clusters at scale, across multiple data centers.
You will build tooling to maintain the health and operations of our data infrastructure. You will have a constant focus on service availability, and design systems that are resilient to failure within heavy growth. You will work across engineering, development and release management teams to enhance system operability.
Design and implement scalable data platforms
Deploy and scale Hadoop infrastructure
Hadoop maintenance and operations; monitoring and troubleshooting, capacity planning
Big Data Environment tuning specifically Kafka & Storm
Expertise/ Skills required:
5+ years managing clustered services, distributed systems, production data stores
1+ years’ experience administering and operating Hadoop clusters
Expertise managing Hadoop and its ecosystem ¬ Kafka, Storm, Zookeeper etc (mandatory)
Hadoop cluster management and capacity planning experience
Excellent Scripting skills in any one language
Need to be comfortable with Linux & Windows environments
Hadoop Admin Responsibilities:
Responsible for implementation and ongoing administration of Hadoop infrastructure.
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing Kafka, Storm, Zookeeper and MapReduce access for the new users.
Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Ambari and other tools.
Performance tuning of Hadoop clusters and Hadoop MapReduce routines.
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system management and monitoring.
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
Point of Contact for Vendor escalation
Halliburton is an Equal Opportunity Employer.
3000 N. Sam Houston Parkway E., Houston, Texas, 77032, United States
Requisition Number: 13302
Experience Level: Experienced Hire
Job Family: Information Technology
Product Service Line: Information Technology
Full Time / Part Time: Full Time
Additional Locations for this position:
Compensation is competitive and commensurate with experience.
Nearest Major Market: Houston
Job Segment: System Administrator, Linux, Database, Testing, Business Intelligence, Technology