Hadoop Platform Engineer Job at RAMPS International Inc., San Jose, CA

dDBBWGFIWWZwOVJUdDZmbzhyME85dVY2Vnc9PQ==
  • RAMPS International Inc.
  • San Jose, CA

Job Description

Job Description

Job Description

Hadoop Platform Engineer
San Jose, CA
4-12 Months

Position summary
The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including designing, deploying, monitoring, tuning and troubleshooting.

Job Responsibilities
Responsibilities:
• Design and develop different architectural models for our scalable data processing as well as scalable data storage
• Build data pipelines and ETL using heterogeneous sources
• Build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
• Transform data using data mapping and data processing capabilities like MapReduce, Spark SQL
• Supports Big Data and batch/real time analytical solutions
• Own the platform architecture and drive it to the next level of effectiveness to support current and future requirements
• Design, implement, deploy and maintain security, data capacity, node forecasting and planning.
• Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
• Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams.
• Participate in a 12x7 rotation for production issue escalations.
• Communicate effectively with people at all levels of the organization.

Requirements:
• B.S. degree in Computer Science, Electrical and Computer Engineering, or equivalent technical fields.
• Experience in tools integration, automation, configuration management systems.
• Experience with networking, systems administration skills.
• 3+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.
• MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
• Strong development/automation skills. Must be very comfortable with reading and writing Scala, Python or Java code.
• Proven Ability to build Curated Models for BI and Analytics
• Strong SQL Skills

Best regards,

 
Sridhar P
Senior Recruiter | RAMPS International, Inc
1199 Amboy Ave, Suite 2F, Edison, NJ 08837
email: sridhar@rampscorp.com |url:

Job Tags

Work experience placement,

Similar Jobs

Portland VA Research Foundation

Research Assistant II Job at Portland VA Research Foundation

 ...Job Description Job Description Job Title: Research Assistant II Department: Mental Health Reports To: Dr. Chris Stauffer...  ...Health Care System - Vancouver campus SUMMARY The Social Neuroscience and Psychotherapy (SNaP) Lab aims to maximize the benefits... 

Jobleads-US

Patient Experience Manager Job at Jobleads-US

Role Overview Sodexo is seeking a Patient Food Service Experience Manager at the UC Healt h Medical Center in Cincinnati, Ohio . This strategic food service leader will direct patient feeding operations at this hospital. This food service manager will lead, mentor and develop... 

Conco Construction

Construction Project Manager Job at Conco Construction

 ...be expected to learn and have an in-depth understanding of Concos self-performing trades (earthwork, concrete, masonry, ironwork, carpentry, drywall and pre-engineered metal buildings). Concos success is highly dependent on developing and maintain long term business... 

Allprobe Environmental Inc.

Environmental/Geotechnical Driller and helper, no experience necessary Job at Allprobe Environmental Inc.

 ...than the shale drilling and fracking occurring in our area and is with a stable company that has been in business 20years. Prior experience is preferred but not required. OSHA 40 hour HAZWOPER training is preferred but not required. As a Drillers helper you will act... 

Cognizant

Consulting Account Partner/Principal, Media Job at Cognizant

 ...organization that is continually expanding our client base and increasingly being recommended by analysts such as Forrester, ISG and Gartner. And were growing! The Role Cognizant's Communications, Media, and Technology (CMT) practice is seeking a dynamic...