Hadoop Engineer Resume Samples

4.6 (81 votes) for Hadoop Engineer Resume Samples

The Guide To Resume Tailoring

Guide the recruiter to the conclusion that you are the best candidate for the hadoop engineer job. It’s actually very simple. Tailor your resume by picking relevant responsibilities from the examples below and then add your accomplishments. This way, you can position yourself in the best way to get hired.

Craft your perfect resume by picking job responsibilities written by professional recruiters

Pick from the thousands of curated job responsibilities used by the leading companies

Tailor your resume & cover letter with wording that best fits for each job you apply

Resume Builder

Create a Resume in Minutes with Professional Resume Templates

Resume Builder
CHOOSE THE BEST TEMPLATE - Choose from 15 Leading Templates. No need to think about design details.
USE PRE-WRITTEN BULLET POINTS - Select from thousands of pre-written bullet points.
SAVE YOUR DOCUMENTS IN PDF FILES - Instantly download in PDF format or share a custom link.

Resume Builder

Create a Resume in Minutes with Professional Resume Templates

Create a Resume in Minutes
CS
C Stiedemann
Corene
Stiedemann
9892 Noe Path
Boston
MA
+1 (555) 340 8054
9892 Noe Path
Boston
MA
Phone
p +1 (555) 340 8054
Experience Experience
Detroit, MI
Hadoop Engineer
Detroit, MI
Conroy and Sons
Detroit, MI
Hadoop Engineer
  • Leverage metrics to manage the server fleet and complex computing systems to drive automation, improvement, and performance
  • Build strong partnerships with senior management to drive development of BB&T’s strategy across IT and other functions
  • Develop and execute plans for complex systems backed by excellence, confidence, and thorough engineering analysis
  • Develop and execute plans for complex systems backed by excellence, confidence, and thorough engineering analysis; and
  • Work closely with the vendor, Cloudera, to make sure the environment is running properly
  • This support would include filesystem management and monitoring, cluster monitoring and management and automating / scripting backups and restores
  • Perform security and compliance assessment
Boston, MA
Hadoop Engineer / Administrator
Boston, MA
McGlynn Group
Boston, MA
Hadoop Engineer / Administrator
  • Manage and lead a team of Database Administrators
  • Actively participate in all phases of project development life cycle including database policies, procedures, standards and supporting documentation, database design, process flow analysis, development, benchmark analysis, performance/tuning, capacity planning, and production implementation
  • Provide status reports to senior management
  • Conduct employee performance appraisals, provide feedback, coaching, team building and training/education to team members
  • Assisting with communication interfaces/integration to associated systems
  • Upholds enterprise policy guidelines and recommends new and improved guidelines
  • Provide Hadoop Administration support which includes infrastructure setup, software installation (MapR, Hortonworks, Cloudera, etc.), configuration, upgrading/patching, monitoring, trouble shooting, maintenance, and working with development team to install components (Hive, Pig, etc.) and manage MapReduce jobs
present
Philadelphia, PA
Senior Hadoop Engineer
Philadelphia, PA
Kirlin and Sons
present
Philadelphia, PA
Senior Hadoop Engineer
present
  • In depth knowledge of hardware sizing, capacity management, cluster management and maintenance, performance monitoring and configuration
  • Work with stakeholders and Data Scientists in the Strategy and Marketing divisions to data management and analysis best practices
  • Lead software development in a collaborative team environment using Scrum Agile methodologies, primarily using Java and JavaScript with frameworks
  • Setup security using Kerberos and AD on Cloudera and Hortonworks clusters
  • Performance tuning applications and systems for high volume throughput
  • Expert with versioning, change control, problem management and troubleshooting
  • Ensures solutions developed adhere to security and data privacy policies
Education Education
Bachelor’s Degree in Computer Science
Bachelor’s Degree in Computer Science
Loyola University Chicago
Bachelor’s Degree in Computer Science
Skills Skills
  • Ability to establish strong relationships with the corresponding technical community
  • Ability to serve as a visionary concerning future technological capabilities and operational scenarios; ability to create new business models and technologies
  • Demonstrated proficiency in basic computer applications, such as Microsoft Office software products
  • Design, install, and maintain highly available systems (including monitoring, security, backup, and performance tuning)
  • Strong documentation skills
  • Cloudera Certified Professional Certification
  • Has excellent oral and written communication skills
  • Strong Customer Service skills
  • Good analytical and problem solving skills
  • Ability to script for cron jobs
Create a Resume in Minutes

15 Hadoop Engineer resume templates

1

Hadoop Engineer Resume Examples & Samples

  • Design Hadoop and Hadoop Analytical/BI Tools deployment architectures (with features such as high availability, scalability, process isolation, load-balancing, workload scheduling, etc.)
  • Install, validate, test, and package Hadoop and Hadoop Analytical/BI products on Red Hat Linux platforms
  • Publish and enforce best practices, configuration recommendations, usage design/patterns, and cookbooks to developer community
  • Engineer process automation integrations
  • Perform security and compliance assessment
  • Contribute to Application Deployment Framework (requirements gathering, project planning, etc.)
  • Evaluate capacity for new application on-boarding into a large scale Hadoop cluster
  • Provide Hadoop SME and Level-3 technical support for troubleshooting
  • Experience using/installing/supporting Hadoop components such as HDFS, MapReduce, Hive, HBase, Pig, Sqoop, Flume, Datameer, Platfora, etc
  • Experience installing, troubleshooting, and tuning systems. Experience on Hadoop and Hadoop Analytical/BI tools
  • Experience with multi-tenant platforms taking into account Data Segregation, Resource Management, Access Controls, etc
  • Experience with Red Hat Linux, UNIX Shell Scripting, Java, RDBMS, NoSQL, and ETL solutions
  • Experience with Kerberos, TLS encryption, SAML, LDAP
  • Experience with full SDLC deployments with associated administration and maintenance functions
2

Hadoop Engineer Resume Examples & Samples

  • Maintain the Hadoop components
  • Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time
  • Develop and maintain the hdfs files
  • Develop and maintain Hive/Impala tables
  • Evaluation the new Hadoop components releases
  • Provide ongoing maintenance, support and enhancements in existing systems and platforms
  • Collaborate with BI Developers, data scientists, business users and other engineers to define requirements and design solutions
  • Perform database tuning including monitoring, troubleshooting and optimizing performance of the databases
  • More than 3 years of relevant experience with Hadoop ecosystem (Cloudera)
  • More than 3 years of relevant experience with Java Development
  • More than 3 years of relevant experience with BI/DW ecosystem
  • Good understanding of Cloudera Hadoop architecture
  • Good understanding these Hadoop components
  • Hadoop/MapReduce
  • Hue
  • Storm
  • Kafka
  • Impala
  • Knowledge in real-time or near real-time processes
  • Knowledge Databases like SQL Server, Oracle, Teradata is an asset
  • Knowledge Informatica ETL tool is an asset
  • Excellent communication skills in English and/or French (written and oral)
  • Strong capacity to communicate ideas and solutions to non-technical people
3

Hadoop Engineer Resume Examples & Samples

  • Develop internal and client applications using a modern Big Data toolkit (Hadoop, Elasticsearch, MongoDB, Storm, etc.)
  • Work onsite at client
  • At least 1 year of experience in one of the following areas
  • Has excellent oral and written communication skills
4

Senior Hadoop Engineer Resume Examples & Samples

  • Lead software development in a collaborative team environment using Scrum Agile methodologies, primarily using Java and JavaScript with frameworks
  • Lead designing, building, installing, configuring applications that lend themselves to a continuous integration environment
  • Lead analysis of data stores and uncover insights
  • Experience in developing for high performance and large Hadoop clusters
  • Strong understanding of Hadoop architecture, storage and IO subsystems, network and distributed systems
  • Expert scripting with shell scripting (Bash, PHP, PERL, Python, etc.)
  • Expert with versioning, change control, problem management and troubleshooting
  • Experience with RDBMS technologies and SQL language; Oracle and MySQL highly preferred
  • Hands on experience with open source management tools (Pig, Hive, Flume, Thrift API, etc.) including participation in the community
  • Hadoop Developer Certified
5

ETL / Hadoop Engineer Resume Examples & Samples

  • Troubleshoot and develop on Hadoop technologies including HDFS, MapReduce2, YARN, Hive, Pig, Flume, HBase, MongoDB, Accumulo, Tez, Sqoop, Zookeeper, Spark, Kafka, Storm, and Hadoop ETL development via tools such as Informatica, Pentaho
  • Participate in analysis of data stores and help uncover insights
  • Assist and support proof of concepts as Big Data technology evolves
  • 3+ years of ETL data integration development, Scrum Agile, and software architecture
  • Some experience developing utilizing Big Data Hadoop Ecosystem components (Sqoop, Hive, Pig, Flume, etc.)
  • Experience with RDBMS technologies and SQL language; Teradata and Oracle highly preferred
  • Data modeling (Entity-Relational-Diagram)
6

Engineer, Hadoop Engineer Resume Examples & Samples

  • Understanding of high performance and large Hadoop clusters
  • Experience managing and developing utilizing open source technologies and libraries
  • Experience with Java Virtual Machines (JVM) and multithreaded processing
  • Experience with versioning, change control, problem management and troubleshooting
7

Senior Hadoop Engineer / Architect Resume Examples & Samples

  • Lead a team of highly motivated data integration engineers
  • Provide technical advisory and expertise on Analytics subject matter
  • Create, implement and execute the roadmap for providing Analytics insight and Machine Learning
  • Identify useful technology that can be used to fulfill user story requirements from an Analytics perspective
  • Experiment with new technology as an ongoing proof of concept
  • Architect and develop data integration pipelines using a combination of stream and batch processing techniques
  • Integrate multiple data sources using Extraction, Transformation and Loading (ETL)
  • Build data lake and data marts using HDFS, NoSQL and Relational databases
  • Manage multiple Big Data clusters and data storage in the cloud
  • Collect and process event data from multiple application sources with both internal Elsevier and external vendor products
  • Understand data science and work directly with data scientists and machine learning engineers
  • 8+ years experience in software programming using Java, JavaScript Spring, SQL, etc
  • 3+ years experience in service integration using REST, SOAP, RPC, etc
  • 3+ years experience in Data Management, Data Modeling
  • Python, Scala or any semi-functional programming preferred
  • Excellent SQL skills from different range levels of ANSI compliancy
  • Basic knowledge of Applied Statistics
  • Advanced knowledge of Systems and Service Architecture
  • Advanced knowledge of Polyglot Persistence and use of RDBMS, In-Memory Key/Value stores, BigTable databases and Distributed File Systems such as HDFS and Amazon S3
  • Industry experience working with large scale stream processing, batch processing and data mining
  • Extensive knowledge of the Hadoop ecosystem and its components such as HDFS, Kafka, Spark, Flume, Oozie, HBase, Hive
  • Experience with at least one of the Hadoop distributions such as Cloudera, Hortonworks, MapR or Pivotal
  • Experience with Cloud services such as AWS or Azure
  • Experience with Linux/UNIX systems and the best practices for deploying applications to Hadoop from those environments
  • Advanced knowledge of ETL/Data Routing and understanding of tools such as NiFi, Kinesis, etc
  • Good understanding of DevOps, SDLC and Agile methodology
  • Software/Infrastructure Diagrams such as Sequence, UML, Data Flows
  • Requirements Analysis, Planning, Problem Solving, Strategic Planning
  • Excellent Verbal Communication, Self-Motivated with Initiative
  • Education business domain knowledge preferred
8

Hadoop Engineer / Integrator Resume Examples & Samples

  • Contributing member of a high-performing, agile team focused on next generation data & analytic technologies
  • Provide senior level technical consulting to create and enhance analytic platforms & tools that enables state of the art, next generation Big Data capabilities to analytic users and applications
  • Engineering and integrating Hadoop modules such as YARN & MapReduce, and related Apache projects such as Hive, Hbase, Pig
  • Provide senior level technical consulting to application development teams during application design and development for highly complex and critical data projects
  • Code and integrate open source solutions into the data-analytic ecosystem
  • Develop fast prototype solutions by integrating various open source components
  • Be part of teams delivering all data projects including migration to new data technologies for unstructured, streaming and high volume data
  • Developing and deploying distributed computing Big Data applications using Open Source frameworks like Apache Spark, Apex, Flink, Storm and Kafka
  • Utilizing programming languages like Java, Spark, Python and NoSQL databases like Cassandra
  • Developing data management and governance tools on an open source framework
  • Hands on experience leading delivery through Agile methodologies
  • Experience developing software solutions to build out capabilities on a Big Data and other Enterprise Data Platforms
  • 2+ year Experience with the various tools & frameworks that enable capabilities within the data ecosystem (Hadoop, Kafka, , NIFI, Python, Hive, Tableau, MapReduce, YARN, Pig, Hbase, NoSQL)
  • Experience developing data solutions on AWS
  • Experience designing, developing, and implementing ETL and relational database systems
  • Experience working with automated build and continuous integration systems (Chef, Jenkins, Docker)
  • Experience with Linux including basic commands, shell scripting and solution engineering
  • Experience managing code on Github
  • Experience with data mining, machine learning, statistical modeling tools or underlying algorithms
9

Hadoop Engineer Resume Examples & Samples

  • Basic analytical and creative problem solving skills for creation and testing of software systems
  • Basic communication skills to provide systems diagnoses and resolution for current systems
  • Basic interpersonal skills to interact with customers, senior level personnel, and team members
10

Hadoop Engineer Resume Examples & Samples

  • Support application monitoring data system handling the reporting built in Platfora (existing) as well as working on the new architecture for migration
  • Competent with Hive table creation, loading, and querying as well as newer technologies such as Spark and Jethro and be able to ingest data into Hadoop to multiple areas within the ecosystem such as HDFS
  • Work with the business on developing new reporting outside of Platfora within Tableau or some other reporting tool available while developing a new architecture that would adhere to the performance requirements
  • Bachelor's Degree (or higher) or High School Diploma/GED with 5+ years of database design architecture experience
  • 5+ years of database design architecture experience
  • 5+ years of extract/transform/load (ETL) engineering & design experience
  • 1+ years of Hadoop core technologies (HDFS, Hive, YARN) experience
  • 1+ years of Hadoop ETL technologies (Sqoop/Sqoop2) experience
  • Familiarity with Linux server management and shell scripting
  • SQL Server 2008+/BIDS experience
  • Tableau experience
  • Platfora/Zoomdata/AtScale experience
  • Kafka/Flume experience
  • Spark experience
  • Jethro experience
  • Java experience
11

Senior Hadoop Engineer Resume Examples & Samples

  • Excellent Linux skills and have hands-on experience administering an on-premise Hadoop cluster (master & worker nodes)
  • In depth knowledge of hardware sizing, capacity management, cluster management and maintenance, performance monitoring and configuration
  • Expertise with Red Hat Linux installation/management/administration
  • Expertise with Hadoop Cluster administration and management
  • Expertise with Hadoop/MapReduce/Hive
  • Knowledge of SQL/Impala, Database Design and ETL skills
12

Hadoop Engineer Resume Examples & Samples

  • Extensive experience with Java, and the willingness to learn new technologies. Experience with other object-oriented languages will be considered, but our code is Java so you should be able to get up-to-speed on at least one of them quickly)
  • The Hadoop eco-systems and/or other such technologies (examples include Hive, Pig, MapReduce, HDFS, HBase, Accumulo, Cassandra, Kafka, Storm and Spark). Familiarity with Hortonworks is ideal
  • Delivering business relevant solutions using the tools and technologies mentioned previously
  • Experience developing systems to handle high volumes of streaming data
  • Experience with Relational database design, SQL, and Cluster management is desired
  • Linux experience, including
  • Linux/Unix and scripting languages like Bash, Python, etc.,
  • Linux command line experience,
  • Basic Linux administration skills a plus
  • Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance 10 CFR 710, Appendix B
  • Drug Testing: All Security Clearance (L or Q) positions will be considered by the Department of Energy to be Testing Designated Positions which means that they are subject to applicant, random, and for cause drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP)
13

Senior Cloud Hadoop Engineer Resume Examples & Samples

  • Work with Teradata Hadoop Engineering organization to facilitate the deployment of new database releases into the Cloud ecosystem
  • Define standardized / automated cloud database release processes
  • Develop procedures/tools to map customer requirements into standardized cloud instances
  • Create ordering, provisioning, configuration management, monitoring, and maintenance procedures
  • Bachelor's degree in computer science, computer engineering or related technical field
  • 7+ years of experience in deploying new software into a live production environment
  • Experience operationalizing the mass deployment of custom server and storage systems to support very large database systems
  • Experienced with staging of large database computers including firmware and software loads followed by database installation and configuration
  • Experience with automated CM and deployment tools such as Chef, Puppet, or Ansible
  • Experience writing software to configure systems and gather system data/set parameters
  • Experience interfacing directly with end Customers
  • Experience w/Teradata solutions including the Teradata RDBMS, Teradata Aster, Hadoop, and/or Big Data Discovery environments
  • Advance knowledge of Hadoop, Linux/UNIX
  • Broad expertise in the entire portfolio of Teradata products, and how they are currently deployed to on-premises customers
  • Teradata Certification
  • Experience supporting cloud based analytics solutions
  • Hands-on experience with public cloud services (AWS, Azure, Google)
  • Knowledge of Security Standards (ISO27001, SSAE16, PCI, HIPAA, etc)
  • Teradata's total compensation approach includes a competitive base salary, 401(k), strong work/family programs, and medical, dental and disability coverage
  • Teradata is an Equal Opportunity/Affirmative Action Employer and commits to hiring returning veterans
14

Hadoop Engineer Resume Examples & Samples

  • Implement new Hadoop infrastructure as well as interfaces / APIs to meet the aforementioned objective
  • This support would include filesystem management and monitoring, cluster monitoring and management and automating / scripting backups and restores
  • Troubleshoot using logs and monitors should errors arise
  • BS or MS in Computer Science, Computer Engineering, Mathematics. Strength in both fields is necessary; double majors are a big plus
  • 3+ years experience with C or Java and Python
  • Experience translating math into efficient code
15

Senior Hadoop Engineer Resume Examples & Samples

  • Create defect tracking tickets
  • Lead on creating and enhancing technical bulletins, procedures and support processes such as change control templates, service bulletins, support tools, problem scenario reporting rules, knowledge articles, etc
  • Actively participate on online forums, respond to questions and contribute content to enable self-service
  • Work closely with Engineering team members, ideally co-locate with engineering team members
  • Debug customer issues and make code changes, and engage the right engineer(s) as needed in order to resolve customer issues as rapidly as possible
  • Actively watch common configuration issues and user errors happening with developers and testers during development and testing, collect and document them, working with data scientist to formularize them into learning cases and feed them into the service analytics machine learning system
  • Ph.D in Computer Science or related discipline with 3 years of experience in the field OR
  • Extensive working knowledge/Experience of Hadoop
  • 8 years of experience programming gained through a combination of academic studies and work experience. Strong Python (preferred) and/or Java / C++ skills
  • 5 year of experience working with complex software in a parallel processing environment gained through a combination of academic studies and work experience
  • Experience deploying and troubleshooting complex distributed systems
  • Excellent interpersonal skills. Will be expected to communicate well with engineers, product managers, customers and consultants
  • Eagerness and aptitude for learning things quickly
  • Ability to work various shifts (i.e. after-hours, weekends, and holidays) as needed
  • Ability to provide 24x7 rotating on-call support
16

Senior Hadoop Engineer Resume Examples & Samples

  • Responsible for implementation and ongoing administration of Hadoop infrastructure of some or all of the big data systems in distributed cloud environments
  • Setup security using Kerberos and AD on Cloudera and Hortonworks clusters
  • Setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
  • 7+ years of experience in Information Technology operations
  • 7+ years of relevant professional experience in Unix and Linux Systems, server hardware, virtualization, RedHat
  • 4+ years of demonstrated customer management experience
  • 4+ years working in a corporate datacenter environment
  • 3+ years Hadoop experience
  • 3+ years AWS/Azure experience
  • Proven experience with automation
  • Basic understanding of TCP/IP networking
  • Excellent troubleshooting techniques
  • Good communication skills over the phone, e-mail and documentation
  • Strong team player capable of providing support across the IT organization to train and assist others
  • Demonstrable ability to work with a diverse team across global time zones (i.e., US, India, Europe) to effectively complete tasks and objectives
  • Ability to balance multiple priorities and meet specific deadlines through the use of strong organizational skills
  • Highly energetic, self-motivated, quick learner with the ability to work independently
  • Strong dedication, work ethic, sense of teamwork, and professional attitude
  • Proven history of constantly striving for improved methodology, efficiency, and work processes
  • Ability to work under considerable pressure managing multiple tasks and priorities
  • Demonstrates the ability to produce high-quality results with attention to details
  • Strong interpersonal, leadership, and team communications skills are essential
  • Willing to Travel domestically and internationally (5%)
17

Hadoop Engineer Resume Examples & Samples

  • 3+ years of proven industry experience working on the backend services or infrastructure for a large scale, highly distributed web site or web service
  • Solid foundation in computer science fundamentals with sound knowledge of data structures, algorithms, and design
  • Strong Java or other object-oriented programming experience or, even better, experience and/or interest in functional languages (we use Scala!)
  • Familiarity with JVM profiling and GC tuning. Experience with tools like YourKit, JMH, statsd-jvm-profiler or equivalents a plus
  • Experience designing and deploying large scale distributed systems, either serving online traffic or for offline computation
  • Bonus points for experience with Hadoop, MongoDB, Finagle, Kafka, ZooKeeper, Graphite (or other time series metrics stores), JVM profiling, Grafana, Linux system administration, Chef (or equivalent experience with Puppet, Ansible, etc.), Aurora (or other cluster management frameworks like Marathon or Kubernetes)
  • Comfortable in a small and fast-paced startup environment
  • Bachelors Degree or higher in Computer Science, Electrical Engineering or related field
18

Hadoop Engineer Resume Examples & Samples

  • Participate in the enterprise infrastructure vision and strategy
  • Focused on service reliability and sustainability
  • Develop and execute plans for complex systems backed by excellence, confidence, and thorough engineering analysis; and
  • Technology experience required; Hive, Hbase, Sqoop, Ranger, zookeeper, NIFI
  • Other technologies good to have; Spark, Phoenix, Spring Batch, Accumulo
  • In depth experience with one of the major Hadoop distributions
  • 5-10 years’ experience with Unix management, complex computing platforms, and/or cutting-edge technologies involving virtualization, distribution, and high performance computing
  • Bachelors degree in Computer Science, technical field, or equivalent experience
19

Hadoop Engineer / Administrator Resume Examples & Samples

  • Manage and lead a team of Database Administrators
  • Actively participate in all phases of project development life cycle including database policies, procedures, standards and supporting documentation, database design, process flow analysis, development, benchmark analysis, performance/tuning, capacity planning, and production implementation
  • Production support responsibilities include maximizing system availability, ensuring swift and complete database recovery, optimizing database and availability through ongoing maintenance, and ensure conformance to audit and operating standards
  • Provide status reports to senior management
  • Participate in the evaluation, and recommendation of appropriate hardware and software resources
  • Conduct employee performance appraisals, provide feedback, coaching, team building and training/education to team members
  • Conduct interviews for recruitment of full-time and consulting positions as required
  • Assisting with communication interfaces/integration to associated systems
  • Upholds enterprise policy guidelines and recommends new and improved guidelines
  • Provide Hadoop Administration support which includes infrastructure setup, software installation (MapR, Hortonworks, Cloudera, etc.), configuration, upgrading/patching, monitoring, trouble shooting, maintenance, and working with development team to install components (Hive, Pig, etc.) and manage MapReduce jobs
  • Uphold enterprise policy guidelines and recommend new and improved guidelines to ensure compatibility and better service for end-users
  • Performing capacity monitoring and short and long-term capacity planning in collaboration with development resources, system administrators and system architects
  • Maintaining security according to best practices and generating security solutions that balance auditor requirements with user requirements
  • Automation using shell scripting
  • Participating in 24x7 on call rotation and customer service experience
  • Implement DR strategy for Hadoop Distributions collaborating with storage and Unix teams
  • Identifying and initiating resolutions to user problems/concerns associated with big data functionality (hardware and software)
  • Staying abreast of the most current release of MPP technology (Netezza) and HADOOP (major distributions), including compatibility issues with operating systems, new functionalities and utilities
  • Provide Administration support on Datameer
  • Assist in Capacity Planning and Security Implementation
  • Monitor overall standards and procedures
  • Assist in integrating various systems
  • Consult with users, determine requirements and make design recommendations. Educate and support onboarding of new team members
  • Strong Linux system administrator skills
  • Excellent knowledge of Hadoop architecture and administration and support
  • Proficient in YARN,SPARK, Zookeeper, HBASE, HDFS, Pig, Hive, Sqoop, Flume
  • Python, and shell scripting; experience with Chef a plus
  • Expert understanding of ETL principles and how to apply them within Hadoop
  • Be able to read java code, and basic coding/scripting ability in Java, Perl, Ruby, C#, and/or PHP
  • Experienced with linux system monitoring and analysis
  • Customer service experience / strong customer focus
  • Strong multi-tasking skills
  • Strong analysis and troubleshooting skills and experience
  • Self-starter who is excited about learning new technology
  • Databases (MySQL, Oracle, MSSQL)
  • Exposure to Virtualization
  • Exposure to security concepts / best practices
  • 1+ years MPP and/or HADOOP administration experience
  • 3+ years UNIX experience
  • 1+ years Shell scripting
  • 1+ years data analytics experience
  • 5+ years Application Administration experience
  • MapR experience
  • Hortonworks experience
  • Websphere administration experience
  • Any Hadoop distribution experience
  • Any MPP appliance experience
  • Experience delivering presentations to senior leadership
20

Hadoop Engineer Resume Examples & Samples

  • BS or MS degree or equivalent experience relevant to functional area
  • Excellent Communication skills, both written and interpersonal
  • 5 years of software engineering or related experience
  • At least 2 years of experience with Hadoop components, including hdfs, hbase, spark and kafka
  • Experience of maintaining and tuning live production systems
  • Proficient with Java and Python
21

Hadoop Engineer Resume Examples & Samples

  • Hadoop experience (hive, impala, spark, kafka, YARN .) They don't need experience with all of these but hsould have worked with at least 3 of them
  • Unix Background
  • Hadoop security knowledge - LDAP, Century or century roles
  • Any application architecture experience is a bonus.**
22

Senior Hadoop Engineer Resume Examples & Samples

  • Hands on experience with HDFS, Map Reduce, Spark, Hive, Airflow, Impala or similar technologies
  • Research, evaluate and utilize new technologies/tools/frameworks around Hadoop and AWS eco system
  • Excellent scripting skills in one or more (Java Script, Shell, Python etc.)
  • Strong understanding of Hadoop architecture with AWS
  • Build libraries, user defined functions and frameworks on Hadoop eco system
  • Implement automated testing for data transformation ensuring high quality for data integrity and consistency
  • Execute all components of product testing such as functional, regression, end to end testing, performance & load testing and Failure mode testing
  • Experience with performance/scalability tuning, algorithms and computational complexity
  • Proven ability to work cross functional teams to complete solution design, development and delivery
  • MS/BS degree in Computer Science or related discipline
  • 6+ years’ experience in large-scale distributed application development
  • 2+ year enterprise experience in Hadoop development
23

Hadoop Engineer Resume Examples & Samples

  • Enhances traditional data warehouse environment with Hadoop and other next generation Big Data tools
  • Provides expertise on database design for large, complex database systems using a variety of database technologies
  • Installs and configures Big Data servers, tools and database
  • Analyzes new data sources identified for the Enterprise Data Warehouse
  • Develops ETL requirements for extracting, transforming and loading data into the Data Warehouse
  • Creates ETL functional specifications that document source to target data mappings
  • Coordinates and collaborates with end users and business analysts in identifying, developing and validating ETL requirements
  • Requires a bachelor’s degree or equivalent
  • Requires at least 2-4 years of experience in a large Data Warehouse environment using Hadoop, HBase, Hive, Impala, Spark, Pig, Sqoop, Flume and/or MapReduce
  • Exposure to Teradata Data Warehouse environment
  • Data modeling and database design experience
  • Experience in providing IT applications development and systems implementation services to federal customers
24

Hadoop Engineer Resume Examples & Samples

  • Hadoop experience with applications including: hive, impala, spark, kafka, YARN
  • Unix Background - Administrative/Engineering
  • Hadoop security knowledge with LDAP, Century, century roles, or LDAP/Active Directory
  • Core Java, Shell, Python scripting experience
25

Senior Hadoop Engineer Resume Examples & Samples

  • Bachelors in computer science, or related technical discipline with a Business Intelligence and Data Analytics concentration
  • Passion for big data and analytics and understanding of Hadoop distributions
  • Good understanding of architecture and design principles
  • Exposure to new cloud technologies/tools/frameworks, particularly AWS
  • Exposure to streaming technologies like Kafka, AWS Kinesis etc
  • Experience in programming languages like Java, Python, SQL
  • Knowledge of statistical analysis and machine learning is nice to have
  • Build data pipelines using Hadoop ecosystem components such has Hive, Spark & Airflow
  • Automate Analytic platform solutions hosted in AWS, leveraging AWS managed services of EMR, S3, Lambda, KINESIS, SNS & SQS
  • Leverage your SQL, Python, scripting skills in a distributed computing environment
  • Build secure and highly available software solutions for high-performance, reliability and maintainability
  • Work in a collaborative environment that rewards innovation, problem solving and leadership
  • Implement full DevOps culture of Build, Test automation with continuous integration and deployment
26

Senior Hadoop Engineer Resume Examples & Samples

  • Excellent scripting skills in one or more (Java Script, Shell, Python, etc.)
  • Build libraries; user defined functions and frameworks on Hadoop eco system
  • Build continuous integration and test-driven development environment
  • Experience with performance/scalability tuning, algorithms, and computational complexity
  • Proven ability to work cross functional teams to complete solution design, development, and delivery
  • Experience with Machine Learning algorithms
  • Statistical analysis with R, Python or similar
  • Experience with NoSQL & Columnar Databases technologies such as Cassandra, Redshift/Hbase
  • Experiences with messaging & Complex event processing systems such as Kafka, Storm, and Spark
27

Hadoop Engineer Videa Resume Examples & Samples

  • Design and build systems that ingest, clean and transform data for use by our data scientists and their models
  • Ownership of a system that is the core of our data products by providing day-to-day production support of this Hadoop infrastructure
  • 3+ years experience with Hadoop and Spark in particular
  • Proven ability at architecting scalable, high performance systems
  • Prior experience with machine learning algorithms and their implementations
  • Enthusiasm to work in a fast-paced team
28

Hadoop Engineer Resume Examples & Samples

  • Lead existing and emerging technology and development processes, ensuring that technologies and processes are aligned with the goals and strategies of the BB&T business strategy
  • Develop/invent highly innovative solutions within multiple technologies, theories and/or techniques that impact IT strategy
  • Identify and develop revolutionary business opportunities with significant impacts on the direction of IT Services and BB&T’s financial results
  • Build strong partnerships with senior management to drive development of BB&T’s strategy across IT and other functions
  • Bachelor’s degree in Information Systems-related curriculum, or equivalent education and related training
  • Business acumen and effective communication skills
  • Ability to create change
29

Hadoop Engineer Resume Examples & Samples

  • Understanding and hands on technical expertise of Insert data, building extracts and services layers to/from Hadoop / Impala data ecosystem for third-party analytics solution integration
  • Design a solution to enable other team members enable the Cloudera platform and help configure the platform
  • Proven data manipulation skills (SQL applied to Oracle and DB2 databases, scripting languages, Big Data related technologies)
  • The drive to deliver on commitments and an openness to new ideas
  • 6-8 years of experience in IT Industry and 4+ years of experience in Big data platforms, Information delivery, Analytics and Business Intelligence based on data from Cloudera Hadoop
  • At least 4 year hands-on working experience with the following technologies: Hadoop, Mahout, Pig, Hive, HBase, Sqoop, Zookeeper, Ambari, MapReduce
  • Proven track record of architecting, designing, developing, implementing and maintaining large scale Cloud Data Service technologies and processes
  • Understanding of the benefits of big data ecosystem, data warehousing, data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design, data modeling, reporting process metadata, and ETL processes
  • Experience with Netezza architecture and migrations to Hadoop stack is a must
  • Experience with Data Integration on traditional and Hadoop environments
  • Experience working with commercial distributions of HDFS, preferably Cloudera
  • Experience with Hadoop Cluster Administration and performance tuning
30

Hadoop Engineer / Developer Resume Examples & Samples

  • 3+ years of direct experience in a big data environment specific to engineering, architecture and/or software development for a large production environment
  • Possess strong research, analytical and problem solving skills required to work with Petabytes or even Exabytes of data
  • Proven experience in a Hadoop ecosystem to include
31

Hadoop Engineer Resume Examples & Samples

  • Responsible for creating scripts in order to automate tasks within the client's environment
  • Build and upgrade the clients existing big data environment
  • Troubleshoot, patch, maintain, and secure the clients Hadoop environment
  • Provide the highest escalated level of support within the clients environment
  • Work closely with the vendor, Cloudera, to make sure the environment is running properly
  • Help plan, build, and run deployments and additions to the clients existing cloud environment
  • Ability to script for cron jobs
  • Experience supporting a Hadoop environment with over 50 nodes
  • Experience with Hadoop Administration
32

Hadoop Engineer Resume Examples & Samples

  • Responsible for implementation and ongoing administration of Hadoop infrastructure
  • Aligning with the systems engineering team to select, install, and upgrade software
  • Mentor other team members with performance tuning and tools
  • Support any process that needs attention in production environment
33

Senior Hadoop Engineer Resume Examples & Samples

  • Strong analytical and problem solving skills, fast and eager learner, solid foundation in data structures and algorithms
  • Algorithmic analysis skills and ability to design with various time/space/quality/latency trade-offs
  • Exposure to batch algorithms/systems such as Hadoop, Hive, Scalding, Map Reduce
  • Experience with scripting in Scala/Python etc
  • BS + 6 years, MS + 4 years, PhD + 1 year of work experience in a similar role
  • Ability to navigate and work through ambiguity
  • Proven experience to complete complex projects from start to end
  • Proven background in Distributed Computing, Data Warehousing, ETL development, and large scale data processing
  • Strong functional programming skills in Scala/ML/Haskell/Lisp etc
  • Background in statistics, hypothesis testing etc
  • Knowledge of Spark, Storm, Kafka, NoSQL databases
  • Good testing practices (unit, integration, system) with automation
  • Company Summary
34

Hadoop Engineer, Principal Resume Examples & Samples

  • Administrating, monitoring and tuning an existing Hadoop Clusters
  • Providing hardware architectural guidance, planning and estimating cluster capacity, and creating roadmaps for Hadoop cluster deployment
  • Installing and/or Upgrading Cloudera Distribution of Hadoop
  • Manage extracting, loading and transforming data in and out of Hadoop, primarily using HIVE, IMPALA
  • Participate 24/7 on-call rotation schedule
  • 10 years of previous UNIX working experience
  • 3+ years of experience working with administrating Hadoop and Hive echo system
  • Proficient with Linux shell scripting
  • Familiarity with YARN, IMPALA, Sqoop, Pig
  • On-call production support experience
  • Flexible working hours are required to support the platform
35

Hadoop Engineer Resume Examples & Samples

  • BI Tool integration with Hadoop
  • Experience with database replication and scaling
  • Linux (RHEL) proficiency a must
  • Scripting experience
  • Must posses good analytics and problem solving skills
  • Must be willing to work flexible hours
36

Senior Hadoop Engineer Resume Examples & Samples

  • Create an innovative environment in which experimentation is welcomed and new solutions can be quickly implemented and iterated, while still maintaining a high level of quality
  • Lead B2B (business-to-business) big-data analysis effort, working closely with our corresponding team in Strategy to establish data management and analysis best practices
  • Minimum of 5 years of years of Object-Oriented programming experience with a minimum of 4 years of Java experience, and 3 years of Hadoop experience
  • Must demonstrate strong, proven knowledge of Hadoop and related technologies , specifically deep insights into Spark, Hive, Sqoop and Pig, as well as a workflow tool like Oozie or AirFlow
  • Solid general development skills, with proven experience working on complex big data systems as well as general database technologies like Oracle, and NoSQL databases like Cassandra or similar
  • Experience must include web services and RESTful APIs, processing of time series analytics using Druid or similar, working in a cloud environment like AWS and devops tasks on Linux, working in an Agile environment
  • Must demonstrate exceptional troubleshooting and strong architectural skills, and clearly and effectively describe this in both a verbal and written format