Senior Big Data Engineer Resume Samples
4.6
(80 votes) for
Senior Big Data Engineer Resume Samples
The Guide To Resume Tailoring
Guide the recruiter to the conclusion that you are the best candidate for the senior big data engineer job. It’s actually very simple. Tailor your resume by picking relevant responsibilities from the examples below and then add your accomplishments. This way, you can position yourself in the best way to get hired.
Craft your perfect resume by picking job responsibilities written by professional recruiters
Pick from the thousands of curated job responsibilities used by the leading companies
Tailor your resume & cover letter with wording that best fits for each job you apply
Resume Builder
Create a Resume in Minutes with Professional Resume Templates
CHOOSE THE BEST TEMPLATE
- Choose from 15 Leading Templates. No need to think about design details.
USE PRE-WRITTEN BULLET POINTS
- Select from thousands of pre-written bullet points.
SAVE YOUR DOCUMENTS IN PDF FILES
- Instantly download in PDF format or share a custom link.
IW
I Wuckert
Ima
Wuckert
8721 Kuphal Canyon
Philadelphia
PA
+1 (555) 118 9348
8721 Kuphal Canyon
Philadelphia
PA
Phone
p
+1 (555) 118 9348
Experience
Experience
Houston, TX
Senior Big Data Engineer
Houston, TX
Turner, Collins and Jakubowski
Houston, TX
Senior Big Data Engineer
- Executes on Big Data requests to improve the accuracy, quality, completeness, speed of data, and decisions made from Big Data analysis
- Work closely together with global tech, product and data science teams to develop new ideas, implement and test them, and measure success
- Manages various Big Data analytic tool development projects with midsize teams
- Work with the architecture team to define conceptual and logical data models
- Identifies and develops Big Data sources & techniques to solve business problems
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, andloading across multiple game franchises
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
Philadelphia, PA
MQM Senior Big Data Engineer
Philadelphia, PA
Kerluke Group
Philadelphia, PA
MQM Senior Big Data Engineer
- Work in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business
- Boards are created to provide oversight and guidance on a regular basis – providingsenior sponsorship and involvement throughout the lifecycle of a project
- Boards are created to provide oversight and guidance on a regular basis – providing senior sponsorship and involvement throughout the lifecycle of a project
- Developing data analytics, data mining and reporting solutions using Teradata Aster and Hortonworks Hadoop
- Teams manage cash – budgeting is not on an annual basis but provided to prove business value over multi-year horizons
- Teams manage cash – budgeting is not on an annual basis but provided to provebusiness value over multi-year horizons
- Working on projects that provide real-time and historical analysis, decision support, predictive analytics, and reporting services
present
Phoenix, AZ
Persmod Senior Big Data Engineer
Phoenix, AZ
Wilderman, Streich and Mraz
present
Phoenix, AZ
Persmod Senior Big Data Engineer
present
- Responsible for supporting and leading project tasks
- Contributes to the overall strategic vision, and integrates a broad range of ideas regarding implementation and support of ADE 2.0
- Design, deploy and maintain enterprise class security, network and systems management applications within an AWS environment
- Supports demos, conference room pilots, and Fit/Gap sessions and propose options to fill gaps through product configuration, BPR, customizations/extensions, or third-party products
- Works as member of a dynamic high performance IPT
- Frequent inter-organizational and outside customer contacts
- Develops and builds frameworks/prototypes that integrate big data and advanced analytics to make business decisions
Education
Education
Bachelor’s Degree in Computer Science
Bachelor’s Degree in Computer Science
Emory University
Bachelor’s Degree in Computer Science
Skills
Skills
- Ability to work quickly with an eye towards writing clean code that is efficient and reusable
- Strong knowledge with one or more scripting languages (python, bash/sed/awk)
- Strong communication and relationship building skills with a strong intercultural sensitivity
- Strong programming skills, strong IT background
- Ability to iterate quickly in an agile development process
- Ability to drive development of solutions, from architecture to design and development
- Ability to learn new technologies and evaluate multiple technologies to solve a problem
- Experience with data quality tools such as First Logic
- Excellent oral and written communication skills
- Ability to build prototypes for new features that will delight our users and are consistent with business goals
15 Senior Big Data Engineer resume templates
Read our complete resume writing guides
1
Senior Big Data Engineer Resume Examples & Samples
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, or loading across a broad portion of the existing Hadoop and MPP ecosystems
- Identifies gaps and improves the existing platform to improve quality, robustness, maintainability, and speed
- Interacts with internal customers and ensuresthat solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Leads a Scrum team of developers to ensure correct prioritization and delivery of key features within the Core Platform team, managing backlog grooming, sprint entries/exits and retrospectives
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
2
Senior Big Data Engineer Resume Examples & Samples
- Define technical scope and objectives through research and participation in requirements-gathering and definition of processes
- Gather and process raw, structured, semi-structured, and unstructured data at scale, including writing scripts, developing programmatic interfaces against web APIs, scraping web pages, processing twitter feeds, etc
- Design, review, implement and optimize data transformation processes in the Hadoop (primary) and Informatica ecosystems
- Test and prototype new data integration tools, techniques and methodologies
- Adhere to all applicable AutoTrader development policies, procedures and standards
- Participate in functional test planning and testing for the assigned application integrations, functional areas and projects
- Work with the team in an Agile/SCRUM environment to ensure a quality product is delivered
- Rapid response and cross-functional work to deliver appropriate resolution of technical, procedural, and operational issues
- A BS degree in Computer Science, related technical field, or equivalent work experience; Masters preferred
- Experience architecting and integrating the Hadoop platform with traditional RDBMS data warehouses
- Experience with major Hadoop distributions like Cloudera (preferred), HortonWorks, MapR, BigInsights, or Amazon EMR is essential
- Experience developing within the Hadoop platform including Java MapReduce, Hive, Pig, and Pig UDF development
- Working knowledge of Linux O/S and Solaris environments
- Experience with logical, 3NF or Dimensional data models
- Experience with data quality tools such as First Logic
- Experience with NoSQL databases like HBase, Cassandra, Redis and MongoDB
- Experience with Hadoop ecosystem technologies like Flume
- Experience with Netezza and Oracle
- Certifications from Cloudera, HortonWorks and/or MapR
- Knowledge of Java SE, Java EE, JMS, XML, XSL, Web Services and other application integration related technologies
- Familiarity with Business Intelligence tools and platforms like Tableau, Pentaho, Jaspersoft, Cognos, Business Objects, and Microstrategy a plus
- Experience in working in an Agile/SCRUM model
3
Senior Big Data Engineer Resume Examples & Samples
- Translation of complex functional and technical requirements into detailed architecture and design
- Developing code
- Reviewing code of others and providing feedback to continually raise the bar of engineering excellence on the team
- Diving deep into open source technologies like Hadoop, Hive, Pig, Hbase, and Spark to fix bugs and performance bottlenecks
- Submitting patches and improvements to open source technologies
- Mentoring other developers
- Bachelor’s degree or equivalent experience. Strong preference for Computer Science
- 6+ year's overall development experience and 3+ year's enterprise software experience
- Ability to work directly with scientists and business users to plan projects, track timelines and turn the ambiguous into specific goals and targets
- Experience with large distributed services is a plus as is building/operating highly available systems
- Experience leading the architecture of an open source messaging product is preferred
4
Senior Big Data Engineer Resume Examples & Samples
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, andloading across multiple game franchises
- Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
- Interacts with engineering teams across WB and ensuresthat solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Works directly with business analysts and data scientists to understand and support their usecases
5
Senior Big Data Engineer Resume Examples & Samples
- 3 years of OOD experience working on backend systems
- You have experience architecting highly scalable, highly concurrent and low latency systems
- You have experience with Big Data and NoSQL technologies like Hadoop, HBase, Cassandra, Hypertable, Storm, Flume, Pig and Hive
- You can adapt cutting edge technologies to enterprise requirements including high availability and disaster recovery
6
Senior Big Data Engineer Resume Examples & Samples
- Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem
- Build streaming and real-time data analytic pipelines
- Implement and configure big data technologies as well as tune processes for performance at scale
- Mentor and grow a team of big data engineers
- 3+ years of experience building large scale big data applications
- Experience with big data interactive query technologies like Spark, Impala, or Hive
- Proficiency in Spark and/or Scala
- Experience building Continuous Integration (CI)/Continuous Deployment(CD) systems
7
Senior Big Data Engineer Resume Examples & Samples
- A solid track record of architecting and designing large-scale high-throughput data solutions
- Expert knowledge about enterprise search engines based on Apache Lucence (Elasticsearch, Solr)
- Experience in a data standardization, data quality and data governance process implementation
- Experience with open source software and programming languages (Scala)
- Proven ability to research, assess and recommend architecture, technologies and vendors
- Ability to drive development of solutions, from architecture to design and development
- Ability to lead by example and mentor other developers
- Extensive years in data integration implementation/design
- Extensive years of experience in any Java/Scala/Python
- Extensive years in Hadoop ecosystem
- Extensive years in Hadoop data integration tools (Sqoop, Flume, Spark)
- Extensive years in Lucene based enterprise search tools (Elasticsearch, Solr)
8
Senior Big Data Engineer Resume Examples & Samples
- BS in Engineering or Computer Science or equivalent
- 4 or more years of experience Java or Scala
- 2 or more years of experience building large scale distributed system
- 1 or more years of experience in big data technologies (mainly Spark)
- 1 or more years of experience in RESTFul interfaces
- 2 or more years of experience with agile software development practice
- 2 or more years of experience in leading other SW developers Additional Prefer
- Experience with deploying large scale application in the cloud (AWS, GCP, Azure or other)
- 2 or more years of experience with SPRING framework - Excellent communication skills in English
9
Senior Big Data Engineer Resume Examples & Samples
- Lead Application Big Data Platform containing application generated data
- Key partner with Business Analytics team on advance analytics activities
- Ability to be hands-on and lead teams.
- Hands on Development
- Assesses readiness of technical solutions and hardware including systems, tools, technologies, and processes.
- Recommends, and enforces data and technical solutions, standards, and governance for the program/project and other technical measures.
- Acts as strategic leader with ability to influence, collaborate and deploy innovative technology solutions.
- Evaluate and ability to influence key technologies include: 1.Data LakeArchitecture, 2.Integration Services, 3.Application Database Services,
- Managing projects including planning, design, build, test, and deployment.
- Responsible for identifying technical trend opportunities for enterprise data and performance improvement; and in converting those opportunities into valued assets that exceed business goals and produce clear ROI.
- 5+ years –Database Design (MPP and Transactional) such as SQL Server, Oracle, DB2
- Excellent knowledge of Hadoop (Cloudera), EMR, DynamoDB (Cassandra), or similar solution
- Excellent oral and written communication skills
- Strong analysis and troubleshooting skills and experience
- Self-starter who is excited about learning new technology
- 2+ years Enterprise Data Architecture, Development, Data management experience
- Experience in BIG DATA (Hadoop stack preferred)
- Experience with Data Architecture: application, reporting frameworks, modeling, processing, availability and scalability
- Understanding of advanced architectural principles of Enterprise Data Management including master data management, modeling and architectural principles applied to Application Databases.
- Bachelor's degree in Information Science / Information Technology, Computer Science, Engineering, Mathematics, Physics, or a related field
- Strong knowledge of Linux system monitoring and analysis
- Expert knowledge of Hadoop 1 & 2 architectures and administration and support.
- Expert knowledge in Map-Reduce, Cascading, HBase, HDFS, Pig, Hive, Spark
- Strong knowledge of real time streaming frameworks and patterns. Such as experience with Kinesis, Kafka or equivalent solution.
- Good understanding of machine learning frameworks such as Spark MLib,Apache Mahout or equivalent.
- Strong core java or scala development experience and basic coding/scripting ability in Python, Perl, and/or Ruby.
- Extensive Database experience (MySQL, SQL Server, Oracle)
- Exposure to Virtualization (VMware, Xen, Hypervisor)
- Prior working experience with AWS - any or all of EC2, S3, Data Pipeline, Redshift, RDS, DynamoDB, EMR
- Exposure to security concepts / best practices
- Experience managing full application stacks from the OS up through custom application
10
Senior Big Data Engineer Resume Examples & Samples
- 7+ years of development experience developing production grade software
- Solid background in Object-Oriented Design and Programming
- Experience in different programming or scripting languages like Java, C++, Scala/Spark, Python, etc
- Experience implement robust ETL/ELT workflow in cloud computing environment
- Experience with Hadoop-based technologies such as MapReduce, Hive, Pig, HBase, Cassandra, noSQL databases
- Bachelor’s degree or M.S. degree in computer science, mathematics, statistics or bioinformatics or equivalent work experience
- Experience in statistical analysis/ machine learning/ predictive modeling is a big plus
11
Senior Big Data Engineer Resume Examples & Samples
- Knowledge of RDBMS, ETL and Data warehouse technologies
- Source control tools such as GIT, TFS, SVN
- Continuous integration tools such as Jenkins, TeamCity
- Testing frameworks like Junit, Scalatest, Mock testing
12
Senior Big Data Engineer Resume Examples & Samples
- Teams manage cash – budgeting is not on an annual basis but provided to provebusiness value over multi-year horizons
- Boards are created to provide oversight and guidance on a regular basis – providingsenior sponsorship and involvement throughout the lifecycle of a project
- Manage multiple big data infrastructures (Spark/Hadoop, Cassandra)
- Provide data model reviews / aid in data design for each startup
- Lead and coach incubation teams on cloud development best practices
- Contribute to the efficiency, effectiveness, and improvement of best practices as a thought leader
13
Senior Big Data Engineer Resume Examples & Samples
- Provides complex application solutions by identifying business requirements; researching potential solutions; making recommendations to meet end user business objectives
- Supports Information Systems Division (ISD) applications by coordinating responses to user questions and problems; overseeing research of service level functions (for example, performance, availability, reliability)
- Leads efforts to increase Information Systems Division (ISD) team effectiveness by identifying and implementing best practices; utilizing work review processes
- Manages product installation upgrades (for example, Information Systems Division (ISD) application solutions, third-party products)
- Participates in team projects by following Information Systems Development Life Cycle (ISDLC) processes; leading projects; creating and approving project plans
- Develops Associate capabilities by mentoring and teaching team members (for example, coding languages, scripts, documentation requirements, programming standards, DBMS technologies)
- Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders
- Models compliance with company policies and procedures and supports company mission, values, and standards of ethics and integrity
14
Senior Big Data Engineer Resume Examples & Samples
- Coach and develop junior data analysts and engineers
- Take lead in defining approaches to extracting and processing data for ad-hoc analyses
- Work with BBC online product teams to identify detailed data requirements - specifically data integration, data quality, data derivation and data transformation requirements
- Producing ad-hoc data extracts and reports on data from a wide variety of systems using tools such as SQL, Hive, Python and Tableau
- Support the Architecture and Engineering team with the ongoing design and development of the Single Customer View, including sourcing, assessing and integrating new data sources
- Work with the architecture team to define conceptual and logical data models
15
Senior Big Data Engineer Resume Examples & Samples
- Gather and process raw, structured, semi-structured, and unstructured data at scale, including writing scripts and developing programmatic interfaces against web APIs
- Design, review, implement and optimize data transformation processes in the Hadoop ecosystem
- Adhere to all applicable Cox Automotive Enterprise Data Platforms development policies, procedures and standards
- Work with the team in an Agile/Kanban environment to ensure a quality product is delivered
16
Senior Big Data Engineer Resume Examples & Samples
- You have a B.S. or M.S. Computer Science or related field, or equivalent experience
- 8+ years of development experience, 5+ years of experience in working on large-scale distributed systems
- Mastery of Linux or Unix – you understand the operating system internals, filesystems, databases, network, compiler also a plus
- Experience with modern distributed systems like Datastores (e.g. Cassandra), Messaging Systems (e.g. Kafka), and Resource Management Systems (e.g. Mesos)
- You are highly skilled at developing and debugging in at least one of these programming languages, C/C++, Java, Python or Go
- Experience with agile development methodology and test-driven development
- Willing to learn new technologies and take ownership. Should demonstrate owning components from conception to production
- Experience using telemetry and metrics to drive operational excellence
- You are passionate in building tools and automation to make operations more repeatable and robust
- You have experience with cloud computing platforms (e.g. AWS, Microsoft Azure, etc.)
- Strong communication and relationship building skills with a strong intercultural sensitivity
17
Senior Big Data Engineer Resume Examples & Samples
- BA/BS in Computer Science, Management Information Systems or equivalent degree
- 1-5 Years’ Experience
- Programming skills & experience in Java, C++, R, Perl, or Python
- Ability to handle multiple projects and multiple deliverables
- Work with company confidential information
- Teradata database and Aster/Hadoop experience
- MS degree in Computer Science, Management Information Systems or equivalent degree
18
Senior Big Data Engineer Resume Examples & Samples
- A seasoned and passionate engineer who enjoys challenging and interesting problems around big data volume, scale, performance, integration, and many others
- A seasoned professional with 5+ years of relevant experience who is excited to apply their current skills and to grow their knowledge base
- 3+ years Java development experience
- Successful track record of engineering Big Data solutions with technologies like HBase, Hadoop, Hive, Oozie, MongoDB
- Familiar with Agile methodology, test-driven development, source control management, and automated testing
- Desire to work in collaborative and fast paced agile environment
19
Senior Big Data Engineer Resume Examples & Samples
- Experience with major Hadoop distributions such as Cloudera (preferred), HortonWorks, MapR, BigInsights, or Amazon EMR is essential
- Experience developing within the Hadoop platform including Java, MapReduce, Hive, Spark, Python
- Experience with scheduling technologies such as Azkaban, Oozie, or Control-M
- Experience with Netezza, Oracle, SQL Server
- Experience with Hadoop ecosystem technologies like Flume, Sqoop, NiFi, Spark Streaming
- Knowledge of Java SE, Java EE, JMS, XML, XSL, Web Services and other application integration-related technologies
- Experience with NoSQL databases such as HBase, Cassandra, Redis or MongoDB
- Experience with Pig and Pig UDF development
- Familiarity with Business Analytics tools and platforms such as Tableau, Jaspersoft, Business Objects, MicroStrategy, Platfora, a plus
- Experience in working in an Agile/Kanban model
20
Senior Big Data Engineer Resume Examples & Samples
- Participate as a development team member in the agile (Scrum) process throughout the SDLC
- Participate in project planning sessions, working closely with business analysts and team members to analyze requirements and provide design recommendations for complex systems
- Design and develop new software or make modifications to existing complex software applications using disciplined processes, adhering to industry standards and best practices
- Drive selection, integration and deployment of big data tools/frameworks to provide required capabilities
- Take part in reviews of work (e.g. design and code reviews) and demonstrate software to all stakeholders
- Significant experience developing with MS SQL Server, including logical/physical design, stored procedures, functions, triggers and performance tuning
- Experience with reporting and BI tools (e.g., SSRS, Crystal, COGNOS, Business Objects, Jaspersoft)
- Ability to work independently and flexibility to multi-task and adapt to changing business needs
- Enthusiastic team player who is delivery-oriented, takes responsibility for the team’s success, and strives to continually learn and improve
- Knowledge of Model Driven Development
- Experience in the banking industry, especially in risk management
- Experience with Microsoft Azure
21
Senior Big Data Engineer Resume Examples & Samples
- 7-10 yeas of Technical Business experience – ETL experience
- 4-7 years of solid Hadoop experience – Sqoop, Pig, Hive…
- Bachelor’s degree in Information Science
- Technical understanding of Teradata, SQL, Data Stage, Hadoop, Unix Scripting
- Technical experience with big data visualization applications
- To be able to clearly articulate pros and cons of various technologies and platform
- To be able to benchmark systems, analyze system bottlenecks and propose solutions to eliminate them
- Big Data Specialist Willingness to learn new data movement concepts
- Build scalable, repeatable solutions for data ingestion
- Be able to document use cases, solutions and recommendations
- Be able to explain the work in plain language
- To be able to help program and project managers in the design, planning and governance of implementing projects
- To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution
- To be able to work creatively and analytically in a problem-solving environment
- To be a self-starter
- To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines
- To be able to work in a fast-paced agile development environment
22
Senior Big Data Engineer Resume Examples & Samples
- Implement data crunching processes while taking into account performance, scale, availability, accuracy, monitoring and more
- At least 3 years of industry experience in similar positions
- Experience with Java/Scala and the surrounding ecosystem (Gradle/Maven etc.)
- Thorough knowledge and experience with dynamic programming languages such as Python or Ruby
23
Senior Big Data Engineer Resume Examples & Samples
- Four years Enterprise Java experience developing server-side applications
- Expertise in writing complex ANSI SQL queries with Oracle, MySql, Postgres databases
- Experience with Hadoop - lambda architecture, streaming data ingestion, Apache Storm, YARN, SPARK, HIVE
- Three years of coding experience in an Agile/Scrum environment
- Three years systems development experience
- Three years coding experience
24
Senior Big Data Engineer Resume Examples & Samples
- Minimum Qualifications
- 7 years OR 5 years experience in information technology or related field within the past 7 years
- 5 years of development experience in Java
- 5 years of development experience in business intelligence tools
- 5 years of development experience in SQL technology
- 1 year experience leading a technical team
25
Senior Big Data Engineer Resume Examples & Samples
- Build and support scalable and durable data solutions that can enable self-service advanced analytics atHomeAway using both traditional (SQL server) and modern DW technologies (Hadoop,Spark, Cloud, NoSQL etc.) in an agile manner
- Support HomeAway’s product and business team’s specific data and reporting needs on a global scale
- Close partnership with internal partners from Engineering, product, and business (Sales, Customer Experience, Marketing etc.)
- 8+ years of EDW development experience including 2+ years in Big data space (i.e. building data pipelines in Hadoop), working with Petabytes of data
- Proven technical lead using technologies such as SQL server (or any relational DB), Hadoop, Cassandra, Sqoop, Oozie, Scala, Java, Python, Spark, Hive and Kafka (KStream and Kafka Connect)
- Experience with of all aspects of data systems (both Big data and traditional) including database design, ETL, aggregation strategy, performance optimization
- Capable of working closely with business and product teams to ensure data solutions are aligned with business initiatives and are of high quality
26
Senior Big Data Engineer Resume Examples & Samples
- A harmonious, informal, international and playful work environment
- Work with cool modern technologies, processes and consumer facing products
- Access to tools and resources to do your job
- Ability to join multiple internal interest groups in eBay in trending topics like Data Science, Mobile Development, Customer Experience and more
- Continuous Deployment of product changes to get rapid feedback about your work
- Being part of the eBay family, a company with a history and great potential
- Work closely together with global tech, product and data science teams to develop new ideas, implement and test them, and measure success
- Translate data science models and algorithms into cleanly coded data products
- Use your ETL and Big Data infrastructure knowledge to improve our data ingestion systems
27
Senior Big Data Engineer Resume Examples & Samples
- Lead the design, implementation, and continuous delivery of an insights data pipeline supporting the development and operation of DynamoDB service
- Actively participate in hiring talented people and assist in the career development of others both on and outside your team, mentoring individuals and helping other managers guide the career growth of their team members
- Demonstrate high levels of creativity and right judgments, most of the time
- Understand business context to decisions made within and across groups
- Maintain a current understanding of industry and technology trends
- Contribute to Amazon's Intellectual Property through patents and/or external publications
- Bachelor's Degree or higher in Computer Sciences or similar
- 3+ years of hands-on experience as a big data engineer
- Masters or PhD in computer science
- Experience in cloud services
- Experience with Hadoop, HBase, Spark, Kafka or similar technologies (strong plus)
28
Senior Big Data Engineer Resume Examples & Samples
- Hands-on experience with DevOps tools, automating engineering and operational tasks
- Highly knowledgeable and experienced with scripting languages like Puppet, Python, Perl, etc
- 3+ years of working experience in BigData technologies (Hadoop, Solr, Kafka and Flume)
- Big-data operations experience, especially in Kafka and/or Solr
- Solr and Search domain experience is highly preferred
- Experience with source control management such as Git and/or SVN
- Development experience in object oriented programming languages such as Java /Scala is preferred
- Expertise in troubleshooting complex OS, database, file system, network configuration, and application & web server issues
- Evangelize DevOps best practices
29
Senior Big Data Engineer Resume Examples & Samples
- Lead Application Big Data Platform containing application generated data
- Key partner with Business Analytics team on advance analytics activities
- Be hands-on and lead teams
- Assesses readiness of technical solutions and hardware including systems, tools, technologies, and processes
- Recommends, and enforces data and technical solutions, standards, and governance for the program/project and other technical measures
- Acts as strategic leader with ability to influence, collaborate and deploy innovative technology solutions
- Evaluate and ability to influence key technologies include: Data Lake Architecture, Integration Services, and Application Database Services
- Managing projects including planning, design, build, test, and deployment
- Responsible for identifying technical trend opportunities
- 5+ years - Database Design (MPP and Transactional) such as SQL Server, Oracle, DB2
- 2+ years of Enterprise Data Architecture, Development, and Data management experience
- Knowledge of MDM, Big Data, Reference Data, Data Integration, Metadata, and Data Standards
- Excellent knowledge of Hadoop (Cloudera), EMR, DynamoDB (Cassandra), or similar solution
- Experience in Big Data (Hadoop stack preferred)
- Experience with Data Architecture: application, reporting frameworks, modeling, processing, and availability and scalability
- Understanding of advanced architectural principles of Enterprise Data Management including master data management, modeling and architectural principles applied to Application Databases
- Strong knowledge of Linux system monitoring and analysis
- Expert knowledge of Hadoop 1 and 2 architectures and administration and support
- Expert knowledge in Map-Reduce, Cascading, HBase, HDFS, Pig, Hive, and Spark
- Good understanding of machine learning frameworks such as Spark MLib, Apache Mahout or equivalent
- Strong core Java or Scala development experience and basic coding/scripting ability in Python, Perl, and/or Ruby
- Networking experience (DNS, TCP/IP)
- Extensive Database experience (MySQL, SQL Server, and Oracle)
- Exposure to Virtualization (VMware, Xen, and Hypervisor)
30
Senior Big Data Engineer Resume Examples & Samples
- The Database team is looking for a creative individual with following skill set
- Minimum of 5-8 years experience in a professional software development team
- Experience with message brokering systems, especially Kafka
- Experience with NoSQL Technologies like MongoDB, CouchBase and Elasticsearch
- Experience with RDBMS Oracle, Vertica
- Aptitude to independently learn new technologies
- Strong process and data investigation skills across a variety of platforms and logging environments
- Skill full at managing project priorities, dependencies and deliverables
- Strong working knowledge with distributed systems preferred
- Strong knowledge with one or more scripting languages (python, bash/sed/awk)
- Experience with Git/SVN
- Strong Java Expertise - including but not limited to: Core Java, Multithreading, Networking (including non-blocking IO), JDBC, RMI
- Knowledge of JVM Internals, GarbageCollection and Concurrency
- Experience writing REST based services using Netty or similar frameworks
- Experience on JSON and AVRO
- Experience with JavaScript UI frameworks (AngularJS, ReactJS, etc.) is a plus
- Required Technical Skills
- RDBMS: Oracle, Vertica
- NoSQL DB: MongoDB, Elasticsearch, CouchBase
- OS: AIX, LINUX, Solaris
- Replication: Kafka, Golden Gate
- Languages: Java, Python, PL/SQL, SQL and Shell Scripting
31
Senior Big Data Engineer Resume Examples & Samples
- Knowledge of the Linux operation system (OS, networking, process level)
- Understanding of Big Data technologies (Hadoop, Hbase, Spark, Kafka, Flume, Hive, etc)
- Understanding of one or more object-oriented programming languages (Java, C++)
- Fluent in at least one scripting language (Shell, Python, Ruby, etc.)
32
MQM Senior Big Data Engineer Resume Examples & Samples
- Have a passion for Big Data technologies and a flexible, creative approach to problem solving.
- 3+ years of hands-on experience with the Hadoop stack (MapReduce Programming Paradigm, HBase, Pig, Hive, Sqoop, Shark and Spark) and key-value store technologies such as Cassandra
- 3 - 5+ years experience in Java programming
- Have a solid track record of building large scale systems utilizing Big Data Technologies
- Experience building large-scale server-side systems with distributed processing algorithms
- Proficiency in MapReduce development and experience with Hadoop or other data processing technologies required
- Supporting Hadoop developers and assisting in troubleshooting and optimization of map reduce jobs and Pig Latin scripts
- Provide hardware architectural guidance, planning, estimating cluster capacity, and creating roadmaps for Hadoop cluster deployment
- Deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance
- Excellent experience in design and development of large scale applications
- Experience with Kafka and Storm is a plus
- Excellent problem solving and programming skills; proven technical leadership and communication skills
- Plus: Have made active contributions to open source projects like Apache Hadoop or Cassandra
33
Senior Big Data Engineer Resume Examples & Samples
- Analyze and propose data anomalies for data cleansing, data discovery and profiling
- 4 + years experience working (development/administration) with Hadoop, Cloudera, HIVE, NoSql data platforms (Cassandra, MongoDB), Pub/sub messaging (Rendezvous, AMPS, Kafka, etc.), Stream processing (Storm, Spark Streaming, etc.)
- Strong knowledge of distributed systems and asynchronous architectures
- Prior experience building visualization and UI
34
Senior Big Data Engineer Resume Examples & Samples
- Work with the platform team to identify, evaluate and implement NoSQL storage solutions
- Design strategies for storing structured and unstructured data
- Write code in a variety of languages
- Assist in architecting and deliver software components
- Author and maintain technical specifications
- Bachelor's or Master's Degree in Computer Science, Software Engineering or related field
- 3+ Experience implementing solutions built on NoSQL database technologies systems (HBase, Hadoop, DynamoDB , MongoDB, etc…)
- 5+ years professional experience designing and developing Java applications
- 3+ years of experience developing and working on big data platforms leveraging services like Dynamo, Redshift, Lambda , Kinesis and EMR
- Experience working with large data sets
- Big Data concepts such as map reduce,
- Deep understanding of one (or more) of the following languages: Scala, Python and Java
- Experience implementing and using RESTful APIs
- Experience with source control, build systems, and testing tools
- Excellent communication and collaboration skills
- Ability to work from our Boston office
- Experience with a big data database management system (e.g. Cassandra, HBase)
- Experience running and administering applications on Amazon Web Services
- Experience working with Amazon Web Services (AWS) and cloud management tools
- Prior experience building ETL systems
- Experience with Spark and R
- Experience working in an agile environment (Scrum, Kanban, etc.)
35
Senior Big Data Engineer Resume Examples & Samples
- Design, develop, and operate highly-scalable, high-performance, low-cost, and accurate data pipelines in distributed data processing platforms with AWS technologies
- Recognize and adopt best practices in data processing, reporting, and analysis: data integrity, test design, analysis, validation, and documentation
- Keep up to date with big data technologies, evaluate and make decisions around the use of new or existing software products to design the data architecture
- Bachelor’s degree in Computer Science, Electrical Engineering, Information Systems, Mathematics, or a related field
- Ability to work and communicate effectively with developers and Business users
- 6+ years of experience in designing and developing analytical systems
- 3+ years of experience in designing and developing data processing pipelines using distributed computing technologies such as Hive, Spark, and Pig
- Proficiency with Linux/Unix systems
- Experience with AWS technologies such as EMR, Dynamo, RDS, Redshift, S3, etc
- Experience with big data technologies such as Hadoop, Hive, Hbase, Pig, Spark, etc
36
Senior Big Data Engineer Resume Examples & Samples
- Teams manage cash – budgeting is not on an annual basis but provided to prove business value over multi-year horizons
- Boards are created to provide oversight and guidance on a regular basis – providing senior sponsorship and involvement throughout the lifecycle of a project
- Source, extract, transform & load datasets into Atlas’ infrastructure
- Build scalable and flexible data model that can work across our datasets
- Look for “signal in the noise”: How can we use datasets for new insights?
- Coach other incubations on cloud development best practices
37
Senior Big Data Engineer Resume Examples & Samples
- Keep up to date with advances in data persistence and big data technologies and run pilots to design the data architecture to scale with the increased data sets of advertiser experience
- Skilled in presenting findings, metrics and business information to a broad audience consisting of multiple disciplines and all levels or the organizations
- Experience with Java and Map Reduce frameworks such as Hive/Hadoop
38
Senior Big Data Engineer Resume Examples & Samples
- Design and implement key components for highly scalable, distributed data collection and analysis system built for handling petabytes of data in the cloud
- Analyze and support requirements from machine learning specialists, focusing on the most important topics in the rapidly evolving automotive industry
- Move architecture and implementation through the automotive development pipeline, from research to deployment in millions of cars on the road
- Work with architects from other divisions contributing to this analytics system and mentor team members on best practices in backend infrastructure and distributed computing topics
- Strong programming skills, strong IT background
- Hands-on development with key technologies including Scala, Spark, and other relevant distributed computing languages, frameworks, and libraries
- Experience with distributed databases, such as Cassandra, and the key issues affecting their performance and reliability
- Experience using high-throughput, distributed message queueing systems such as Kafka
- Familiarity with operational technologies, including Docker (required), Chef, Puppet, ZooKeeper, Terraform, and Ansible (preferred)
- An ability to periodically deploy systems to cloud environments such as AWS
- Mastery of key development tools such as GIT, and familiarity with collaboration tools such as Jira and Confluence or similar tools
- Experience with the SMACK stack (Spark, Mesos, Akka, Cassandra, Kafka) as a holistic system, and the important considerations for running this system at scale
- Experience or understanding of developing machine/deep learning systems in a distributed environment
- Conventional backend development experience with Java and common frameworks (Spring, Play)
39
Senior Big Data Engineer Resume Examples & Samples
- Integrate and aggregate complex data from multiple data sources and platforms that enhance customer access to information and promote a data driven culture
- Quickly assemble meaningful data sets where none are available to answer complex business questions. Own the BI technology stack; partnering with EDO to ensure the technologies and platforms Personal Lines relies on are available, stable, and delivering the necessary business value
- Liaison to enterprise technical partners in all matters concerning data management, data quality, and platform/servers that would impact Personal Lines
- Build and foster relationships with Personal Lines’s technical partners
- Contribute to or act as the Personal Lines Data Steward, monitoring data quality, evaluating the completeness and strategic soundness from a business perspective of any requested warehouse enhancements
- Subject matter expert in at least 2, preferably 3 of the following: Tableau(Desktop and Server), SAS, SQL, R, data warehouse concepts and architecture, agile software development, performance testing and tuning
- Takes on the role of subject matter expert for Personal Lines data and projects
- Technical knowledge: 3- 5years experience with various tools used for data exploration and business intelligence (e.g. Toad, SQL, Oracle, SAS, R, Business Objects, MSBI, Tableau, Qlik, MicroStrategy, Alteryx)
- Solid knowledge on ETL process
- Knowledge on Informatica is a plus
- Good understanding and experience with data modeling
- Advanced knowledge of SQL and data warehouse design and usage
- Experience in writing shell scripts and job automation thru Autosys scheduler
- Highly analytical person equally comfortable coding and interacting with business partners
- Ability to work effectively in a team environment and independently
- Strong written and verbal communication to interact effectively with both technical and non-technical users at all levels of the organization
- Must be able to work on multiple concurrent projects
- Entrepreneurial spirit - self-motivated, strong sense of ownership/accountability, and results oriented with the ability to manage time and schedules effectively
- Deals with issues in a proactive manner
- Accepts challenges and change
- Willingness to learn new technologies/methodologies and apply them
- Ability to understand and follow guidelines and standards
- Proven negotiation ability
- Customer focus: strives to give customers the best service and takes the initiative to add value
- Knowledge of Personal Lines data landscape
- Knowledge of server platforms(UNIX, LINUX, Windows) a plus
40
Senior Big Data Engineer Resume Examples & Samples
- BS in Computer Science, Engineering, or related technical discipline – or equivalent combination of training and experience
- 6+ years core Java experience: building business logic layers and back-end systems for high-volume pipelines
- Experience with Spark Streaming and Scala
- Current experience in Spark, Hadoop, MapReduce and HDFS, Cassandra/HBase
- Understanding of data flows, data architecture, ETL and processing of structured and unstructured data
- Experience with high-speed messaging frameworks and streaming (Kafka, Akka, reactive)
- Experience with DevOps tools (GitHub, Travis CI, JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development)
- Ability to work quickly with an eye towards writing clean code that is efficient and reusable
- Ability to build prototypes for new features that will delight our users and are consistent with business goals
- Ability to iterate quickly in an agile development process
41
Senior Big Data Engineer Resume Examples & Samples
- Minimum of 5+ years of IT industry experience in application development and technology evaluation
- Minimum of 2+ years of experience in developing and/or supporting NoSQL solutions
- Proficiency in UNIX / Linux operating systems
- Knowledge on MongoDB, DynamoDB (AWS) and/or MySQL is preferred
- Proficiency on Apache software foundation big data projects like Hadoop, Hive, Hbase, etc.,
- Ability to write applications using common developer scripting languages such as Shell, Perl, Python, Java, JavaScript etc.,
- Knowledge on standard web design patterns like REST, MVC, Ajax, etc.,
- Ability to handle large dataset in a Very Large DataBase (VLDB) environment
- Ability to understand relational database systems and its concepts
- Independently develop and sustain required technical knowledge, certification and skills
- Ability to work as a team
- Ability to work in multiple projects and cope up with tight deadline and time constraints
- Ability to freely express his/her own views and accept well known methodologies and design patterns
42
Senior Big Data Engineer Resume Examples & Samples
- Programming in a language such as Python (preferred), Scala, etc
- Programming in other open source tools such NIFI and Streamline for faster development
- Agile Experience
- Big Data Experience (SQL, Hadoop, Python)
- Auto-Insurance Experience (or ability to learn)
43
Senior Big Data Engineer Resume Examples & Samples
- Scalability, large-scale data processing, and ETL pipelines
- Java or Python
- NoSQL technologies, including Redis, Cassandra, HBase, and/or Hive
- Developing and deploying applications on Linux infrastructure; and
- MySQL and SQL
44
Senior Big Data Engineer Resume Examples & Samples
- MS Computer Science or other relevant technical degree and/or related experience
- Experience with Java or Scala build systems: maven, ant, sbt and gradle
- Experience with multiple Apache Hadoop / Spark ecosystem applications, like: Hadoop, Hive, Oozie, Pig, Presto, Hue, Spark, Tachyon, Zeppelin
- Recognized subject matter expertise in Hadoop or Spark and at least one other complimentary application
- Significant contribution to development for applications or services with a large user base
- Strong understanding of distributed systems and distributed computation
- Strong Java development experience
- Experience building and operating at scale on AWS
45
Persmod Senior Big Data Engineer Resume Examples & Samples
- Contributes to the overall strategic vision, and integrates a broad range of ideas regarding implementation and support of ADE 2.0
- Supports demos, conference room pilots, and Fit/Gap sessions and propose options to fill gaps through product configuration, BPR, customizations/extensions, or third-party products
- Design, deploy and maintain enterprise class security, network and systems management applications within an AWS environment
- Support of technology implementations from a technical perspective including experience with cloud based technologies, data cleansing and conversions, interface design/development, systems development life cycle, etc
- Frequent inter-organizational and outside customer contacts
- Hands-on experience with design, development and deployment of data warehouse solutions in the cloud
- Understanding and experience with IAAS, PAAS, SAAS delivery models and the current competitive landscape
- Knowledgeable in designing secure cloud solutions using AWS services like EC2, S3, IAM roles and policies, Auto scaling, Elastic Load Balancing, and VPC. Or similar experience with other leading cloud providers like Azure, Google Cloud etc
- Hands-on experience with cloud data warehouse platforms such as Amazon Redshift
- Highly proficient in coding/programming with strong design and architecture experience
- Proven experience with software development life cycle (SDLC) and agile/iterative methodologies required
- Great client facing skills with the ability to articulate complex technical challenges and communicate effectively with peers
- Master’s Degree in Engineering, Computer Science, Information Systems, or other related analytical, scientific, or technical disciplines; Relevant Experience: 10+ years. Equivalent experience can be substituted for educational experience
- Must hold an active DoD Secret Security clearance
- Knowledge of the primary AWS services (EC2, ELB, RDS, Route53 & S3)
46
Senior Big Data Engineer Resume Examples & Samples
- Executes complex and occasionally highly complex functional work tracks for the team. Drives the execution of operational/technical objectives for data analytic outputs and business solutions
- Partners with Allstate Technology teams on Big Data efforts
- Supports the Connected Car geospatial team in developing and scaling big data solutions in a geospatial context
- Partners closely with peers in the department to ensure holistic Big Data solutions for our data science community and analytic users
- Can identify new areas of data, research and big data technology that can solve business problems
- Leverages and uses Big Data best practices / lessons learned to develop technical solutions used for descriptive analytics, ETL, predictive modeling, and prescriptive “real time decisions” analytics
- Influences within the department on the effectiveness of Big Data systems to solve their business problems
- Is recognized as an expert in Big Data and is influential within the department
- Develops technical solutions using Big Data techniques in data & analytics processes
- Develops and builds frameworks/prototypes that integrate big data and advanced analytics to make business decisions
- Helps implement new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems
- Understands the Big Data related problems and requirements to identify the optimal technical approach
- Works with key team members to ensure efforts within owned tracks of work will meet their needs
- Drives multiple tracks of moderately complex and occasionally complex work within the research group
- Identifies and develops Big Data sources & techniques to solve business problems
- Co-mingles data sources to lead work on data and problems across departments to drive improved business & technical results through designing, building, and partnering to implement models
- Manages various Big Data analytic tool development projects with midsize teams
- Executes on Big Data requests to improve the accuracy, quality, completeness, speed of data, and decisions made from Big Data analysis
- Uses, learns, teaches, and supports a wide variety of Big Data and Data Science tools and programming languages to achieve results (i.e., R, ETL Tools, Hadoop, and others) (i.e. Python, Pyspark, Java, C#, and Perl)
- The development and execution of a communication strategy that keeps all relevant stakeholders informed and provides an opportunity to influence the direction of the work
- Helps select and develop team members
- 3 - 4 Years of experience or equivalent skills & ability
- Master’s or PhD preferred in a quantitative or scientific field such as computer science, computer engineering or equivalent experience
- Big Data and Data Science tools to achieve results (i.e., database and ETL technologies, R, Hadoop, and others)
- Experience with various data types (e.g. Relational, Unstructured, Hierarchical, Linked “Graph” Data)
- Proven ability to code and develop prototypes in languages such as Pyspark, Python, Perl, Java, C, R, SQL, XSLT. Environment is Pyspark
- Experience in software for the support of geospatial analysis (such as ArcGIS or Magellan) a plus
- Ability to communicate and present advanced technical topics to general audiences
- Leading project teams of various skills levels
- Understanding of predictive modeling techniques a plus
