Senior Big Data Developer Job Description
Senior big data developer
provides programming services for maintenance and bug fixes for Microsoft SQL Server databases used by DISCS applications; this includes creating/updating DML scripts for data modification and creating/updating DDL scripts for data definition.
Senior Big Data Developer Duties & Responsibilities
To write an effective senior big data developer job description, begin by listing detailed duties, responsibilities and expectations. We have included senior big data developer job description templates that you can modify and use.
Sample responsibilities for this position include:
Develop in Big Data architecture, Hadoop stack including HDFS cluster, MapReduce, Hive, Kafka, Storm, Heron, Flink, Spark, Elasticsearch/Solr and NoSQL
Build and support scalable and durable data solutions that can enable self-service advanced analytics atHomeAway using both traditional (SQL server) and modern DW technologies (Hadoop, Spark, Cloud, NoSQL ) in a agile manner
Development in various languages including Java, R, Python, Bash, SQL
Technical design and development in Big Data Technology (Hadoop)
Develop, test and deliver highly performant and secure Java based Web APIs that leverage a customized Apigee Web Tier
Working in a cross-functional agile team you will be developing features end-to-end across the software stack and responsible for all non-functional capabilities
Drive technical ideas and collaborate across a diverse organization
Work seamlessly across the full-stack by utilizing UI frameworks, developing the server APIs, and interacting with distributed data processing systems like Hadoop, Spark, Presto
Migrate Data from relational databases to Hadoop HDFS
Hands on development in JAVA / Python
Senior Big Data Developer Qualifications
Qualifications for a job description may include education, certification, and experience.
Licensing or Certifications for Senior Big Data Developer
List any licenses or certifications required by the position: AWS
Education for Senior Big Data Developer
Typically a job would require a certain level of education.
Employers hiring for the senior big data developer job most commonly would prefer for their future employee to have a relevant degree such as Bachelor's and Master's Degree in Computer Science, Engineering, Science, Information Systems, Technical, Mathematics, Software Engineering, Computer, Information Technology, Computer Engineering
Skills for Senior Big Data Developer
Desired skills for senior big data developer include:
SQL
Data structures
Clustering
DDL/DML/DCL
Hive
Model Driven Development
OOAD
Optimization techniques and dynamic programming concepts
RDBMS/SQL fundamentals
Replication and failover
Desired experience for senior big data developer includes:
Ability and desire to learn and work independently in a team
Experience with Cloudera Hadoop vendor implementation
Experience working with global teams and leveraging global resources to accelerate, support and deliver solutions in multiple global regions Experience with Cloudera Hadoop vendor implementation (Sentry, Navigator)
Experience with XML, Web Services, HTML and data transformation
Development experience in JDBC or Hibernate
Experience with tools such as Git, Stash or SVN, Jenkins or Bamboo and JUnit
Senior Big Data Developer Examples
1
Senior Big Data Developer Job Description
Job Description Example
Our growing company is looking to fill the role of senior big data developer. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for senior big data developer
- Quickly learn new development languages if required
- Work in a very unstructured environment where activities and tasks change frequently
- Be a strong, committed, reliable team player
- Utilizing the latest technologies available, designing and building data solutions to meet business needs
- Constantly seek out better ways to do things, new tools, new technologies, new processes
- Work on both transformational and BAU projects delivering new value while also maintaining existing processes
- Work as part of a cross functional agile team responsible for end-to-end delivery of business needs
- Utilize DevOps to automate everything
- The individual will provide thought leadership and drive architecture and the design of Big Data Information Management & Analytics solutions
- Ensure alignment of the enterprise architecture and data management strategies with the business strategies and goals
Qualifications for senior big data developer
- Java, Core Java, Java EE
- Database - Oracle, DB2, NoSQL
- Strong commercial exposure with Hadoop / Pig / and or Cassandra
- Experience with Lean and/ or SCRUM development methodologies a plus
- Desire to learn, participate on diverse teams on exciting and challenging activities
- You are C# .Net Microsoft Certified or Sun Certified Java Programmer
2
Senior Big Data Developer Job Description
Job Description Example
Our innovative and growing company is looking to fill the role of senior big data developer. To join our growing team, please review the list of responsibilities and qualifications.
Responsibilities for senior big data developer
- Broad based experience in deploying data management solutions
- Identifies creative, technology-based opportunities to improve service, reduce costs, and increase revenues with business partners and vendors
- Work closely with business users at a technical and user level, to design and produce solutions
- Take part in reviews of work
- Become member of a product team that delivers applications to internal users
- Be part of the growing Hadoop community of 35+ specialist
- Design and implementation of software product (BigData related) including data models and visualisations
- Develop Big Data solutions on top of Hadoop and Teradata
- Development, testing and automation of developed solutions
- Write technical documentation including, but not limited to high level architecture diagrams
Qualifications for senior big data developer
- You have experience in distributed cache experience
- You are experienced in working within an Agile and or Scrum environment
- Ability to collaborate and share initiatives in developing and innovating technology analytics solutions
- Strong communication & problem management skill
- Knowledge of related open source products, notably Spark, Cassandra, Hadoop
- Knowledge in design patterns and object oriented and functional programming
3
Senior Big Data Developer Job Description
Job Description Example
Our company is growing rapidly and is hiring for a senior big data developer. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for senior big data developer
- Developing server-side applications with Big Data Technologies
- According to requirements and specifications
- Within established or defined quality and performance standards
- Within agreed upon delivery timelines
- If required, to lead a small team of Developers to work on development projects
- Participate in consultation with Development Leads in estimating effort for work assigned
- Participate in initiatives that improve processes and/or procedures that contribute to performance effectiveness and efficiencies
- Communicate work progress and all (work related) pertinent information in an accurate and timely manner to the Development Leads
- Possess a Degree in Computer Science, Software Engineering or equivalent
- At least 5 years of working experience in a commercial software development environment with at least the last 2 years in a senior technical position
Qualifications for senior big data developer
- Experience with state of the art development tools (Git, Gerrit, Bugzilla, CMake, Maven, Docker, …)
- Programming experience in Node.js
- At least 1+ years hands on Java development experience is required
- Development of algorithms using Scala, Python, Java on ML platforms such as Spark, H20
- High throughput (750k requests per second) at low latency (10s of ms)
- TBs of data moving across our data pipeline every hour
4
Senior Big Data Developer Job Description
Job Description Example
Our growing company is looking for a senior big data developer. Thank you in advance for taking a look at the list of responsibilities and qualifications. We look forward to reviewing your resume.
Responsibilities for senior big data developer
- Linux (Usage and Administration)
- Familiar with Open Source tools / Frameworks
- Software as a Service (SaaS) platform
- NoSQL databases, such as HBase, Cassandra, MongoDB • Performance and automated testing of Web Services
- The Data Engineer will design and develop components of big data processing, as part of an agile/scrum team
- The Data Engineer will help plan and implement methods to scale our product further
- Deploy and manage EMR, Redshift, and Dynamo DB services based applications on AWS
- Write regression tests for your own code using different programming languages
- Docker and Kubernetes
- Data pipeline engine
Qualifications for senior big data developer
- PBs of data constantly churning on our analytics platform
- Rapidly expanding global footprint
- Fast paced Ad tech, big data at massive scale ecosystem
- Masters in Mathematics, Physics, Computer Science or Informatics
- At least 7 years of professional experience outside academia
- Strong in mathematics and statistics
5
Senior Big Data Developer Job Description
Job Description Example
Our growing company is looking for a senior big data developer. If you are looking for an exciting place to work, please take a look at the list of qualifications below.
Responsibilities for senior big data developer
- Knowledge in MariaDB, or at least should have knowledge in RMDB (e.g, MySQL, Oracle)
- Preferable to have knowledge in Private Cloud platform (Openshift, Kubernetes, Docker)
- Familiar with Agile practice, especially to the Scrum Master role
- Establish Continuous integration and Release automation
- Good to know any Machine Learning technologies, models
- New application development and production application support
- Analyze, design, develop, test, and implement distributed applications as part of a systems development team
- Provide feedback on and adhere to delivery dates
- Design, develop and implement advanced algorithms and data pipelines that extract, classify and merge structured and unstructured data from multiple sources
- Participate in requirements and design workshops with our onshore team and clients
Qualifications for senior big data developer
- At least four years of professional experience outside academia
- Must have 2+ years of experience with REST or Web Services API development
- Experience with Social Media API level interactions
- Other Tech
- Bachelor's degree in Computer Science, Telecommunications, Electrical Engineering or related field preferred
- Very strong Unix/Linux skills