This job has expired, please see additional jobs below
Big Data Analyst
Autodesk
San Francisco, CA, United States
Job Details - this job has expired, please see similar jobs below
Big Data Analyst
Location: San Francisco, CA- United States
Job ID: 18WD28972
Position Overview
Autodesk is looking for a Big Data Analyst in San Francisco, that will work on managing Big Data Platform, that includes collecting, storing, processing and analyzing of massive sets of data. The primary focus will be help choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be helping in integrating solutions with the architecture used across the company. We are looking for someone with experience running entire Big Data on AWS environments.
Reporting to the Manager of Data Services you will plan, build, tune, configure in a Big Data environment, and drill into challenging technical problems, research and conduct testing to improve existing Big Data environment.
Responsibilities
• Help to select and integrate any Big Data and frameworks required to provide requested capabilities
• Running entire Big Data on AWS environments
• Monitoring performance and advising any necessary infrastructure changes
• Work with your team to help understand requirement, evaluate new features and architecture and help drive decisions
• Participate in agile based projects with an objective of ensuring the change meets the team’s goals for quality, reliability, and supportability
• Key deliverables include the creation of a steady state support plan, performing test cases, creating appropriate documentation, ensuring proper monitoring, coordinating code promotion and validation, and the facilitation of team cross training sessions
• Propose solutions to optimize current environment and ensure new solutions are optimally designed by development or application architect team, as needed
• Design and implement security solutions to protect organization’s data
• Build collaborative partnerships with software architects, technical leads and key individuals within other functional organizations
• Own and manage technical debt and security vulnerabilities
• Efficiently deliver presentations to key customers and senior management
Minimum Qualifications
• At least 2+ years of experience in Big Data technologies
• AWS Skill set - EMR, Cloudwatch, Lambda, Kinesis, Kinesis firehose, API gateway, Gilue
• Experience in management of Hadoop, EMR and Spark Clusters
• Proficient with Hadoop and MapReduce, HDFS, EMR and Spark Technologies
• Running entire Big Data on AWS environments is “A must”
• Proficient in understanding and resolving complex distributed computing technical issues
• Ability to solve any ongoing issues with operating the cluster
• Good knowledge of Big Data tools such as Hive, Oozie, Hue, Sqoop
• Experience with Integration of Data from multiple data sources
• Experience on databases, such as Redshift and MySQL
• Knowledge in various ETL techniques and frameworks, such as Flume
• Good understanding of Lambda architecture, along with its advantages and drawbacks
• BS degree in Computer Technology or equivalent experience
Preferred Qualifications
• Strong customer service skills and an eagerness to excel
• Flexible, open mind, self-motivated
• Driven by quality, performance, and automation
• Excellent analytical and problem-solving skills
• Ability to work within a global team and coordinate activities with remote persons
• Being able to work independently
• Willing to propose ways for improvements
• Attention to detail and the ability to learn quickly
• Excellent written and verbal English
About Autodesk
With Autodesk software, you have the power to Make Anything. The future of making is here, bringing with it radical changes in the way things are designed, made, and used. It's disrupting every industry: architecture, engineering, and construction; manufacturing; and media and entertainment. With the right knowledge and tools, this disruption is your opportunity. Our software is used by everyone - from design professionals, engineers and architects to digital scientists, students and hobbyists. We constantly explore new ways to integrate all dimensions of diversity across our employees, customers, partners, and communities. Our ultimate goal is to expand opportunities for anyone to imagine, design, and make a better world.