This job has expired, please see additional jobs below
Senior Software Engineer - Personalization Infrastructure
Entertainment & Media Industry Company
Los Gatos, CA, United States
Job Details - this job has expired, please see similar jobs below
The Personalization Infrastructure team builds scalable Machine Learning (ML) infrastructure to recommend videos for Company's 80+ million global users. Here are some examples of the types of things we work on:
• Build and operate generic workflow orchestration systems for Machine Learning pipelines
• Accelerate A/B Testing and Offline ML Experimentation platforms for personalized video recommendations
• Provide fast access to data snapshots of micro-services to enable offline experimentation with online data
• Put together best-of-breed open source solutions within the Company ecosystem primarily targeted to product discovery use cases
• Build and operate telemetry services and real-time/stream-processed data infrastructure for near-line/low-latency personalized recommendations
The Opportunity
We are looking for an experienced, talented and motivated Senior Software Engineer to work on one or multiple projects the team works on. One of the projects where we are looking to accelerate and take to the next stage is Meson, the workflow orchestration framework we are building to train daily production ML models for our video recommender systems. To learn more, read the recent Meson blog post and watch our talk at Spark Summit 2016. We plan to open source Meson in future. You will be expected to drive the requirements and own large components of the infrastructure and help throughout the development life cycle: architecture, design, implementation, testing and post-release support.
This is a great opportunity to enhance your cloud computing experience, work on the cutting edge of Big Data technologies like Apache Spark, and simultaneously gain intimate knowledge of Company products and services at high scale, all the while working for a unique and pioneering company that is redefining how video content is consumed globally. To be successful in this role, you must have outstanding software development skills, ability to learn fast, enjoy development in a functional language like Scala, and thrive working cross functionally with several teams. You will need to exhibit strong leadership and communication skills to successfully execute on the engineering and release priorities in a highly-dynamic low-process environment.
Minimum Qualifications
• Strong bias towards action
• 4+ years of experience with large-scale distributed systems, micro-services, high-scale web architecture
• BS/MS in Computer Science, Electrical Engineering or related field
• Strong Java and object-oriented development experience in production
• Excellent communication skills
Preferred Qualifications
• Experience working on Machine Learning Infrastructure at a web-scale organization
• Experience working with functional languages like Scala
• Experience building applications on Apache Spark
• Understanding of resource schedulers like Apache Mesos and Yarn
• Experience with Cloud Computing platforms like Amazon AWS
To learn more, here are some blog posts on the kind of work the team does: Time Travel for Feature Generation, Spark Streaming Resiliency andTrending Now on Company.
The Culture
Company culture is unique and is built on a strong foundation of Freedom and Responsibility. We provide an environment of autonomy and expect responsible and fast execution. High performance is not only noticed but required. You will get to work with some of the best and the brightest who will get you to lift your game up, allowing your to make a difference to the business in a meaningful way. We value people who thrive in such a dynamic and ever changing environment, and we try to keep process to a minimum, to get out of the way of the best. This is the kind of environment that we value at Company. You can learn more at Company Culture