This job has expired, please see additional jobs below
Data Engineer
Viacom
New York, NY, United States
Job Details - this job has expired, please see similar jobs below
Overview and Responsibilities
The ideal candidate for this role would be an independent, self-motivated individual driven to build state-of-the-art data driven products with many of Viacom’s unique distributed data sources. We, the Data Strategy team at Viacom are looking to create be-spoke solutions and solve puzzles from the ever-changing social media industry.
Responsibilities
• Build distributed, high-volume data pipelines to power new product features based on analytics and machine-learning.
• Work in full-stack mode, moving fluidly between Python, Scala, Java etc.
• Build applications that are AWS ready.
• You’ve built your own highly fault-tolerant data pipelines from scratch, know what goes wrong, and have ideas for how to fix it.
• Join a tightly knit team solving hard problems the right way.
• Own meaningful parts of our service, have an impact, grow with the company.
• Develop, test and maintain data architectures to ensure data analysis readiness.
Basic Qualifications
• BS/MS/PhD in a STEM field
• You have built and operated data pipelines for real customers in production systems.
• You are familiar with social APIs and their limitations.
• You are fluent in several programming languages (Python, R, Scala, Julia, Java) and frameworks (Kafka, Storm, Hive, Redshift, Memsql).
• You’ve built your own data pipelines from scratch and have architected solutions for data science and analytics.
• You are knowledgeable about data modeling, data access, and data warehousing techniques.
• Have deep understanding, fluency and advanced application of modern data processing technology stacks i.e. Spark, Hadoop, MemSql ecosystem technologies, and others
• Deep understanding of NoSQL technologies including column family, graph, document, and key-value data storage technologies.
• Deep understanding of relational database technologies and database development techniques.
Additional Qualifications
• You enjoy wrangling huge amounts of data and exploring new data sets.
• You tend to obsess over code simplicity and performance.
• You want to work in a fast, high growth startup-like environment.