This job has expired, please see additional jobs below
Data Engineer
Spotify
Boston, MA, United States
Job Details - this job has expired, please see similar jobs below
What you'll do
• Continuously design, develop, and test data-driven solutions
• Work with state-of-the-art data processing frameworks and technologies
• Help drive the company-wide advancement of Spotify’s data infrastructure, tooling and processes
• Improve data quality through testing, tooling and continuously evaluating performance
• Collaborate with software engineers, ML experts and others
• Work in cross-functional agile teams to regularly experiment, iterate, and deliver on new product objectives with an end-to-end responsibility for your squad’s mission
• Work from our office in Boston, Massachusetts
Who you are
• You have a proven record of personally taking large data projects from ideation to implementation
• You have experience architecting and operating large data pipelines
• You know how to work with high volume heterogeneous data with distributed systems such as Hadoop
• You are an expert in one or more higher level JVM-based data processing frameworks like Crunch, Scalding, Storm, Spark and Dataflow (not just Pig/Hive/BigQuery/other SQL-like abstractions)
• You are knowledgeable about data modeling, data access, and data storage techniques
• You care about agile software processes, data-driven development, reliability, and responsible experimentation
• You are passionate about creating clean code and have a strong foundation in coding and building data pipelines
• You preferably have worked on open source or other data related projects