Data Labeling Specialist (Contract)

About Pinterest:  

Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you’ll be challenged to take on work that upholds this mission and pushes Pinterest forward. You’ll grow as a person and leader in your field, all the while helping Pinners make their lives better in the positive corner of the internet.

Our new progressive work model is called PinFlex, a term that’s uniquely Pinterest to describe our flexible approach to living and working. Visit our PinFlex landing page to learn more. 

Pinterest brings millions of people the inspiration to create a life they love. To help achieve that goal, we're looking for a talented Relevance specialist  to help us grow Pinterest internationally, focusing on content relevance. We need a self-motivated individual who is passionate about content quality  and thrive in a highly operational environment. As part of our product organization, you will be working with talented engineers, product managers, data scientists, and vendors to set up and run human evaluations from inception to delivery. This is a 6-month contract. The role is remote, with all meetings conducted via Video Conference. Home internet expenses are covered up to $50/month if needed. Easy access to the Bay Area is a nice to have should offices reopen in South Of Market (SoMA) San Francisco, CA. PST timezone preferred.

What you’ll do: 

• Create and test labeling guidelines and templates for internal stakeholders according to our best practices
• Localize labeling guidelines into several languages, leveraging our localization team 
• Train and test vendor crowd on labeling tasks
• Build ground truth data, propose and implement quality control processes to continuously improve the quality of our datasets.
• Report progress on labeling projects on a recurring basis. You will work with our labeling vendors  to ensure they deliver high quality data.
• Identify gaps, inconsistencies and areas of improvements in labeling guidelines and propose solutions 
• Provide data analysis reports on accuracy, labels distribution and recommendations

What we’re looking for: 

• 2+ years of experience in human judgment for machine learning working on search relevance or merchant review topics
• 2+ years of experience in quality assurance, survey design, experimental design and/or taxonomy/oncology
• Critical thinker, with an eye for detail and quality
• Proven experience working with large data sets and keeping the quality high
• Impeccable communication and relationship-building skills
• Awareness and understanding of tech industry standards and practices
• Avid user of Pinterest, with a solid understanding of our product

More about contract roles at Pinterest:

• This is a temporary contract position at Pinterest. As such, the contractor who fills this role will be employed either by our staffing partner (PRO Unlimited) or by an agency supplier partner, and not an employee of Pinterest.
• All interviews will be scheduled and/or conducted by the Pinterest assignment manager. When a finalist has been selected, PRO Unlimited or the agency supplier partner will extend the offer and provide assignment details including duration, benefits options and onboarding details.

#LI-REMOTE

Our Commitment to Diversity:

At Pinterest, our mission is to bring everyone the inspiration to create a life they love—and that includes our employees. We’re taking on the most exciting challenges of our working lives, and we succeed with a team that represents an inclusive and diverse set of identities and backgrounds.