Project Manager I, Human Computation

San Francisco, CA

Project Manager I, Human Computation


Our Customer Support and Operationss department aims to support, protect, and retain every user on the planet. Within Customer Support and Operationss,  the Human Computation program partners with Product, Engineering, and Policy to train and test machine learning models. Our work directly impacts the quality and consumption of our most popular products, helping to prevent the abuse and misuse of Twitter, and to delight our ever expanding global user base.


We’re looking for a dynamic team player who has a proven track record in driving high-impact projects/initiatives, training and managing vendors and vendor teams (e.g. both domestic and international), designing complex experiments, creating templates using HTML, CSS, and JavaScript, writing technical documentation, monitoring worker productivity & data quality, managing a wide variety of business resources, and effectively navigating a challenging, fast-paced, and dynamic daily working environment.

Responsibilities

Human Computation

  • Drive global team goals, priorities, and initiatives to ensure accurate qualitative measurements and consistent improvement across Twitter’s user-facing product suite.
  • Drive end-to-end project plans for new site build-outs, liquid workforce management, and internal tooling backlogs.
  • Work directly with Engineers, Data Scientists, and Product Managers to create and execute evaluations to label data to train and measure the precision of high-impact machine learning models.
  • Own accountability for efficiently and effectively fulfilling end-to-end Human Computation and other content review/human evaluation needs across key internal and external partners.
  • Write clear and concise documentation and obtain buy-in from leadership across a wide variety of stakeholder teams.
  • Drive impactful evaluations, build strong relationships with stakeholders, and quickly deliver results.
  • Review and/or process sensitive and potentially disturbing content including but not limited to pornographic images, child pornography, vulgar language, hate speech, violent threats, and other graphic images.
  • Build evaluation templates using HTML, JavaScript, and CSS.

People

  • Delegate labeling tasks across international and multi-vendor workforce solutions, in order to consistently exceed the expectations of our internal business partners.
  • Manage onboarding, offboarding, and sensitive access privileges of global contingent workforce.
  • Train, oversee, and own accountability for a 60+ person international and designated contingent team, large-scale and multilingual liquid workforce, and crowdsourced workforce.
  • Create and maintain exams that test contingent worker productivity and quality across 3+ global vendor teams.
  • Manage the day-to-day work of international vendor workforce.

Minimum Qualifications

  • BA or BS in Cognitive Science, Psychology, Statistics, or a related field.
  • Over 1 years of technical writing experience.
  • Over 1 year experience with HTML, XML, CSS, JavaScript, and SQL or specialized database query languages.
  • Over 1 year direct experience with human computation, crowdsourcing, or experimental design.
  • Excellent written and verbal communication skills, organizational skills, and highly developed interpersonal skills.
  • Active, passionate Twitter user with strong interest in social media.

Prefered Qualifications

  • Over 2 years experience working with large data-sets.
  • Over 2 years experience designing and implementing research experiments.
  • Over 1 year experience working with Python and/or R for analysis of large data-sets.
  • Proficiency in one or more non-English languages.


Hiring Process

Step 1

After you apply, a recruiter may reach out to you for an introductory call.

Step 2

If your background is a match for the role, you may phone interview with 1-2 people.

Step 3

If you continue through the process, you will come onsite 1-2 times to interview with a total of 5-10 people.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may select “Decline to Disclose”. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Twitter cares about your privacy and protecting your data.  Please click the privacy policy link and acknowledge you have read and understood how Twitter treats your privacy and your data.  

Would you like to receive email communication from Twitter about career opportunities? You may unsubscribe at any time.
Applicant Data - You have a choice. Can we keep your personal data for both the job you are applying for and any other Twitter jobs that we feel you may be a match for? If you choose yes we will retain your personal data for a period of twelve months to consider you for other job opportunities at Twitter.
Analytics - May we use personal data from your resume and application to analyze and improve the Twitter hiring experience.
Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.