Data Engineer, Data Science

San Francisco, CA

Who We Are:

Twitter users generate many terabytes of data every day; Twitter engineers run hundreds of experiments; Twitter Data Engineers build data pipelines and data processes that calculate metrics and scale increasingly sophisticated models of users and content.

The Data Science team at Twitter is at the intersection of all this data and strives to make it actionable to all business units around Twitter. Data Engineers work alongside Data Scientists analyze this data via observational analyses, trend analyses, modeling, and new measurement strategies. We also implement metrics to track the impact of new product experiments and more generally find ways to make very large scale data approachable to guide our decisions.


What You’ll Do:

Twitter has very large and complex datasets. As a Twitter Data Engineer you will build datasets and make them accessible to our partner teams by writing great production code to simplify the complexity. Your work will enable Product Managers and other decision-makers across the company to bring together insights and inform our product and strategy. In every decision that you influence, you will see the product improve and be more valuable to Twitter users.

We are trying to improve Twitter. To improve something, we need to be able to measure it. As a Data Engineer you will enable better measurements and ensure measurement accuracy so that we know where we are doing well and where we want to improve.


As such, you will:

  • Design, develop, and launch extremely efficient and reliable data pipelines to move data and to provide intuitive analytics to our partner teams.
  • Make Twitter-scale data more discoverable and easy to use for Data Scientists and Analysts across the company.
  • Collaborate with other engineers and Data Scientists to discover the best solutions.
  • Support your colleagues by reviewing code and designs.
  • Diagnose and solve issues in our existing data pipelines and envision and build their successors.


Who You Are:

You want to be part of a community of the most talented, forward-thinking Data Scientists and Engineers in the industry. You are a strong Scala or Java developer. You demonstrate clear and concise communication and data-driven decision-making.

You are passionate about learning or growing your expertise in some or all of the following:

  • Data Pipelines
  • Data Warehousing
  • Statistics
  • Metrics Development


Requirements:

  • B.S. and/or M.S. in Computer Science or a related technical field, or equivalent experience
  • 2+ years of experience in either data infrastructure or backend systems
  • Strong understanding of SQL
  • Broad knowledge of the data infrastructure ecosystem
  • Experience with Hadoop or other MapReduce-based architectures
  • Experience working with large data volumes
  • Good understanding of one or more of the following: Scala, C++, or Java


Experience with any of the following is a plus:

  • Scalding
  • Full Stack Development
  • Presto or Hive
  • Spark


Applicants will be considered for this role at all levels from SWE I to Senior SWE depending on qualifications.


We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran status, genetic information, marital status or any other legally protected status.


San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.



 

Engineering Hiring Process

Step 1

Once your application is received, a recruiter will reach out pending your qualifications are a match for the role.

Step 2

If your background is a match, you may have 1-2 technical phone interviews or be given the chance to provide a work sample depending on the role.

Step 3

If the phone interviews go well or your work sample is strong, the final step includes interviews with 5-6 people held onsite in our office.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may select “Decline to Disclose”. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Twitter cares about your privacy and protecting your data.  Please click the privacy policy link and acknowledge you have read and understood how Twitter treats your privacy and your data.  

Would you like to receive email communication from Twitter about career opportunities? You may unsubscribe at any time.
Applicant Data - You have a choice. Can we keep your personal data for both the job you are applying for and any other Twitter jobs that we feel you may be a match for? If you choose yes we will retain your personal data for a period of twelve months to consider you for other job opportunities at Twitter.
Analytics - May we use personal data from your resume and application to analyze and improve the Twitter hiring experience.
Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.