Software Engineer - Big Data Engineering

San Francisco, CA

Who We Are:
As engineers on the Data Platform team, our mission is to build the fastest, most reliable, and largest-scale data processing technologies in the world - able to cope with ever-increasing volumes of data in real time - and then apply them to the company’s most critical and fundamental data problems.

What You’ll Do:

As a member of the team, you will be the “source of truth” for Twitter’s most fundamental data - such as Tweet content, engagement data, and user relationships - along with core metrics such as daily and monthly active users. You will surface these datasets in real time to mission-critical products and business applications throughout the company. You will be among the earliest adopters of bleeding-edge data technologies and features, working directly with infrastructure teams to integrate them into your services at scale. You will empower dozens of engineering teams, hundreds of co-workers, and millions of users to dream of new insights and new possibilities.

 

Data Platform is hiring for the following applications teams:

  • Core Metrics - pipelines that sift through tens of billions of events per day to power Twitter’s most critical business insights

 

Who You Are:

You want to be part of a community of the most talented, forward-thinking engineers in the industry. You take satisfaction in building resilient, performant, and thoroughly tested distributed systems that can power the most business-critical applications. You want to learn, work with, and contribute to cutting-edge open-source technologies. The ideal candidate has experience with and/or history of contributions to Hadoop, Spark, Hive, Scalding, Parquet, or similar technologies. You have experience in distributed systems, database internals, or performance analysis.

 

Requirements:

  • MS in computer science or a related field OR BS in computer science and 3 years of experience in software engineering.

  • Backend development experience with a solid foundation in data pipelines, distributed systems, large-scale data processing

  • Proficiency with Java, python or Scala

  • Experience with Linux/Unix systems

  • Working knowledge of MapReduce, Hadoop, HDFS

  • Experience with ETL and query language a plus

 

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran status, genetic information, marital status or any other legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Engineering Hiring Process

Step 1

Once your application is received, a recruiter will reach out pending your qualifications are a match for the role.

Step 2

If your background is a match, you may have 1-2 technical phone interviews or be given the chance to provide a work sample depending on the role.

Step 3

If the phone interviews go well or your work sample is strong, the final step includes interviews with 5-6 people held onsite in our office.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may select “Decline to Disclose”. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Twitter cares about your privacy and protecting your data.  Please click the privacy policy link and acknowledge you have read and understood how Twitter treats your privacy and your data.  

Applicant Data - You have a choice. Can we keep your personal data for both the job you are applying for and any other Twitter jobs that we feel you may be a match for? If you choose yes we will retain your personal data for a period of twelve months to consider you for other job opportunities at Twitter.
Analytics - May we use personal data from your resume and application to analyze and improve the Twitter hiring experience.
Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.