Software Engineer - Data Pipeline

San Francisco, CA

Who We Are:

Twitter’s globally distributed, real-time communications network generates trillions of events and petabytes of data per day. As engineers on the Data Infrastructure team our mission is to build the fastest, most reliable, and largest-scale data processing technologies in the world - able to cope with ever-increasing volumes of data in real time - and then apply them to the company’s most critical and fundamental data problems.

What You’ll Do:

Data Pipeline team owns RPC services that simplify data discovery, data management, and job scheduling, as well as a GUI data portal that is the main entry point for discovering and managing data inside Twitter. You will make Twitter-scale data more discoverable and easy to manage for data scientists and engineers across the company. You will be expected to lead some efforts while offering support for others. You will collaborate to discover the best solutions. You will support your colleagues by reviewing code and designs. You will diagnose and solve issues in our existing systems and envision and build their successors.

Who You Are:

You want to be part of a community of the most talented, forward-thinking engineers in the industry. You are a strong Scala, Java, or C++ developer. You demonstrate clear and concise communication and data-driven decision-making.

You're passionate about learning or growing your expertise in some or all of the following:

  • Microservice Architecture
  • Metadata Management
  • Data Discovery
  • Data Pipelines
  • Job Scheduling
Experience with any of the following is a plus:
  • Full Stack Development
  • React
  • Ruby on Rails
  • MySQL

Applicants will be considered for this role at all levels from SWE I to Staff depending on qualifications.

Requirements:

  • BS, MS, or PhD in computer science or a related field, or equivalent work experience

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran status, genetic information, marital status or any other legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

 

Hiring Process

Step 1

After you apply, a recruiter may reach out to you for an introductory call.

Step 2

If your background is a match for the role, you may phone interview with 1-2 people.

Step 3

If you continue through the process, you will come onsite 1-2 times to interview with a total of 5-10 people.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may decline to disclose. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.