Software Engineer - Twitter Cloud Infrastructure

New York, NY

From the team who built and deployed Twitter's first-ever compatible datacenter in AWS and GCP, our new mission is to provide the next generation of data analytics and data understanding at Twitter. Using the data from our advertising platform as our starting point, our goal is to make answering complex questions at Twitter as easy as asking them. We're going to start by taking the massive data sets we collect every day (along with all its history) and making everything fully queryable and searchable in seconds! And we're also going to build all the tools necessary to highlight issues well before they ever get a chance to turn into real problems for the business.

In our previous project, we learned that we could build technology that would effectively offload pager and infrastructure maintenance duties to the cloud, which gave our engineers more time to focus on building new solutions versus maintaining existing ones. Given the enormity of the task we face, we need you to help us design and implement the tools and services that will make it easier for Twitter to make more data-driven decisions than ever before!

What You'll Do:

This team has taken on a new role in Revenue Insights, so everything is brand new for us. So, here is a sampling of past projects we've completed:

  • Twitter Cloud Data Center (TCDC) - Created a replica of Twitter's data centers in both Amazon Web Services (AWS) and Google Cloud Platform (GCP). This allowed any Twitter service to run in the Cloud to support dynamic machine allocation and regional deployments.
  • Kafka-Mesos (https://github.com/mesos/kafka/) - Recently migrated Kafka to run on our Mesos cluster for easier management. Quickly became the most active committer to the project and took over ownership.
  • Data Center Manager (dcm) - A tool embracing “data centers as configuration”. It allows us to bring up an entire production-ready TCDC region in hours.
Current/Upcoming projects:
  • Query Service - Empower users to query data consistently from wherever it lives. We recognize that that customers will put their data in the places and tools that services them best and this will allow others to access data consistently regardless of where it's located.
  • Query Cache - Using Google's DataFlow and Beam, we will be aggregating BigQuery data in BigTable so that customers and clients will experience blazing speed when investigating their metrics.
  • Automatic Alerting - Will allow users to select the metrics that are important to them and display those metrics in dashboards when unusual trends occur.
What Else You Can Expect:

We believe that people are our strongest asset, and take special interest in each and every one of our engineers. You can expect a real investment in your professional growth, and a dedication to crafting a strong, sustainable career for you. Our teams are composed of highly talented and passionate 'A' players, and you’ll get the mentorship and coaching you deserve to hone your skills and expertise. Our vibrant culture and high expectations will kindle your passion and bring out the best in you!

In particular, we are an experienced team of senior engineers that work across batch, streaming, and serving systems to deliver solutions to a diverse set of problems here at Twitter. We move quickly and we expect to make an impact. If this describes your approach to writing software, apply to join us!

Who You Are:

  • Industry experience working in a distributed computing environment.
  • A strong passion for building tools and systems that enable other developers on your team to build great things.
  • Proven strengths in algorithms, complex data structures, and dynamic programming.
  • Previous experience with cloud server environments such as Amazon Web Services (AWS) and/or Google Cloud Platform (GCP).
  • Good understanding of continuous integration and a strong drive toward automation.
  • Good understanding of multi-threading, scaling, concurrency, caching, queuing, RPC, and distributed data storage.
  • Ability to thrive in a dynamic, fast-paced, collaborative, and high-growth environment.
  • Strong attention to detail.
For Bonus Points, You Would Also Have:
  • Experience administering production systems (preferably Linux) and a general awareness of DevOps best practices.
  • Experience with the Lambda architecture and different ways of implementing it.
  • Contributed / committed to a well-known open source project and/or interest in doing so in the future.
  • Demonstrated ability to excel in whatever you pursue (whether it's work, school, competitions, open source contributions, personal projects, etc. you've always stood out and succeeded).

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Engineering Hiring Process

Step 1

Once your application is received, a recruiter will reach out pending your qualifications are a match for the role.

Step 2

If your background is a match, you may have 1-2 technical phone interviews or be given the chance to provide a work sample depending on the role.

Step 3

If the phone interviews go well or your work sample is strong, the final step includes interviews with 5-6 people held onsite in our office.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may decline to disclose. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.