Software Engineer - Data Infrastructure


Who We Are:

The Data Infrastructure organization provides Twitter’s internal data platform. The technologies we work on include Hadoop, Scribe, Flume, Scalding, Cascading, Summingbird, Parquet, Spark, Presto, Hive, Heron, Zeppelin, and many others. Several of these technologies were originally developed at Twitter and we actively contribute to open source for many others. We operate at substantial scale, with multiple Hadoop clusters of 10k+ nodes each, hundreds of Petabytes of data, trillions of log messages arriving daily, and tens of thousands of jobs executed each day. We are focused on providing world-class tools to our internal customers. We are investing heavily in the privacy and security of our platform. We are also in the process of embracing a hybrid cloud model by migrating some of our use cases to Google Cloud Platform. These recent investments have driven significant growth in our organization and we are looking for engineers at all levels to join a new team in Bangalore to build next-generation Analytics Infrastructure.

Who You Are:

You want to be part of a community of the most talented, forward-thinking engineers in the industry. You want to learn, work with, and contribute to cutting-edge open-source technologies. The ideal candidate has experience with and/or a history of contributions to Hadoop, Spark, Hive, Scalding, Parquet, Airflow or similar technologies. You are a strong Java, Scala, or C++ developer. You have experience in distributed systems, database internals, Linux and networking fundamentals, or performance analysis

What You’ll Do:

Be part of the seed engineering team in Bangalore. You will be part of the team with end-end ownership of a large infrastructure. You get to define and influence engineering culture and help in growing Twitter Bangalore engineering.

You will help us solve some of our biggest challenges!

  • Evaluate, and onboard open source technologies
  • Build highly reliable, multi-tenant and secured infrastructure
  • Build new tools to achieve self-serve analytics for product and business teams
  • Understand how Twitter’s data is used and “what it all means”
  • Delight internal customers


Experience and Skills

  • Backend Engineering or Stack experience with 3+ years,
  • Experience in building and operating distributed backend systems in Java, Scala or C++
  • Strong design and architecture skills.
  • Bachelor's degree or equivalent experience in computer science, engineering, or other technical disciplines (MS/Ph.D. is a plus)

Preferred Qualifications & Ideal Candidates

  • Exposure to building systems for data analytics
  • Experience with working on open source software
  • Experience with orchestration engines like Apache Airflow, and Apache Oozie

Engineering Hiring Process

Step 1

Once your application is received, a recruiter will reach out pending your qualifications are a match for the role.

Step 2

If your background is a match, you may have 1-2 technical phone interviews or be given the chance to provide a work sample depending on the role.

Step 3

If the phone interviews go well or your work sample is strong, the final step includes interviews with 5-6 people held onsite in our office.


Personal Information

Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter cares about your privacy and protecting your data.  Please click the privacy policy link and acknowledge you have read and understood how Twitter treats your privacy and your data.  

Would you like to receive email communication from Twitter about career opportunities? You may unsubscribe at any time.
Applicant Data - You have a choice. Can we keep your personal data for both the job you are applying for and any other Twitter jobs that we feel you may be a match for? If you choose yes we will retain your personal data for a period of twelve months to consider you for other job opportunities at Twitter.
Analytics - May we use personal data from your resume and application to analyze and improve the Twitter hiring experience.
Thanks for applying!
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.