Software Engineer (Inference Tooling)- Experimentation Platform

The Position

As a software engineer on the PIE team, you will build the infrastructure that allows for consistent and powerful causal inference across a highly scaled experimentation platform. You'll work directly with numerous teams across the company to improve Twitter’s rate of innovation though a better understanding of our users.

Why it matters: The PIE team and our internal experimentation platform, Duck Duck Goose (DDG), are vital to driving rapid innovation at Twitter. Twitter runs hundreds of experiments every day to understand the causal impact of everything from UI changes to the deployment of new machine learning models. PIE makes this all possible!

What you’ll be doing:

  • Develop sophisticated libraries and tooling to enable accurate and highly scaled analysis of experiment results.  Design and implement cutting edge causal inference techniques and scale them across hundreds of experiments.

  • Work with cutting-edge technology like Dataflow and BigQuery to power Twitter’s analysis of experimentation results.

  • Participate in all phases of software development from architecture/design through implementation, testing, and on-call.

  • Work closely with Experimentation Data Science, Product DS and relevance engineering to solve challenging causal inference problems and build production grade implementations of those solutions.

  • Drive “Experimentation Culture” at Twitter. Be a part of leveling up experimentation and causal inference culture at Twitter.


What it takes:

  • 3+ years in a hands-on engineering role, writing and shipping high quality production code.

  • Experience with at least one modern programming language (e.g. Go, Python, JVM languages)

  • Experience with statistics and/or causal inference.  You don’t need to be an expert, but you should have enough understanding of key concepts to productively work with DS partners.

  • Experience debugging in a data-heavy environment (e.g. Hadoop, Spark).

  • Experience with software engineering standard methodologies (e.g. unit testing, code reviews, design documentation).

  • Bonus Points: Experience with GCP/Dataflow/BigQuery is a big plus.

Company Description

Who we are: Twitter serves the public conversation by encouraging people all over the world to connect, learn, debate, and solve problems together. We believe conversation can change the world, and that’s why Tweeps (that’s what we call Twitter employees) come to work every day.

The PIE team is responsible for Twitter’s experimentation methodology and implementation as well as visualization and analysis tools that help teams understand user behavior. We work with product, engineering, data science, design and senior leadership to help increase our rate and our quality of innovation. The team employs a wide variety of open-source technologies including Hadoop, Presto, Scalding, Summingbird, just to name a few.

We are a tight-knit and encouraging group that values diversity and loves working together. We want to maintain and increase our diversity so whoever you are and wherever you come from, if you are an outstanding engineer we would be honored if you applied!

Additional Information

We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.

San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records


Software Engineering, Data Science and Analytics


San Francisco, New York City, Boulder, Seattle, Remote US



U.S. Equal Employment Opportunity information (Completion is voluntary)
Non U.S. Equal Employment Opportunity information (Completion is voluntary)
Privacy and data