Data Engineer -- Cortex - Boulder

Boulder, CO

Who We Are:

Cortex empower internal teams to efficiently leverage ML by providing a platform and by unifying, educating, and advancing the state of the art in ML technologies within Twitter. We win when our customers win by helping our users stay informed, share and discuss what matters; by serving the public conversation. We’re building an AI-first company and every major initiative is increasingly dependent on the successful application of machine learning. Cortex is at the nexus of this evolution.


Our team of ML software engineers is constructing one of the strongest machine learning platforms in the world, based on the latest ML industry practices, deep learning, engineering excellence, powered by Twitter data at scale.


Twitter data is the fuel for machine learning. Our Data Engineers build:

  • Systems to efficiently share, organize, discover features for ML models.
  • Easy-to-use libraries to access features in batch and serve them in real time.
  • Tools and dashboards to observe feature statistics over time.
  • Libraries to help for ML practitioners build efficient data pipelines for generating features in batch and in realtime.


Our tools enable ML engineers to leverage and operationalize Twitter data to improve their models. We care deeply about:

  • Engineering excellence such as good design abstractions, API stability, best practices and unit testing.
  • Staying abreast and compatible with a quickly shifting technology landscape for ML platform components and related open source solutions.
  • An exceptional developer experience for our customers.
  • Making the transition from offline hydration to online serving of features easy as models move from training to production.
  • An exceptional developer experience for our customers.


What You’ll Do:

If this sounds like a team you want to be part of, great! We are looking for engineers who love writing code, have a desire to learn new technologies, thrive on teamwork and are committed to serving their customers.


Your responsibilities include:

  • Building feature extraction, transformation and serving infrastructure.
  • Building batch and real-time, streaming data pipelines.
  • Designing elegant abstractions, shareable libraries, and robust APIs.
  • Adapting, extending and contributing to open source and third party solutions to seamlessly function within our toolchain.
  • Actively looking for ways to improve the end-to-end experience for developers across Cortex’s product portfolio.
  • Working closely with product managers, engineers and stakeholders across the company.
  • Shaping the direction of our toolchain and product portfolio.


Who You Are:

  • You have a passion for machine learning.
  • You wish to tackle hard product and engineering challenges working in concert with smart people.
  • You're excited to ramp up on new technologies to build awesome things with us!
  • You have the ability to take on complex problems, learn quickly, iterate, and persist towards a good solution.
  • You are adamant about studying customer needs and enabling their success through our products.
  • You take pride in polishing and supporting of our products.
  • You thrive on building platform tools for developers.
  • You are passionate about leveraging Twitter’s proprietary data for use in ML applications.


Requirements:

  • You have a sound grasp on OOP concepts, data structures and algorithms.
  • You have a disciplined approach to writing unit and integration tests.
  • You are rigorous in software design life cycle best practices (design docs, code reviews, support, Sprint planning, Agile methodologies).
  • You have working knowledge of Python and Java/Scala.
  • You understand distributed computing architectures.
  • You easily articulate complex concepts in writing and speech.
  • BS, MS, or PhD in Computer Science or equivalent work experience.
  • You have a proven understanding of Big Data technologies (e.g. Hadoop, Spark, Map/Reduce)


Nice to have:

  • Data science, statistics or modeling experience.
  • Familiarity with feature management solutions or data pipelines.
  • Streaming data compute engines, e.g. Kappa architectures, Apache Beam, Kafka Streams.


We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.


Engineering Hiring Process

Step 1

Once your application is received, a recruiter will reach out pending your qualifications are a match for the role.

Step 2

If your background is a match, you may have 1-2 technical phone interviews or be given the chance to provide a work sample depending on the role.

Step 3

If the phone interviews go well or your work sample is strong, the final step includes interviews with 5-6 people held onsite in our office.

Application

Personal Information

This field is required.
This field is required.
This field is required.
This field is required.
Required field. PDFs only; max file size is 1MB.
Required field. PDFs only; max file size is 1MB.

U.S. Equal Opportunity Employment Information  (Completion is Voluntary)

At Twitter, we have a bold aspiration to reach every person on the planet. We believe that goal is more attainable with a team that understands and represents different cultures and backgrounds and we are committed to an inclusive and diverse Twitter.

This is where you come in! Please take a few minutes to provide us with your information. You are not required to provide this information and you may decline to disclose. Your decision to provide information (or not) will not affect your employment or opportunities at Twitter.

Twitter is an equal opportunity employer. We do not discriminate based on race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status or any legally protected status.

You can view the ‘EEO is the Law’ poster here.

Twitter does not accept any unsolicited resumes from recruiting agencies and will not pay fees associated with any such resumes. Agencies, please do not send resumes to any Twitter location, employee, or email address.

Twitter, Inc. is committed to working with and providing access and reasonable accommodations to applicants with physical or mental disabilities. If you need an accommodation in order to apply for open job opportunities, please submit a description of your accommodation request to RARequest-Recruiting@twitter.com. This email is only for accommodation requests related to the application process.

Success
Thanks for applying!
Error
Submission failed. Please make sure all fields are correctly formatted.

Don't see the right fit?

Check out other opportunities at Twitter.