Twitter.com is one of the largest and most popular websites in the world. Our code operates at massive scale and speed, serving billions of requests per day, connecting hundreds of millions of active Twitter users to real-time information about their lives and the world we live in. Staff Software Engineers in the Twitter Observability group provide the technical leadership needed to build technologies that make the world’s largest real-time service scalable, efficient and flexible to evolve fast.
The Observability group at Twitter builds monitoring infrastructure covering operational metrics, centralized logging and distributed tracing for every team at Twitter across multiple data centers and public cloud regions. We operate these three datasets at an industry-competitive scale, collecting and processing 18B metrics, 400M log entries, and 2.5M distributed traces every minute. We have an ambitious goal to take these products to the next levels.
This role focuses on defining strategic direction and providing technical leadership for our Tracing solution powered by Zipkin. Twitter's infrastructure, services, and applications generate vast amounts of data, of which traces play a significant role in providing a system- perspective. We use this data to ensure the health and good functioning of the platform, to diagnose and debug problems, to tune performance, and to improve efficiency. Longer-term, it drives and justifies long-lived and consequential decisions like feature adoption and capacity planning.
Why it matters:
Observability is a mission-critical component of Twitter infrastructure that provides key insights into the Twitter infrastructure. With the growth of the company, the scale of our operations is exploding. In addition to solving scaling problems for these distributed systems, we are committed to make the life of every Twitter engineer delightful by providing a smart diagnostics platform.
What you’ll be doing:
Be responsible for the Tracing technical strategy and roadmap.
Work with other senior technical leaders across the company.
Expand the frontiers of distributed tracing to come up with new solutions that best serve our engineering workforce and discover new applications using big data analysis on tracing data.
Mentor and grow other technical leaders in the group.
Design & develop highly performant and complex distributed systems. Keep the stack up to date with emerging technology trends.