Imbalance detection for healthier experimentation

Deciding to launch a new product feature at Etsy requires teams to rigorously assess whether it will improve the user experience....

Stephane Shao

Mar 4, 2022

How the 2020 Mask Surge Reshaped Etsy’s Taxonomy Capabilities

On April 3, 2020, the US Centers for Disease Control and Prevention (CDC) recommended wearing face masks in public to combat the...

Yael Kaufman

Feb 8, 2022

Increasing experimentation accuracy and speed by using control variates

At Etsy, we strive to nurture a culture of continuous learning and rapid innovation. To ensure that new products and functionalities...

Stephane Shao

Jun 2, 2021

Improving our design system through Dark Mode

Etsy recently launched Dark Mode in our iOS and Android buyer apps. Since Dark Mode was introduced system-wide last year in iOS...

Stephanie Sharp

Oct 21, 2020

How to Pick a Metric as the North Star for Algorithms to Optimize Business KPI? A Causal Inference Approach

This article draws on our published paper in KDD 2020 (Oral Presentation, Selection Rate: 5.8%, 44 out of 756) Introduction It...

Xuan Yin

Aug 2, 2020

Chaining iOS Machine Learning, Computer Vision, and Augmented Reality to Make the Magical Real

Etsy recently released a feature in our buyer-facing  iOS app that allows users to visualize wall art within their environments....

Jacob Van Order

Jun 23, 2020

Double-bucketing in A/B Testing

Previously, we’ve posted about the importance we put in Etsy’s experimentation systems for our decision-making process. In...

David Schott

Nov 7, 2018

Etsy’s experiment with immutable documentation

Introduction Writing documentation is like trying to hit a moving target. The way a system works changes constantly, so as soon...

Paul-Jean Letourneau

Oct 10, 2018

How Etsy Handles Peeking in A/B Testing

Etsy relies heavily on experimentation to improve our decision-making process. We leverage our internal A/B testing tool when...

Callie McRee

Oct 3, 2018

Modeling User Journeys via Semantic Embeddings

Etsy is a global marketplace for unique goods. This means that as soon as an item becomes popular, it runs the risk of selling...

Nishan Subedi

Jul 12, 2018

The EventHorizon Saga

This is an epic tale of EventHorizon, and how we finally got it to a happy place. EventHorizon is a tool we use to watch events...

Brad Greenlee

May 29, 2018

Culture of Quality: Measuring Code Coverage at Etsy

In the summer of 2017, Etsy created the Test Engineering Strategy Team to define, measure, and develop practices that would help...

Jeffery Campbell

Feb 15, 2018