Home > The Storque > Etsy News > All about Etsy FAQ Series: The Ins and Outs of Engineering

Recent comments
Polu Kala! Where in Greece are they from? Thanks for ...
by aegeansea
on Gotta Travel On: A D...

This is invaluable information for me---thank you so much for ...
by everythingworks
on A DIY-Friendly Guide...

YAY!! EFA!! Artist Helping Animals, doesn't get any better than ...
by UberDuperCreations
on Etsy for Animals: Wo...

I'm curious, like a few others, as to how exactly ...
by geekxnerd
on The Long View: Rob &...

great video!
by sheridesthelion
on Make a Hammock and R...

What a wonderful article. It goes to show that hard ...
by clearlakecreations
on Quit Your Day Job: D...

If you shove some wooden poles or some such in ...
by fugsly
on Make a Hammock and R...
All about Etsy FAQ Series: The Ins and Outs of Engineering
Article Header Image

As part of our All about Etsy FAQ Series
, Chris aka RevolvingDork — one of Etsy's founders and a member of the Engineering Team — answers questions below.

Engineering is perhaps the most complex and specialized team within Etsy. It's our job to keep the site speedy, secure, and online. We are also charged with implementing changes to the site, and developing new features. Here are some answers to questions you may have about Etsy engineering!

Q. Why do some features take so long to be released? Why aren’t you building the ideas I’ve posted into the forums?
A. The overwhelming majority of the work we do goes unnoticed by the Etsy population. Because Etsy has been growing at a breakneck pace throughout the past two years, it has required constant and sweeping changes to the lower levels of the site. We're always monitoring the speed at which the site operates and working to shave down the execution time on problem features.

Adding new features to a site that grows as fast as Etsy is a delicate balancing act. There are hundreds of factors that come into play, ranging from community demand to programmer availability to the concerns of the business.

One of the most pressing concerns when it comes to building new features is database load. The databases are the repository of all of the information on Etsy — every user, every listing, and every forum post is stored in a database. There are currently billions of records stored in the databases, so making any change to the way they are structured requires a great deal of technical foresight and planning. Saving any kind of new information requires a change to the database structure, and any change to the database structure needs to be tested thoroughly before being deployed into the live site.

Not all site additions require database work. Many of the flash applications on the site, for instance, make use of existing calls into the system and can be developed more quickly and with a smaller team. The time required to finish a new feature depends on how many layers of the site have to change to make it work. Some features require new machines to be purchased and installed into our server farm, which can mean longer lead times.

The bottom line is that at our size, there is no such thing as a “simple” change. Even seemingly innocuous changes can require development of the site’s markup, front end code, middle layer, caching, network structure, databases, and hardware. We do our best to keep development rapid enough to meet the needs of our users, but measured enough to keep the system running fast and error-free.

Q. Why can’t you provide a list of planned features and when you expect them to come out?
A. Development on Etsy can be a tumultuous process. Features routinely get their timelines rescheduled, accelerated, or even dropped entirely from development. Because we cannot be sure of when features will be released or even if they’ll ever see the light of day, we cannot disclose our development schedule with the community. If a feature is nearly complete and has passed preliminary testing, we may release details about it through the Storque before it has launched.

Q. What do I do if I discover a bug on the site?
A. If you think you’ve found a bug while using Etsy, the first place you should go is the bugs forum. Check the first page of posts to see if anyone else has already posted a thread about your issue; if so, you can post additional information about the bug in the existing thread. If none of the threads match your issue, you can start a new thread. The bugs forum is monitored several times throughout the day, so you can feel confident that your issue is being seen by those that can help you.

Q. What is the development process like?
A. All major site changes start out as a requirements document from the Product Team. This usually comes in the form of a collection of mockup screens and walk through documentation (read more about this in Kelly's post in this series).

A team leader is picked for the project. After reviewing the requirements document, he or she determines what changes will have to be made to the system and how many people will need to be recruited for the project. An engineering roadmap is drawn up by the team leader, and a timeline is set.

All actual development work is performed on what we call a “planet,” which is a copy of the entire Etsy website. This allows us to get our hands dirty and break things without affecting the public site. Planets are like little developer playgrounds, where we can experiment with ideas and test out our hypotheses.

Once all of the development is done, the new code is handed off to QA. It’s QA’s job to test out changes and make sure they work properly (read more about the QA process in Annette's post in this series). Once the green light is given by QA, the changes are pushed onto the live servers by Site Ops, and we have a new feature!

Engineering in Etsy is a tough job, but it’s also extremely rewarding. There’s no feeling quite like knowing that hundreds of thousands of people are using the tools you’ve built.

If you have any further questions about the engineering process, comment below. I’d love to answer any of your queries in a future Storque article!


Related Items
This article was reported by:
Etsy Admin RevolvingDork
shop . profile . contact

tags Tags All about Etsy FAQ Series, engineering, RevolvingDork, site features
12 comments     Login to add your own!
Etsy Admin daniellexo says:

This is a great article RD, thanks so much!

P.S. there are mystical orbs in that picture of chris, haim and dustin!


1/23/08 at 1:14p.m.
BluewaterStudio says:

Thank you for the update!! I can't wait to be an expert programmer. I love this stuff... Sabine


1/23/08 at 1:27p.m.
Etsy Admin sarawearsskirts says:

the real question is, who is the better guitar hero? chris or haim?


1/23/08 at 3:34p.m.
neawear says:

Ohhh sara, don't ask! They'll have a fight! lol


1/23/08 at 5:36p.m.
purekatherine says:

kudos on the use of the word tumultuous.


1/23/08 at 5:59p.m.
Etsy Admin annettemusick says:

hotness. QA loves Etsy!


1/23/08 at 7:00p.m.
alkemystic88 says:

Do you guys ever take a break ?


1/23/08 at 7:39p.m.
ArgyleWhale says:

Looks like Haim is throwing in some "star power" and is using his whammy bar. Chris looks a little more intense though so it's a tough call.

Seems they are both too cool for their guitar straps.


1/23/08 at 9:20p.m.
operatic says:

Why don't you provide a list of planned features? You don't have to give us implementation dates, but it would be good to know what's being worked on.

:)


1/24/08 at 9:59a.m.
greygoat says:

Thanks for this article, I think it is really helpful in explaining some of what goes on. In my day job, I write requirements documents for another large website company so I do understand what goes on in the background in Etsy and try not to gripe about the timescales, however enthusiastic I am about the changes :D

Also, I may swipe the article and send it out to our commercial department, LOL!


2/2/08 at 5:38a.m.
melissakate says:

Wow! I don't know the last time I've seen such intense focus. That picture almost made me laugh out loud. Thanks for all your hard work guys.
And I really mean that :)


2/2/08 at 11:51a.m.
MagicIsland says:

wow you guys have your own planet etsy cool...
no, really thanks for all the great work and updates and improvements to the site!


2/21/08 at 10:39p.m.
Previous Page | Next Page