@andrewchen

Subscribe · Featured · Recent · The Cold Start Problem 📘

Retention is King (Guest Post)

This is a guest post by a friend of mine on retention. Jamie Quint is Managing Partner of Quint Growth, a full-service growth consultancy that works with companies like Twitch and Hipmunk. Previously, he was the PM of Growth at Swipely and a Y Combinator alum. -Andrew


Jamie Quint:
There are too many companies asking, “How do we acquire more users?” that should instead be asking “How do we get better at keeping the users we already have?”.

Its easy when approaching the problem of growth to think that you just need to get more users, after all that seems to be the very definition of growth. However, if you take a step back though and think about growth as the maximization of user-weeks over time, it quickly becomes apparent that focusing on retention has a much larger effect than topline growth. This is also much more of a sustainable growth mindset. Rapid user growth followed by rapid user attrition is an indicator of unsustainable growth. Strong retention of users over time is a good indicator of product-market fit, something you’re hopefully looking to achieve anyway.

Viral Factor and Retention

At a high level, retention is more important than virality because if your users don’t stick around they are not able to invite others to your product over an extended period of time. If you have high retention and no virality you will sustainably grow your user-base over time. If you have high virality and no retention you will not. Between these two extremes it gets a bit more complicated. In order to explain in detail we first need to review a couple of terms: viral factor and retention.

It will help as you follow this post to use our in-house growth model to play with the numbers yourself, the graphs we reference later on in this post are derived from it.

Viral Factor
This describes the growth rate of a site or app based on invitations from existing users of the service. This is often called k factor.

i = number of invites sent by each customer
c = conversion rate of those invites (#signups/#invites)
k = i * c

Viral factor on a weekly basis usually looks something like the graph below. This varies for different products, but I’ve seen this shape again and again across the products we consult on. It is front-loaded like this for three reasons:

    1. The effectiveness of onboarding invitation flows.
      Onboarding is one of the few times you have a high level of user attention towards completing a specific goal (signup) and when you instruct users to invite others they often will without thinking much about it.

 

    1. Users’ level of excitement.
      Humans are most excited by new things, this applies to internet products as well. The excitement users get when trying a new product leads them to share more, but this sharing tapers off as product becomes normal in their everyday lives.

 

  1. Low invite saturation of users networks.
    When a user first starts using a product they know many more people that don’t use the product than do use it. Over time they share your product with others they know. Eventually, even a user who is very passionate about your product has nobody left to share it with that hasn’t already heard about it leading to lower virality as time goes on. This can also be an issue if your company grows very large, but that is a good problem to have.

Screenshot 2014-05-15 16.55.26

Retention
This is the number of users that stick around from one time period to another. There are two ways to express retention, overall retention and week-to-week retention:

    1. Overall Retention
      Overall retention is cumulative over time. If you have 30% overall retention in Week 3 it means that 30% of your users who started at the beginning of Week 1 are still around in Week 3. This is how companies normally express retention when discussing it internally.

 

  1. Week-to-Week Retention
    For growth purposes its often useful to look at retention on a week-to-week basis instead. Week-to-week retention is how many users move from one week to the next. If Week 2 has 40% overall retention and Week 3 has 30% overall retention than our week-to-week retention from Week 2 to Week 3 is 75%. If week-to-week retention is below 100% it means we’re still losing users.

Retention on a week-to-week basis usually looks something like the curve below. It is lowest from the first week to the second week and approaches 100% as time goes on.

Screenshot 2014-05-15 16.55.20

Why is retention so important?

In order for virality to be more important than retention your viral factor must be greater than your overall retention up to that point in time. We’ll prove this mathematically later in this post. The math is hard to simplify exactly, but there is a basic rule you can follow which approximates it. If you take only one thing away from this post it should be this:

Do not focus on improving virality unless your overall retention is stable, not continuing decrease after some reasonable period of time.

To help illustrate this, lets look at a few examples:

    1. Your product has a very high immediate viral factor.If your product is front-loaded with invites that are sent out and accepted at a high enough rate, it is possible to achieve an immediate k > 1 viral factor. In this case, if your invites have an acceptance rate that is quick enough, your monthly active user numbers will continue to grow even if you have zero retention past the first-use of your app/site. Growth of the high virality, low retention type is almost always unsustainable as the viral loops being exploited to attain quick k > 1 virality eventually expire. This has been the downfall of many companies that appeared to grow fast, raised a lot of money on that growth, then quickly died. Like Viddy…viddy

 

Viddy growth model with viral channels working looks like this.

Viddy growth model with viral channels broken looks like this.

    1. Your overall retention is high and decreases slowly as time goes on, but you have strong virality.In this case, products actually do see long term benefit from focusing on increased virality, but it’s often a false signal. Its only worth focusing on virality if you think you can improve virality more than overall retention. If you switch focus too early it will lead to sub-par growth metrics. This is because the compounding effects of retention improvement are much stronger than those of virality improvement.We can illustrate this easily with our retention/virality simulator and setting week-to-week retention and virality to be equal. We can then measure the effect of proportional changes to one of the other in terms of number of users that we have at some point in the future. In the real world virality is not likely to ever be equal to week-to-week retention, but for purposes of this example please disregard that as it helps illustrate our point in the clearest way possible.

      Base Case – Equal Virality and Retention: ~88k users total in Week 7, 44k from retention and 44k from virality as seen in the stacked bar chart.

      20% Increased Week 1 Virality: ~110k users total in Week 7, 53k from retention and 57k from virality.

      20% Increased Week 1 Retention: ~125k users total in Week 7, 65k from retention and 60k from virality.

      As you can see here, changes in retention have long term effects that have a greater effect than equivalent changes in virality.

 

  1. Your overall retention is high and stable.If you have maximized your retention to the point where you think you can increase virality more than overall retention, even accounting for the compounding effects of retention, then it makes sense to focus on virality.

Prove It!

It’s easy to model growth in Excel and there are some great models that have been shared online to help do this. The one I use is available for download at http://bit.ly/growthmodel. It’s a slightly modified version of this great one from Rahul at Rapportive. It will give you a nice overview of how you can expect to grow if you plug in some numbers. From a user accounting perspective this is great, but its a bit hard to conceptualize how growth actually works by looking at it that way. To get a bit of a different perspective, building a tree to see exactly where users that exist in a given week come from is quite helpful.

In the tree below w0 represents some set of users that start at time 0. Each level of the tree is a week in time. At each subsequent level you get users that stick around from retention or are invited via user virality. The number of users at a given node is just the product of all the nodes leading to that point. The coefficients represent the viral and retention factors over time, v2 is the viral coefficient in week 2 from the above virality graph, r3 is the retention coefficient in week 3 from the above retention graph, etc.

Screenshot 2014-05-13 17.24.01

The number of users at any given level can be simplified into a recursive equation.

Screenshot 2014-05-13 17.15.28

As you can see, this matches exactly what we saw in the tree graph above. The leading viral factor (current virality vi) matters relative to overall retention (trailing product of rn‘s).

Visualizing Retention and Virality

For the client work that we do at Quint Growth we built a tool to plug in numbers and visualize the retention/virality tree. Its the same tool we mentioned in the beginning of the post and used in Viddy example above. We’ve found it incredibly useful for visualizing how much more important retention is than virality (and the few cases in which it is not). We’ve made it available at http://quintgrowth.com/growthmodel.html and hope you find it as useful as we do!

Special thanks to Isaac Hodes for help with the d3 visualizations for the retention/virality visualizer.

PS. Get new updates/analysis on tech and startups

I write a high-quality, weekly newsletter covering what's happening in Silicon Valley, focused on startups, marketing, and mobile.

Views expressed in “content” (including posts, podcasts, videos) linked on this website or posted in social media and other platforms (collectively, “content distribution outlets”) are my own and are not the views of AH Capital Management, L.L.C. (“a16z”) or its respective affiliates. AH Capital Management is an investment adviser registered with the Securities and Exchange Commission. Registration as an investment adviser does not imply any special skill or training. The posts are not directed to any investors or potential investors, and do not constitute an offer to sell -- or a solicitation of an offer to buy -- any securities, and may not be used or relied upon in evaluating the merits of any investment.

The content should not be construed as or relied upon in any manner as investment, legal, tax, or other advice. You should consult your own advisers as to legal, business, tax, and other related matters concerning any investment. Any projections, estimates, forecasts, targets, prospects and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Any charts provided here are for informational purposes only, and should not be relied upon when making any investment decision. Certain information contained in here has been obtained from third-party sources. While taken from sources believed to be reliable, I have not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. The content speaks only as of the date indicated.

Under no circumstances should any posts or other information provided on this website -- or on associated content distribution outlets -- be construed as an offer soliciting the purchase or sale of any security or interest in any pooled investment vehicle sponsored, discussed, or mentioned by a16z personnel. Nor should it be construed as an offer to provide investment advisory services; an offer to invest in an a16z-managed pooled investment vehicle will be made separately and only by means of the confidential offering documents of the specific pooled investment vehicles -- which should be read in their entirety, and only to those who, among other requirements, meet certain qualifications under federal securities laws. Such investors, defined as accredited investors and qualified purchasers, are generally deemed capable of evaluating the merits and risks of prospective investments and financial matters. There can be no assurances that a16z’s investment objectives will be achieved or investment strategies will be successful. Any investment in a vehicle managed by a16z involves a high degree of risk including the risk that the entire amount invested is lost. Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by a16z is available at https://a16z.com/investments/. Excluded from this list are investments for which the issuer has not provided permission for a16z to disclose publicly as well as unannounced investments in publicly traded digital assets. Past results of Andreessen Horowitz’s investments, pooled investment vehicles, or investment strategies are not necessarily indicative of future results. Please see https://a16z.com/disclosures for additional important information.