Issuu on Google+

Increase iPhone App Downloads by A/B Testing App Names

Page 1 of 8 iPhone Consulting iOS App Development & Marketing • • • • • •

Home iOS Consulting iPhone Apps Portfolio Bookstore Contact & About Search this website …


Increase iPhone App Downloads by A/B Testing App Names April 21, 2010 By markj 13 Comments I’m about to outline the single most powerful thing you can do to improve sales/downloads of your iPhone app. I know this is a bold claim, but read on and I will justify it. I first presented this at 360iDev San Jose 2010. Apple made us an amazing market for our software and threw in a fantastic distribution & sales platform. All that for just 30% of receipts, which IMHO, is an incredibly good deal for developers. But the app store doesn’t help anyone find your app right? Wrong! The app store is a catalog of ads for iPhone apps, and millions of people are browsing through those ads – especially the top 100 lists. These browsing people are primed and ready to download, you just have to make them notice your ‘ad’ among the 200,000 others. When people are looking in the app store they are scrolling through a table of app listings. It doesn’t matter if they are checking out the top 100 games or they searched for ‘gardening’, everything in the app store is shown as a list of apps. The listing shows: icon; app name; price; star rating, company name. Get someone to notice your listing, and they will tap through to your app’s page. There they see the screen shot and maybe download your app, but that can’t happen until they’ve tapped on your listing in the first place. The key then, is to get them to tap on your listing. To make the very best performing app listing you need to carefully select the best icon and the best app name. How do you know what will be the best performing, and what do I even mean by best performing anyway? If you study how to be successful advertising on Google, or you learn about AARRR metrics for online business, you will discover that a key metric for online ads is is the Click Through Rate. CTR = clicks / impressions. (Clicks: number of times it was clicked on by people; impressions: number of times the ad was seen by people.) Better CTR means a better performing ad. Study this or try it yourself, and you’ll soon find that no-one makes money on Google by writing an ad, paying for the clicks, and sitting back while money pours in through their web-site. This is because it nearly always cost more for the ads than you can make back by selling your stuff! To make money you need to test several ads, figure out which is the best performing, take that ‘winner’ and make more variations to test. Keep repeating this until you have discovered one that performs well enough so that it is cost effective to pay Google a bunch of money to run the ad in large volume. iPhone app developers should use this same approach to figure out the best performing app listing: change name or icon, measure, compare, repeat. OK, so how do you measure CTR of your app listing? You need to know impressions and clicks. But you don’t know these, only Apple knows how many times your app listing was shown and


Increase iPhone App Downloads by A/B Testing App Names

Page 2 of 8

how many times people tapped on it (assuming even they are tracking this stuff). Hmmm… What we need is a way to test our app listing outside of the app store. It turns out there is something almost as good and extremely affordable: Admob. Below on the left is an app store listing for one of our old apps ‘Smart Caller’. On the right is an Admob ad in an iPhone app. Consider the content, structure, and context – they are very similar. So what I’m saying is that you can use Admob ads to test different icons and different app names for your app, to figure out the very best performing app name and icon for your app in the app store.

You can run an Admob mobile banner ad campaign for as little as $50, which will buy you 1000+ clicks (click prices vary by geography and demand). You might have a CTR of 1-2%, so that $50 is buying you 50,000+ impressions. This means you can test your icon or app name by sampling it 50,000+ times (which probably translates to almost 50,000 different people) all in a day. Survey 50,000 people in one day for just $50 to see which icon or which app name most catches peoples attention? Wow, if that doesn’t blow your mind then you’d better leave your app marketing to someone else. You can even test several ads at once in one $50 campaign, though you might have to baby sit it a little in order to get even testing of each. Now repeat a few times and you can find an app name and icon that performs much better than the ones you started with, all this for around $200 and a few hours work. OK, here’s some proof for you of just how powerful the app icon and app name is. The graph below is real download data for one of our free apps. I won’t explain all the in & outs of the various name and icon changes the app has been through here, but you can see from the graph what a huge effect changing the name and icon had on downloads. Each blue line marks where we changed name or icon, and the red line is the daily download rate. (Of course when you do this, you are trying to increase downloads, and you can see that we decreased downloads… but exactly what happened there is for another blog post!) For this app, we saw 20x difference in download rate for the best app listing vs the worst. Wow. Now in testing via Admob you won’t see such a huge difference in CTR, because live in the app store, a better CTR for your app listing has a leveraging effect. Double your CTR and you double downloads. Doubling downloads will increase your rankings a whole lot, and with increased rankings more people will see your app (more impressions), which leads to even more downloads. Your app listing CTR has massive leveraging power, which I’ll discuss more in a later blog post.


Increase iPhone App Downloads by A/B Testing App Names

Page 3 of 8

Often when app publishers (especially indie developers) look at paid promotions like Admob ads, it’s not clear if it’s money well spent because of the q uestion of how many actual downloads you will get for your money. It can cost a lot per download (Admob does have a way to measure downloads per impression and per $ spent, which is very neat). F or ex ample, one campaign we ran ended up costing us $ 2.5 0 per download for a free app, which was not a cost effective way of acq uiring users for that app. F iguring the download rate (aka conversion rate) for your ad is a more sophisticated way to measure how ‘good’ the ad is, and you should try to measure conversion rate if you are using ads to acq uire users / makes sales. But here I’m not talking about acq uiring users, I’m talking about A/B testing your app name and icon, and for that, your $ 200 might well be the best money you’ll ever spend. Why do I claim this is ‘the best’ thing you can do? Consider your sales funnel. Below is the sales funnel for a free apps that doesn’t have a bunch of PR, blog reviews etc. Its downloads come only from people finding it in the app store. To get people out the bottom of the funnel where you actually get paid, you need people to enter in at the top and keep moving down the funnel. To improve the conversion rate at which people will move down from one level to the nex t, you have to do more work and spend more money. All the conversion rates multiply together to result in the overall conversion rate of your sales funnel, so you can double your overall conversion rate by doubling conversions at any one of the stages. Improving how much people love to use your app (app use stage, or activation and retention in AARRR metrics) is probably q uite hard and ex pensive, but improving how many people click on your app listing in the first place (acq uisition) is q uite easy and cheap by doing what I just described. Then on top of how cheap this is to do, add in the leveraging effect your app listing CTR can have and I hope you can see the potential here.


Increase iPhone App Downloads by A/B Testing App Names

Page 4 of 8

You can and should test your app name before you release your app, but you can also do it for an app that’s been out for ages. Got an app sitting there not selling? Experiment with different names and icons and find something that performs better for you. In our experience, existing users won’t mind you changing name & icon, but do consider changing only one at one time unless you go for a full rebranding, in which case just tell existing users what you are doing. Would you like to de-risk your entire app making business by using this technique? Do app name testing before you ever write a line of code or design a single pixel. Are you an iPhone game developer? I bet you have many ideas for different games, but you’re not sure which one to invest the time and money to develop? Use ads to test several concepts, and build the one with the best click through rate. By doing this you’ll be pre-picking the one that has the best chance of being noticed by people and rising up the app store charts. Up-front market research like this is part of what the customer development & lean startup approach is all about – testing your idea as early as you can. When you try this watch the CTRs for your ads and see if they change over time. When the ads first run, CTR tends to show higher in the reports than it will end up. As time goes on CTRs drop. Then leave it a few days and you’ll sometimes see CTRs rise again (even once the ad campaign has finished). I think it’s just differences in timing of how the click data and impressions data gets reported. I also suspect there’s an effect because of ‘ad-click jockeys’, users who really like clicking ads to see what new apps are out there, so these people click on new ads as soon as they see them. If this is happening its just fine, because click jockeys are the same people who are going to push your app up in the charts. So do keep an eye on the CTRs, and check back after a few days to see how the numbers settle. I’d love to hear from anyone else who’s doing this kind of stuff with their mobile app business, and if I’ve inspired you to try it, let me know how it works out for you. Comment below or email markj at markj dot net. I’d love it if you could share the CTRs you get for different kinds of apps and the ranges you find between best and worst performing in order to develop some benchmarks for evaluating app ideas. I’ll be writing more on these topics myself, so please consider subscribing to this blog. Below are some references to the people I learned these techniques from, I encourage you to go read their blogs, books, and hear them speak if you can.


Increase iPhone App Downloads by A/B Testing App Names

Page 5 of 8

Steve Blank: developed the ‘Customer Development’ approach to the startup business, which my iPhone business is based on. Eric Ries: was Steve’s student, and went on to pioneer customer development for online businesses in combination with agile engineering practices, resulting in the ‘Lean Startup’ movement. Dave McClure: has fantastic work on metrics for online businesses and understanding your sales funnels, a lot of which applies well to the app store. AARRR! Sean Ellis: Lots more great advice on startups and marketing. Al Ries and Jack Trout: their book ‘Positioning – The Battle for your Mind’ explains the challenges in communicating with your customer, and sets the background for just why your app name is so powerful if you get it right. Perry Marshal: great material on understanding online advertising with Google (and by proxy Admob etc). Glenn Livingston: teaches online marketing, emotional marketing, and understanding customers (which is at the heart of whole customer development approach). Neil Young: At iPhone and game conferences, Neil stands up and lays out ngmoco’s strategy to us. (And I started on a ZX Spectrum too!) 360idev: great place to learn about this mobile apps biz. I first presented this at 360iDev San Jose 2010. Dave Wooldridge: The Business of iPhone App Development a great practical marketing book for iPhone devs. (Which I was the tech reviewer for.) Filed Under: App Store & Sales



nicolas says: May 18, 2010 at 11:19 am Really good advice. I am in the process of developing my app and a lot of things that you said give me hope for my marketing plan. Especially if your budget is almost zero. One more thing. Any idea how to find iPhone users in Spanish? Keep up the good work. Write more stuff about apps. Reply


Kevin Bomberry says: June 28, 2010 at 5:49 pm Hey Mark, Thanks for writing up this post. I blogged about it as well as started a “news” discussion in the iPhone Developer Network (iOS DevNet) on LinkedIn. I am actually writing a series on iAd and will be linking back to this article again. Good work!


Increase iPhone App Downloads by A/B Testing App Names

Page 6 of 8

Cheers, Kevin Reply 3.

AppHound says: August 17, 2010 at 4:14 pm This article makes a great point, as objective testing of the icon and app name are indeed a key to success. However, there is a major practical problem in using AdMob for this purpose. It is not possible to give AdMob two ads and have them shown in a truly random way. If you have two ads in the same group, then AdMob will often run one at one time and another at another time, and the results of click-through rates vary a great deal, so its clear the different ads are being shown within different apps and possibly in different countries and devices. Without the ability to serve multiple ads in a truly randomized fashion, there is no way to properly test them as this article claims. Maybe now that Google has bought AdMob, they will develop true randomized testing, which is something Google supports in its other services and uses extensively for its own site. Reply ◦

markj says: August 17, 2010 at 4:19 pm We’ve had the best success using house ads, via Admob, in our own app. That way we know that the ads being compared are being shown in the same app, at the same times. Reply


JC H says: October 24, 2010 at 2:48 pm Thanks for the write-up Mark – very helpful. How do you test CTR on unreleased apps though? -JC Reply

Trackbacks 1. Increase iPhone App Downloads … @ says: April 23, 2010 at 3:17 am [...] (Twitter) par Brett le 23-04-2010 Increase iPhone App Downloads by A/B Testing App Names (via @lukew) No [...]


Increase iPhone App Downloads by A/B Testing App Names

Page 7 of 8

Reply 2. John From Berkeley B links for 2010-04-23 says: April 23, 2010 at 6:37 pm [...] Increase iPhone App Downloads by A/B Testing App Names | markjnet (tags: apps branding development iphone marketing mobile naming testing) [...] Reply 3. Pour augmenter vos ventes, choisissez bien votre nom d’appli - emageen says: April 26, 2010 at 2:16 am [...]« Faut-il privilégier l’iPhone ? [...] Reply 4. Using ads for A/B testing app names and icons D Get Apps Done says: April 26, 2010 at 7:54 pm [...] an known trick for people who previously launched web services, but as Mark Johnson proved with his post , works quite well for iPhone applications as [...] Reply 5. links for 2010-09 -22 @ Digitalistic - Mashup or die trying says: September 22, 2010 at 8:03 am [...] Increase iPhone App Downloads by A/B Testing App Names | markjnet (tags: apps iphone appstore testing metrics naming mobile abtesting) AKPC_IDS += "472,";Popularity: unranked [?] [...] Reply 6. Nobody’s paying for your app. Now what? D GetJar Developer Blog says: June 15, 2011 at 5:26 pm [...] 5. Consider your app’s name and description. Does it say what you think it says? For as little $50, you can test out names with AdMob. [...] Reply 7. Five On Friday @ iPhone Development Blog says: June 18, 2011 at 9:51 am [...] Increase iPhone App Downloads by A/B Testing App Names [...] Reply 8. 360iDev iOS Dev Conference Denver 2011 says: July 26, 2011 at 1:20 pm [...] 360iDev 2011, the friendly iOS developer conference is coming in September to Denver CO. I’ll be there with the entire Focused Apps team (so that’s me and Rob ;-), and we’re presenting on ‘How to be an iOS Consultant’. I attended the first 360iDev in March 2009, it was a fantastic place to learn what was going on in the app store, get top notch technical info, and I met a bunch of inspiring indie iOS devs who continue to publish some great apps. I attended again in 2010 and became a speaker. [...] Reply


Increase iPhone App Downloads by A/B Testing App Names

Page 8 of 8

Speak Your Mind Name * Email * Website B


Post Comment /.-,DE

Notify me of follow-up comments via e-mail

RSS Subscribe

Twitter: @markjnet Categories • • • • • •

App Store & Sales Books iOS Programming iPhone Other My Apps Performance

Best Books for… • • • •

iPhone Programming iPhone Design Building Games Marketing Apps

Return to top of page Copyright 2008-2011 Mark Johnson, iPhone Consultant


Increase iPhone App Downloads