Tag Archives: Split Testing

Testing Email Sequence Order (Cheat Sheet)

If you’ve ever run an analysis of WHEN your customers buy from your email follow ups, most marketers will find a highly disproportionate number of buyers in the early weeks (even the early DAYS) immediately after signing up.  As Gary Halbert says “You’ve got to get them when they’re in heat!”

Yet despite this very clear and convincing skew, almost NO ONE goes to the trouble of testing the ORDER of their follow up sequence.  That’s a BIG MISTAKE because, if email #12 happens to be your strongest pulling follow up, there’s a damn good chance you’ll snag more buyers by moving it closer to the sign up date when a greater proportion of your list is “in heat”…

Moreover, sometimes a particular email does a better job immediately after another email, and, conversely, there are certain messages which will actually decrease the efficacy of their followers.  The bottom line is, there’s usually money on the table for marketers willing to go through the time and effort to optimize the ORDER of their email sequence.

Logistically, this can be difficult, in fact, I’ve found only one or two other people who’ve ever run these kinds of email sequencing tests.  To try and ease the burden, I’ve prepared a simple cheat sheet which outlines exactly how to do this using aweber, step by step.  (Instructions are logically translatable to ANY autoresponder system)

Last, in case you don’t know it yet, I’ll be opening my business coaching practice for the first time in three years (and quite possibly for the last time ever) on January 1st, 2016.  Read the letter and get on the priority notifications list if you’re at all interested please since the spots will go quickly!

Upwards and Onwards!

Dr. G 🙂


Conversion Testing – How Many Actions?

Sever years ago I was presenting at The System seminar, and just after my presentation Trevo Claiborne from the Google Website Optimizer team spoke.  He casually mentioned they recommend ONE HUNDRED conversions/action PER OPTION you are testing.

This was (and still is) in direct contrast to the standard rules of thumb circling around the direct marketing world.  Most say 30, or 40 maximum for the losing version is plenty to declare
a winner.

Now, with my statistical background, rules of thumb have always bothered me in the first place.  I’d rather see the appropriate statistical test applied, but I DO understand the practical need to move at the speed of business and use heurisitics and shortcuts.

But I was incredibly surprised to hear Trevor say ONE HUNDRED in contrast to the 30 to 40 we’re all used to hearing.   So I asked whether this was based upon their observations across all their advertisers … I got a bit of a disclaimer, and then an answer I took for yes.

Here’s why this was a radical statement, and what it means for your marketingl.

First of all, Google knows.

I’m NOT doubting their observations.  I will take their word for it over my statistical training.

Google must SEE something we don’t.   And I’m guessing what that is … what it MUST be, is that there is MUCH MORE NOISE on the internet than there is in traditional direct marketing environments.

This explains why so many clients report confusion after having declared a winner … then later find their profits haven’t really risen correspondingly.

So we probably should all lean in the direction of longer lasting, more statistically robust tests … which translates to MORE actions before making a decision.

On the other hand, the vast majority of clients I’ve spoken with don’t have the necessary traffic to accomplish this in any reasonable time frame.

So what’s the solution?

FEWER AND MORE WELL CHOSEN TESTING OPTIONS WHICH YOU LET RUN ABOUT THREE TIMES AS LONG.   It really doesn’t make sense to “throw all sorts of spaghetti against the wall to see what sticks” like you may hear at some seminars and/or in some courses.  Do your research first and foremost to determine what MIGHT be likely to improve your conversions.  This means surveying people as they’re exiting your page, installing live chats, monitoring competitive sites, reading repeatedly appearing sales copy in your market and identifying very strong candidates for conversion enhancement.

A plain old A-B test with well thought out inputs is probably more valuable than testing umpteen different options.

Of course, Multivariate Taguchi starts to look more attractive in this situation (a method of compressing dozens of tests into one), but you have to remember that the same rules apply … we need MORE actions than we’re used to considering before we get really robust and stable results.

Which means your inputs for Taguchi testing are even more important.  And you should probably validate the winner against your control for the 100 actions Google’s suggesting.

Bottom line?

Google says there’s LOTS AND LOTS of noise online, and you have to test carefully and watch the results for a long time to be sure of them.

Believe them, and design your tests wisely since they’re not as “disposable” as you might have previously thought.

G 🙂

PS – In case you don’t know it yet, I’m going to open my business coaching practice for ONE DAY ONLY for new clients on January 1st, 2016.  The reason?  So few clients ever leave me that I haven’t taken on a new client in almost three full years now… but I feel a responsibility to stay fresh in working with new clients because I TEACH others how to work with them in my business coaching certification.  However, I’m getting pretty old.  Not comb-your-hair-over-your-ginormous-bald-spot old, or even “I need help to go to the bathroom” old… but I’m 51 now, pretty darn busy, and finally thinking it might be nice not to work a zillion hours a week any more.  Which means I very well may NEVER take on new clients again, and this may be your LAST opportunity to work with me personally, if you so desire.  Here’s the link again.

PPS – If you’re not already in the Make Them Buy Club, why the hell not?  It’s only $9.95/mo and it could make a tremendous difference in your business and your life.  The bonuses alone are worth at least $200.  But seeing how we deconstruct a market and advise people to make over their websites is something every marketer can benefit from.  Plus now we publish short 15 to 20 minute video summaries after each site evaluation so you can benefit from the “Cliff Notes” and study the ones which most apply to you in detail later on.  Duh.

Advanced Pay Per Click Testing

“Scientifically Improve Your Clicks, Sales, And Profits Hundreds Of Times Faster by Testing More Than One Thing At A Time!”

Part 1 – The Limits of Traditional Split Testing

Part 2 – The Taguchi Miracle

This post is continued with Advanced Adwords Conversion

more split testing magic

Earlier today I introduced you to www.SuperSplitTester.com … the free utility which does the math to help you stop choosing the WRONG ads in your adwords split tests and helps you choose the one which makes you the most money PER IMPRESSION.

I wanted to explain in more detail.  Here’s the thing:

Google has everybody focused on Click Through Rate (CTR).    You can also see conversion … for example, when split testing two ads, you can see which one gets a better CTR, and which one gets a better conversion rate
But CTR + CONVERSION individually don’t give you the right information to make your critical split testing decisions.

You might be surprised to note that Google isn’t really pricing their traffic according to Click Through Rates, even though that’s how you pay for it**
All they have to SELL you is SPACE (impressions) … so they’re doing the math behind the scenes to figure out how much money they make PER IMPRESSION

Doesn’t it make sense to you that if that’s how Google is selling you the ad space (according to how much they’ll make per impression), that’s the same number you should be looking at?

Sorry if I confused anyone earlier … this is what I was getting at.

** Note: no one really knows exactly how Google prices their traffic.  This is a (strongly) educated guess based upon information available in their learning center and I’m only representing it as my personal opinion.  (So Larry, Sergey, please don’t send your “Uncle Charlie” to my house OK?)

Split Testing – Why You’re Doing It Wrong

WARNING: “99% of Adwords Advertisers Are
Making Split Testing Decisions Using The Wrong Numbers!”
(And if you make Adwords split testing decisions based on click through OR conversion alone, you’re definitely one of them)

You can pick up the spreadsheet here

Or there’s a FREE utility to fix the problem here