by • February 16, 2012 • UncategorizedComments (11)1046

An example of how I’m currently validating a project idea

This is a follow-up to Give it away in response to the question: “How do you validate interest before the product is built?”

I’m going to walk through my thought process and strategy around a new project I’ve been playing with to [hopefully] show what’s happening under the hood.

After failing at business blogging several times and then quasi-succeeding, I began to wonder whether many other people suffer from the same problems.

Testable question #1: Is this a real problem that lots of people have and do they care about solving it?

I wrote a couple articles about my experiences[1]. The strong response[2] reassured me that lots of people had the same problem and would like some solution. I also gave a couple talks at local events.

Beyond a general sense of “people want a solution,” the resulting conversations highlighted one specific problem loads of people had: deciding what to write about.

Testable question #2: Does my imagined value proposition (of overcoming blogger’s block) fit & solve their problem?

I spent a few hours putting together a free workshop in London with the promise that attendees would get “2 month’s worth of blogging ideas in 20 minutes.” 45 people showed up, we had a great time, and they actually did leave with 2 month’s worth of ideas apiece.

By this point, I’ve zoomed in on a specific, solvable problem and have a value proposition which attracts a crowd and can actually solve the problem. That’s a lot of information I didn’t have the week before!

Quiz time: If you were in my shoes, what would you want to test next?

I decided to find out whether it would still be appealing without me in the room as a facilitator. Or, put another way: could it be a webapp?

Testable question #3: Does the appeal of the in-person workshop translate into appeal for an online webapp?

I announced my plans and offered early access for retweets. 30 kind souls obliged[3] and I had bit more information — the webapp was desirable, at least to some, and they were happy to talk about it publicly.

I coded up a crude version over new year’s eve and sent it out to most of the early 30 (I also know I missed a few of you–I am so sorry!)

Testable question #4: Will users endure a 20-30 minute online workshop?

Testable question #5: Upon completion, do they consider it to have been time well spent?

It’s a highly biased group, but early results were strong. Almost everyone who started the workshop completed it and once they did, feedback was unanimously positive. Even better, about 80% of them tweeteed about the experience. While it’s still far from viral, the high public recommendation rate is a useful early indicator.

Testable question #6: Can it grow virally?

In the coming week, I plan to finish version 1 and really begin testing the growth engine. I know it will be time well-spend since I’ve already validated the value proposition across several mediums: blog posts, workshops, talks, twitter, and a crude webapp. I’m confident about the problem, the value proposition, and the core features.

If you’d like to check it out, it’s at

Strategy for hobby projects is the same as strategy for startups

I’ll basically continue this approach for as long as the product exists, regardless of whether it’s my hobby project or a “serious” startup. I’m always ready to kill it if it turns out to be inviable (or to increase its resources if I validate all the easy stuff and it still looks good).

This simple cycle is the core of all startup strategy:

  1. What are the biggest assumptions and uncertainties baked into our idea?
  2. What’s the fastest, cheapest & easiest way to answer those questions?
  3. Do it.
  4. Measure it.
  5. What are the biggest assumptions and uncertainties still baked into our idea? And so on.

Code ain’t nothin’ but a way to answer questions

Note that I didn’t write a single line of code until I was up to assumptions 4 & 5, by which point I was confident in my problem, value proposition, and customer segment. The total time spent coding to date is still well under 20 hours — a single long weekend or a week of late nights after work.

Anyway, that’s how I approach this stuff. It’s also why I really love side projects. You can answer a lot of questions without terribly much time or cash invested and then make a smart decision about when to double-down and quit your job, raise funding, build a team, etc.


[1] I’m fudging the timing here a bit for the sake of narrative clarity. Rather than the problem statement springing fully formed from the skull of Zeus, I actually wrote the blog posts first, the response to which made me suspect I had stumbled across a real problem. I don’t think it makes a difference to the lessons-learned one way or the other, but wanted to clarify.

[2] Social news sites are an incredible first testing ground for new ideas. My standard response to being asked whether something is a “good idea” is to ask who it creates joy or relieves pain for and then pull up the list of subreddits. Your product is going to change the way some person goes about their day, which means you have a vision for what’s wrong with their day and how it should be instead. They’re out there already, conveniently self-identifying into subreddits. The first test is to write something that gets them excited.

[3] 30 early volunteers is a conversion rate of 2% from my 1500 followers, which, in my limited experience, is about the best you’ll ever get on Twitter. Plus, those were retweets, not clicks, which sends a stronger signal. For my money, that falls well within the category of “good enough”.

[4] Does anyone actually read the footnotes? They’re my favourite part.

Related Posts

11 Responses to An example of how I’m currently validating a project idea

  1. This is a hugely helpful post – thank you!*

    I was familiar with the concepts and techniques used (mostly from reading around the lean startup approach) but having a start-to-finish tale with a concrete example is really very powerful. Especially in having some of the motivation behind the steps explained, which can easily be glossed over when it’s explained only in abstract principles.

    The suggestion of using existing online communities like subreddits to test interest by writing targeted blog posts is a valuable one.

    Thanks for taking the time to share this process!

    * One exception: not enough footnotes. My response to [4] is yes, and likewise.

  2. Good post. I love real stories by entrepreneurs.

    I think far too many startups don’t answer the first question (is this a real problem), which makes the other ones pretty hard to get right.

    Last month I went on a subreddit to find people to do a “problem interview” (ala Ash Maurya’s “Running Lean” book) for a product I’m working on (I thought I was the first person to think of using subreddits). The response was pretty positive. I definitely learned a lot from the interviews I was able to arrange.

    Validating the problem takes time. You start out with a list of problems you think matter, and through talking with people you slowly start to hone your message. The problems you list might or might not change over time; your presentation of the problems will.

    When you’re problems or presentation aren’t right, it’s obvious: the person you’re talking to might say they agree with you, but their responses will be lukewarm.

    When your problems and presentation are right, you can tell. They respond to your lists of problems by saying things like “definitely”; they cut you off to describe how they face that problem; they generally sound excited talking about the issue. (People love talking about their problems.)

    If you’re not getting that excitement, then you need to make adjustments to your problem, or your message. Once the problem interviews start sounding the same, it’s time to move on to the solution (question #2).

  3. Great Post:
    I’ve been self employed most of my life.People around me say I have the “art” of closing the deal(80%). Now I’m looking for some new NICHES and being fairly new to this Social Media you have given me some great ideas…I’m 54 and up till this point in my life I some how got it right on my own..There are power in number and I reconize that in a response rate of 2%.Doesn’t sound like much but a group of 30 interested people can be a very powerful thing.Thank you for the insight because I always have much room for improvement.

  4. guga says:

    cool article, Rob! As always!

  5. [...] This works better for service businesses enabled by technology than it does for pure tech businesses. Still, the lines blur. I used an in-person workshop to convince myself to build a web app. [...]

  6. Here’s a nice takeaway for inspiration: “Whatever works for hobby projects will work for startups”.

    This post is telling me to stay interested in my hobby! I haven’t built anything usable yet. I always stop at the Getting Started phase. But I must build! I must continue on building!

  7. motocross, motorcycle, off-road and street bike superstore for: Motocross, go kart parts Dirt Bike parts,ATV parts, UTV parts.

  8. Brendan says:

    Just one small validation for you: love the footnotes. Will definitely be checking out as well – looks awesome. Just stumbled on your site via bootstrapchallenge via hackernews and impressed w/ this to-the-point, useful content – thanks!

  9. There are numerous associated with causes which may be
    due to that unquestionable link. Naturally the average salary
    will continue to abide by Clash of Clans Hack for that near
    future. Your economic push would seem struggling to make-up the thoughts on these concerns which in turn unsettles people.
    To help quote on the list of good political
    analysts Odysseus Bootlegger ‘The good results
    of any kind of politics method can certainly just truly always be
    looked at if the body fat sweetheart offers sung.
    ha Incredibly, he brand new practically nothing involving Clash of Clans Hack until they had been properly in his or her thirties.
    I’m powerfully that if political figures used a smaller amount
    period thinking about Clash of Clans Hack as well as placed additional attempt to their family existence,
    that individuals would certainly have a very different state.

    The reason why performed Clash of Clans Hack cross punch the road?
    : To access additional part! Simply my very little joke, nevertheless enables desire which Clash of Clans Hack isn’t going to invigorate identical
    hilarity in the next elections. Many people feel Clash of Clans Hack ought not to be allowed to obtain when it comes to
    the greater problem: exactly why are usually all of us below?
    Getting that apart its of excellent relevance.

    It confirms order, creates ‘fires’, and yes it produces the top available inside
    persons. Let me get away from the final word towards
    popular Beyonce De Niro: My spouse and i requirement Clash
    of Clans Hack, almost nothing additional nothing much less.

    Here is my homepage: android game hacks

  10. Elvera says:

    Very good site you have here but I was wondering if you knew of any community forums that cover the same topics talked
    about in this article? I’d really like to be a part of group where I can get opinions from other knowledgeable individuals that share the
    same interest. If you have any recommendations, please let
    me know. Cheers!

  11. easter dress says:

    Pretty nice post. I just stumbled upon your weblog and wanted to say that I have truly enjoyed surfing around your blog posts.

    After all I’ll be subscribing to your feed and I hope you write again very soon!