If you make the audience you're initially serving too big, you will dilute the very thing you set out to make, avoid critical mass, and compromise the magic of what you're building. You'll make average stuff for average people instead of something powerful for the few.