For beginner WordPress bloggers, creating a search bot friendly robots.txt is a headache sometimes. This is particularly true for me: I first blindly copied a robots.txt from some site, which resulted in the blocking of all my posts from the search engines. I later found out the robots.txt I copied deliberately blocked all posts with a ? in the default permlink format.
Learning a hard lesson, I found a simple robots.txt will just do the job. Don’t copy robots.txt from sites that claim their robots.txt can do magic to SEO.
So how to create a simple and easy robots.txt for your new WordPress blog?