To avoid undesirable content in the search indexes, webmasters can instruct spiders not to crawl certain files or directories through the standard robots.txt file in the root directory of the domain. Additionally, a page can be explicitly excluded from a search engine's database by using a meta tag specific to robots (usually ). When a search engine visits a site, the robots.txt located in the root directory is the first file crawled. The robots.txt file is then parsed and will instruct the robot as to which pages are not to be crawled. As a search engine crawler may keep a cached copy of this file, it may on occasion crawl pages a webmaster does not wish crawled. Pages typically prevented from being crawled include login specific pages such as shopping carts and user-specific content such as search results from internal searches. In March 2007, Google warned webmasters that they should prevent indexing of internal search results because those pages are considered search spam.[47]
Online reviews have become one of the most important components in purchasing decisions by consumers in North America. According to a survey conducted by Dimensional Research which included over 1000 participants, 90% of respondents said that positive online reviews influenced their buying decisions and 94% will use a business with at least four stars. Interestingly, negative reviews typically came from online review sites whereas Facebook was the main source of positive reviews. Forrester Research predicts that by 2020, 42% of in-store sales will be from customers who are influenced by web product research.

Fill this bucket by building a fan base. Build a social network, get people to link to you, get people to share your t-shirt pages on their social network saying ‘I want this!’, get people to comment, leave testimonials, show pictures of themselves wearing the product or using the product, Create a fan-base and then rally them to link to you and talk about you. That’s how you prove to Google that you are trustworthy and authoritative.
Consider the length of your typical customer buying cycle. If your products and services have a short customer buying cycle, meaning your customers know what they want, search for it, and buy it, you may benefit from SEM ads that put your product right where customers will see it. Longer buying cycles, where customers research and compare for weeks or months, may not perform as well with SEM, as there isn’t an immediate buy after seeing one ad.
Great SEO is increasingly dependent on having a website with a great user experience. To make your user experience great requires carefully tracking what people do so that you always know where to improve. But what do you track? In this 15-minute talk, I’ll cover three effective and advanced ways to use event tracking in Google Analytics to understand a website's user.
Web search is one of the most powerful tools we have today. Just like you, people from all walks of life use Google to find solutions, learn new things and understand the world around. One of those new things may be determining whether SEO vs SEM is best for your business. Whether you’re an online business or a local business, chances are that people are actively looking for you.

Let's say, for example, you're researching the keyword "how to start a blog" for an article you want to create. "Blog" can mean a blog post or the blog website itself, and what a searcher's intent is behind that keyword will influence the direction of your article. Does the searcher want to learn how to start an individual blog post? Or do they want to know how to actually launch a website domain for the purposes of blogging? If your content strategy is only targeting people interested in the latter, you'll need to make sure of the keyword's intent before committing to it.
Search engine marketing (SEM) is a form of Internet marketing that involves the promotion of websites by increasing their visibility in search engine results pages (SERPs) primarily through paid advertising.[1] SEM may incorporate search engine optimization (SEO), which adjusts or rewrites website content and site architecture to achieve a higher ranking in search engine results pages to enhance pay per click (PPC) listings.[2]
While SEO allows you to optimize your website for a greater chance in appearing higher in search results, and online advertising allows you to send promotional content to the target audience of your choosing, SEM combines both benefits as your content is both optimized for higher search rankings and is placed primarily in front of audiences who are most likely to convert when they click on your ads.
×