| |
| |
|
Web Development Information |
|
|
|
Effectively Using Robots Meta Tags
The "robots" meta tag, when used properly, will tell the search engine spiders whether or not to index and follow a particular page. For the purposes of this article, we will be using the "( )" symbols to represent the "< >" in html coding. Some examples of robot usage are as follows: (meta name="robots" content="index,follow") (meta name="robots" content="noindex,follow") (meta name="robots" content="index,nofollow") (meta name="robots" content="noindex,nofollow") Let us first examine what these terms mean before we explain the usage for each one: "index"- This directive tells the search engine robots (or spiders) that it is okay to index the page. Another words, you are allowing the search engine to include your page within their search directory. "noindex"- Using this tag, you are informing the robots that this page should not be indexed. Simply put, this page will not appear in their search directory. "follow"- When you use this tag, you are telling the search engines that you want their robot to follow any links that are found on that page. "nofollow"- The opposite of the above definition, this directive will tell the robots not to follow any links on your page. Putting It All Together: With the robots tags explained, let's examine the usage for each one. 1. (meta name="robots" content="index,follow") This tag will be used when you want the search engine spiders to index the page and follow the links to other pages. Most search engines use this setting as a "default" setting. It is possible that you may not even need to use this tag if you want the search engines to follow and index the page. However, an article at Search Engine World (searchengineworld.com/metatag/robots.htm) suggests that Inktomi does not use this as their default setting. Instead, they use the "index, nofollow" tag. Better safe than sorry! There has been much debate over whether or not it is necessary to use this tag. If there is even a slight possibility that some search engines do not use this as the default setting, then it would only make sense to include this tag if you want your page included in their search directory AND your links to be followed. Do the research and decide for yourself. 2. (meta name="robots" content="noindex,follow") This tag can be used to tell the search engines that you do not want the page included in their directory, but you DO want them to follow the links that lead to other pages. A good example of its usage would be your disclaimer or privacy policy pages. You may not want these pages to show up in the search engines if they are only important to your actual visitors. However, if the links on these pages point to other pages that you want the search engines to find, then you would still want the spiders to "follow" those links. 3. (meta name="robots" content="index,nofollow") This tag will allow your page to be indexed in the search engines, but any links on that page will not be followed. 4. (meta name="robots" content="noindex,nofollow") When using this tag, the search engine spiders will not include this page in their directory and will not follow any links on the page either. Where does the "robots" tag belong? The "robots" meta tag should be used within the (head) and (/head) tags of your page. These tags are located at the top of the html coding. It will look something like this: (html) More Robots Tags Google automatically archives a page as it crawls it. This is called a "cached" version of the page. Visitors can retrieve the archived version of the page by clicking on the "cached" link within Google's search results. If you do not want your content to be archived, you can use the following tag: (meta name="robots" content="noarchive") *This will only prevent your page from being "cached". If you do not want your page to be indexed at all, you will still need to include the "noindex" tag. Another alternative to the above tag is the tag that specifically addresses Google only. If you want other search engine robots to archive your site, but you would like to prevent Google from doing so, then you can use the following tag: (meta name="googlebot" content="noarchive") The Misuse of Robots Tags Something that has been popping up on websites everywhere is the Google indexing tag. This is a silly little tag that is not necessary. Some people think this tag helps Google to spider your site, but this simply isn't true. The tag looks like this: (meta name="googlebot" content="index,follow"). Some website owners believe that by specifying "googlebot" that their site has the advantage of being spidered faster and listed by Google. According to Google's web crawler information, you may use the noindex, nofollow, or noarchive tags when you DO NOT want Google to cache, index, or follow that page. Google's default setting is to index and follow the links on the page, so this "so called" googlebot index/follow tag that some site owner made up one day is completely unnecessary. Another silly little tag--- The "Revisit-After" Tag (meta name="revisit-after" content="90 days") I'm not sure where this myth was started. Today, you will find this tag all over the Internet. Webmasters have even promoted it, claiming that it actually works. Are we so naive to believe the search engine spiders need to know when to come back? I have never used this tag, and my site has no problem with being crawled on a regular basis. Even some SEO (search engine optimization) sites are claiming its value. This comes back to the importance of researching the topic thoroughly first. My research came from some interesting information on WebmasterWorld. It is important to examine the correct usage of the "robots" tag before applying it to your website. Incorrect usage of tags could result in spidering errors that cause robots to completely ignore the page all together. If you are interested in learning more about web robots, this great little site will provide you with the information you need to use them effectively: www.robotstxt.org/wc/robots.html Stephani Richardson is a work at home mother of 4 who has been actively involved with affiliate marketing and home business opportunities since December 1999. She owns and operates several business related websites including 1 Work At Home Dot Com.
MORE RESOURCES:
Web-Development - Google News |
|
|
|
RELATED ARTICLES
Learn to Build a Better Online Business Website Using Keywords and Content Are you aware that 90% of the websites on the Internet today are a waste of time and space. You have probably been on some of the sites I am referring to. Top 5 Reasons to Track Your Website Traffic #5 User Satisfaction: Learn what your visitors and site users do and do not like about your site. Using a good reporting service allows you to monitor your pages individually to see what pages are clicked on first, the most popular pages, duration of any given visitor's time viewing a page (visit duration), and what pages send your visitors off your site (exit pages). Five Essential Questions to Answer Before Creating Your First (or second...or third) Website Right after the thought, "I need a website," people usually say, "I need a web designer!" Actually, before even whispering "web design," you need to answer these five questions in as much detail as possible. Once you're clear on your strategy, you can provide better information to your web designer. 4 Marketing Tips for Resourceful Webmasters! The internet is a sea of knowledge. Getting your information to 'float' by the right audience can be like finding that one special grain of sand on the seashore. How To Start Your Own Website I'm one of those people that always wanted a website, but had no clue as to using the internet. I could check my email and that was about it. 7 Tips to Make Your Order Page Work Harder So your prospect, Mary, is sitting at the computer reading your compelling sales letter. She's convinced she needs your product. Web Measurement: What You Don't Know Would Make A Great Book "What's in it for me?" you ask. "Why should I measure how people use my website? How does it help and what does it all mean?" The purpose of this article is to try to give you some insight into effective web measurement and to talk about the most important page of any website, the landing or home page. 5 Essential Traits Of A Home Business Website So you've decided to start an online work at home business and are just beginning to build your website. You probably have a million different ideas for what you want the site to look like. Five Question-Five Minute Web Makeover Quiz If you haven't made the sales and built your clients to an income you want, then you may need a Web Site makeover.What I mean by that is, most people contact a web master to put up their site. The Road to Better Results A lot has changed in the way sites are optimized for search engines since last year. For one thing, Google is not the only search engine worth looking into anymore; Yahoo has definitely managed to take away some of Google's oomph over the past twelve months. Are You Losing Sales Because of These 4 Simple Website Mistakes? Losing website sales and traffic is sometimes simply a case of web usablity - your website just isn't clear to your visitors. By fixing these simple mistakes, you'll easily increase your conversion rate and make more online sales. How Web Templates Are Helping Online Businesses to MultiplyTheir Income Web templates by nature are created to aid and ease the strenuous process of a typical web development phase. Idea collection, analysis, research, design are just a small part of a bigger picture. Launch Your Own Website Today - Its Easier Than You Think! Thousands of people are now making a living online and the opportunities are abundant as the Internet continues its growth. An added benefit of running an Internet business is that you can usually start one part-time while you maintain your job and steady income. Introductory PHP For Non-Programmers When you started reading this sentence you assumed lo acabara en ingls. However, I didn't finish in English. Web Accessibility: The Basics What is web accessibility & why is it important?Web accessibility is about making your website accessible to all Internet users (both disabled and non-disabled), regardless of what browsing technology they're using. In addition to complying with the law, an accessible website can reap huge benefits on to your website and your business. How Your Own Website Helps Your Small Business Grow What do you mean, you don't have a website for your small business? Now that the Internet age is well and truly upon us, small business owners who haven't yet realised what a well-designed website could do for their business are getting harder and harder to find. If you're one of them, though, read on to find out how starting your own website could help your small business grow. I Want To Be A Freelancer So you have decided that you want to do freelance work. You have done your homework and have developed your skills in HTML, PHP, CMS, and a slew of other applications. Website Imperatives and Solutions When you take a look at the most visited sites on the internet, what hits you in the face? Change, growth, new content. In a sense, a search engine is the perfect web site. The Power Of CPanel cPanel is a control panel for your website and allows you to set up and manage your web account through a graphical interface instead of having to use command line. This means that you can make changes to your website without having to learn to use a command line environment. Get to Know People through Websites Web sites are not just places to sell things; they are a medium where people can get insight into other people's lives. Take the musician Xavier Rudd for example.
|
| home | site map |
| © 2006 |