How Search Engines Index Your Web Site

Join 4Shared Now!
Send me One
Million FREE Guaranteed Visitors








Your Ad Here

Notes on helping search engines index your Web site

This section provides some simple suggestions that will make your documents more accessible to search engines.

Define the document language
In the global context of the Web it is important to know which human language a page was written in. This is discussed in the section on language information.Specify language variants of this documentIf you have prepared translations of this document into other languages, you should use the LINK element to reference these. This allows an indexing engine to offer users search results in the user's preferred language, regardless of how the query was written. For instance, the following links offer French and German alternatives to a search engine:link lang="fr" title="La vie souterraine" hreflang="fr" href="mydoc-fr.html" type="text/html" rel="alternate"link lang="de" title="Das Leben im Untergrund" hreflang="de" href="mydoc-de.html" type="text/html" rel="alternate"Provide keywords and descriptions
Some indexing engines look for META elements that define a comma-separated list of keywords/phrases, or that give a short description. Search engines may present these keywords as the result of a search. The value of the name attribute sought by a search engine is not defined by this specification. Consider these examples,meta content="vacation,Greece,sunshine" name="keywords"meta content="Idyllic European vacations" name="description"Indicate the beginning of a collectionCollections of word processing documents or presentations are frequently translated into collections of HTML documents. It is helpful for search results to reference the beginning of the collection in addition to the page hit by the search. You may help search engines by using the LINK element with rel="start" along with the title attribute, as in:
link title="General Theory of Relativity" href="page1.html" type="text/html" rel="start"
Provide robots with indexing instructionsPeople may be surprised to find that their site has been indexed by an indexing robot and that the robot should not have been permitted to visit a sensitive part of the site. Many Web robots offer facilities for Web site administrators and content providers to limit what the robot does. This is achieved through two mechanisms: a "robots.txt" file and the META element in HTML documents, described below.
B.4.1 Search robots
The robots.txt file

When a Robot visits a Web site, say http://www.foobar.com/, it firsts checks for http://www.foobar.com/robots.txt. If it can find this document, it will analyze its contents to see if it is allowed to retrieve the document. You can customize the robots.txt file to apply only to specific robots, and to disallow access to specific directories or files.Here is a sample robots.txt file that prevents all robots from visiting the entire site

User-agent: * # applies to all robotsDisallow: / # disallow indexing of all pagesThe Robot will simply look for a "/robots.txt" URI on your site, where a site is defined as a HTTP server running on a particular host and port number. Here are
some sample locations for robots.txt:Site URIURI for robots.txt

http://www.w3.org/

http://www.w3.org/robots.txt

http://www.w3.org:80/

http://www.w3.org:80/robots.txt

http://www.w3.org:1234/

http://www.w3.org:1234/robots.txt

http://w3.org/

http://w3.org/robots.txt

There can only be a single "/robots.txt" on a site. Specifically, you should not put "robots.txt" files in user directories, because a robot will never look at them. If you want your users to be able to create their own "robots.txt", you will need to merge them all into a single "/robots.txt". If you don't want to do this your users might want to use the Robots META Tag instead.Some tips: URI's are case-sensitive, and "/robots.txt" string must be all lower-case. Blank lines are not permitted within a single record in the "robots.txt" file.There must be exactly one "User-agent" field per record. The robot should be liberal in interpreting this field. A case-insensitive substring match of the name without version information is recommended.If the value is "*", the record describes the default access policy for any robot that has not matched any of the other records. It is not allowed to have multiple such records in the "/robots.txt" file.The "Disallow" field specifies a partial URI that is not to be visited. This can be a full path, or a partial path; any URI that starts with this value will not be retrieved.

For example,Disallow: /help disallows both /help.html and /help/index.html, whereasDisallow: /help/ would disallow /help/index.html but allow /help.html.An empty value for "Disallow", indicates that all URIs can be retrieved. At least one "Disallow" field must be present in the robots.txt file.Robots and the META element
The META element allows HTML authors to tell visiting robots whether a document may be indexed, or used to harvest more links. No server administrator action is required.
In the following example a robot should neither index this document, nor analyze it for links.

(In order to have the right figures and index your site or not ,please, visit the site which has this article on the following link)

http://www.w3.org/TR/REC-html40/appendix/notes.html

Note. In early 1997 only a few robots implement this, but this is expected to change as more public attention is given to controlling indexing robots.

Related Key words for your search:-
Tags for SEOseo,seok,seong,seoul,senseo,seo uk,seo web,seorang,web seo,blog seo,closeout,firm seo,museo di,seo firm,seo site,seo tool,site seo,closeouts,elite seo,mouseover,pop seoul,seo eliteTags for Metameta,metal,metabo,metals,cemetary,meta tag,metacafe,metairie,metal cd,metallic, metatags, html meta, http meta,meta head, meta html, metaname,metatags,metabolic,metallica, metallics, metastock,timetable,metatitle,metabolife,metabolism,metabolite, metasearch, metastasis, metastatic,metatrader, meta engine, meta search,metabolites,metacrawler,metaphysics,search engine optimization

Free Search Engine Optimization (SEO) tips - step by step , Check this Surprise

Send me One

Million FREE Guaranteed Visitors

Your Ad Here

I have found a very important SEO article on the internet so I started applying the meta tag and I am going to use the other tips and tricks hoping that it may increase my traffic and page ranking below is the article and the name of the author and the source link.

Free Search Engine Optimization (SEO) tips - step by step

There are so many websites all over the internet so it's essential to promote and optimize your website. A new website needs to be visible to search engines. Before submitting your site to search engines it is very important to optimize your website. If you can not afford a search engine optimization service, make sure to follow our few search engine optimization tips to have your web site well optimized for the top placement in search engines.

Step 1. - Analyze your competition
The best way to start optimizing your web site is analyze your competition. Take a look at the web pages that currently have top rankings (Top 10) on Google for targeted keywords and try to find out what these pages have done to get these rankings.
- analyze the first top ten web sites related to your branch
- analyze keywords they are using
- look at their source code, meta tags
- look at their keyword density
- look at their comment tag, alt tags, title tag
- internal and external links on their websites
- look how many sites linking to them
- check out the quality and link popularity of sites that are linking to your competitors
- look how many pages they have
After all you can tell is it easy to beat your competition or it is not.

Step 2. - Start to improve your website with quality content
When optimizing your website always use keyword in the meta tags which are reflected in your page. It is not going to help your search engine ranking if the page has nothing to do with the topic.

Step 3. Choose the right keywords.
As mentioned before, analyze your competition but never use the same keyword and description tag. There are two great resources for finding out the most effective keywords. - Overture - WordTracker

Step 4.Creating meta tags - TITLE Tag
The most important tag is the Title tag, because it is in the head section of your website and many search engines use it. Title tag should be short (about 14 words), descriptive and to the point. The title is appeared on first line in the search engines.

Step 5. Creating meta tags - DESCRIPTION Tag The next important meta tag is description tag. It describes content of your web page
- shouldn't be longer than 120 characters
- description is for the search engines not for the viewers to see

Step 6. Creating meta tags - KEYWORD Tag
- use the most important keywords that your website represents
- we recommend to use 5 keywords separated by a commas
- one keyword should have 1 - 3 words

Step 7.Creating meta tags - ROBOT Tags
it is better to show this step at the link below as I cannot use it here otherwise the topic won't be sent

Step 8. - Check your website URL before submit to search engines.
Your website should be finished without errors:
- no broken links
- no spelling mistakes
- have a good design
- no html tag mistakes
- have a site map

Step 9. - Submit your website to search engines
Submit your website into the most important search engines, it brings you the most of traffic. Make sure to submit your URL for free to http://www.google.com/, http://www.yahoo.com/, http://www.altavista.com/, http://www.alltheweb.com/, http://www.excite.com/, http://www.lycos.com/, http://www.webcrawler.com/, http://www.alexa.com/, http://www.jayde.com/, http://www.whatuseek.com/, Open Directory (The ODP powers core directory services for some the most popular portals and search engines on the Web, including AOL Search, Netscape Search, Google directory, Yahoo directory, Lycos, DirectHit, and HotBot, MSN and hundreds of others). DMOZ and Yahoo Directory listings are tremendously valuable. There are a lot more free and paid search engines and directories to submit, but if you do not have time to search for and submit, you can also use our search engine submission service.

Step 10. - Build your link popularity (offpage optimization)
Next significant step you should do with your website is build your link popularity. Link Popularity is the number and quality of other websites that link to your site. Top rankings depend on your link popularity. It can be done with creating a quality non-reciprocal and reciprocal links from related web sites and Internet directories, blogs, forum sites.

Robert Toth provides search engine optimization, submission and link building service since 2002 and now run Alexia Search Engine Optimization firm (http://searchengineoptimization-submission.com/)

The source: http://www.webworldindex.com/articles/Free-Search-Engine-Optimization-SEO-tips-step-by-step.html

Tags for SEO

seo,seok,seong,seoul,senseo,seo uk,seo web,seorang,web seo,blog seo,closeout,firm seo,museo di,seo firm,seo site,seo tool,site seo,closeouts,elite seo,mouseover,pop seoul,seo elite

Tags for Meta

meta,metal,metabo,metals,cemetary,meta tag,metacafe,metairie,metal cd,metallic, metatags, html meta, http meta,meta head, meta html, metaname,metatags,metabolic,metallica, metallics, metastock,timetable,metatitle,metabolife,metabolism,metabolite, metasearch, metastasis, metastatic,metatrader, meta engine, meta search,metabolites,metacrawler,metaphysics,search engine optimization,

A Great Helping Site for Making Money Online and SEO

Your Ad Here





Salam,

I am bringing you today a great site that will help you concerning a lot of things realted to making or generating money online. You will use it to know your ranking, meta, etc.... It will help you suggest top key word or rank them. It has many good features you can discover yourself. So, I think it is a good tool for SEO and this is its link http://www.seochat.com/ and of course its services are for free.
Wait for me as I will get you some surprises.

By the way, you can click some links or banners on the same blog in fornt of you and sign up for more traffic and money. Just give a try.

See you later