Proper URL's for Search Engine Spidering
Skip | 09 January, 2005 15:56
There is a heated dialog going on with one of the search engine optimization discussion lists I belong to.....
The discussion revolves around what types of file extensions that Google and other SE spiders find most "appealing", or easy to spider and index.
The dilemma in the initial posted case was surrounding .cfm file extensions, which are the file name extensions generated by ColdFusion. If you don't use ColdFusion, don't get started. It's an older tool set bought several years ago by Macromedia.
Meanwhile, the discussion thread has migrated to many surrounding topics relative to file extension types and what is best for the search engine spiders.
Assuming you are using a quality
Linux web site hosting provider such as our sister company BAPort, your server is running Apache. Shame on you if you are using a web host who runs IIS!!!
;-)
If your host is running Apache web server, then most likely they also support the
Apache Mod_Rewrite functions.
If you are using PHP, ASP, HTM, HTML or just about any other type of site builder or tool (on your desktop) to build your site pages, then you can use Apache Mod Rewrite to format all the pages on your site to have the same file extension. The benefit of this is generally, and usually, a simpler URL / file name that is easily consumable by the SE spiders.
Ultimately, it means for faster spidering and higher rankings (assuming you've done a good job with page Titles etc.).
Have a great weekend and be sure to watch
24 tonight if you're in the USA. It's my favorite show and I've been dying for the new season to start again!
Skip
Comments for post