Sometimes it might become annoying for you and you would like to disable this automatic scanning as it takes a few extra seconds to scan the file and it... 

What is a robots.txt file? The robots.txt tells the search engine spider which web pages on your website should be indexed and which web pages should be... 

Here are step you need the following to start: 1. WinRar application ( buy or get free ) 2. 5-15 minutes 3. A Drink of your choice..LoL ! okay now first... 

Search engines such as Google and Yahoo! are leading the way in sorting and indexing the world’s information, making it easy to simply type in keywords...