Get into pay sites for free as a Googlebot

This trick is very clever: many sites limiting access to documents, let Googlebot (Google’s spidering agent) through. I think this is the case with some IEEE archives. So, you can simply tell your browser to identify yourself as the user agent “Googlebot/2.1”. Voilà! You can go where Google can go. What a beautiful hack!

With Firefox, you can get this result with the User Agent Switcher.

More details are available on Pinguy’s website.

Also see my post Google was eating all my bandwidth!

One thought on “Get into pay sites for free as a Googlebot”

Leave a Reply

Your email address will not be published. Required fields are marked *

To create code blocks or other preformatted text, indent by four spaces:

    This will be displayed in a monospaced font. The first four 
    spaces will be stripped off, but all other whitespace
    will be preserved.
    
    Markdown is turned off in code blocks:
     [This is not a link](http://example.com)

To create not a block, but an inline code span, use backticks:

Here is some inline `code`.

For more help see http://daringfireball.net/projects/markdown/syntax