Menu
Forums
New posts
Search forums
What's new
New posts
Latest activity
Log in
Register
What's new
Search
Search
Search titles and first posts only
Search titles only
By:
New posts
Search forums
Menu
Log in
Register
Install the app
Install
Help Support The Rugby Forum :
Forums
Other Stuff
The Clubhouse Bar
There are currently 274 users online. 19 members and 255 guests
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Reply to thread
Message
<blockquote data-quote="smartcooky" data-source="post: 752874" data-attributes="member: 20605"><p>Most of those guests are probably not "stalkers" in the sense that you are thinking</p><p></p><p></p><p>At least half of them are likely to be webcrawlers such as Googlebot, majestic12, CydralSpider, Spiderbot etc. Here is a partial list of over 300 - <a href="http://www.robotstxt.org/db.html" target="_blank">http://www.robotstxt.org/db.html</a></p><p></p><p>There will also be Spam Bots and other such nefarious things looking for ways in to deliver their rubbish</p><p></p><p>There will even be TRF users among the guests, for example, if you log out but leave your browser open on the TRF url, you will be one of the guests.</p></blockquote><p></p>
[QUOTE="smartcooky, post: 752874, member: 20605"] Most of those guests are probably not "stalkers" in the sense that you are thinking At least half of them are likely to be webcrawlers such as Googlebot, majestic12, CydralSpider, Spiderbot etc. Here is a partial list of over 300 - [url]http://www.robotstxt.org/db.html[/url] There will also be Spam Bots and other such nefarious things looking for ways in to deliver their rubbish There will even be TRF users among the guests, for example, if you log out but leave your browser open on the TRF url, you will be one of the guests. [/QUOTE]
Verification
Post reply
Forums
Other Stuff
The Clubhouse Bar
There are currently 274 users online. 19 members and 255 guests
Top