 » Site Navigation | | | | » Recent Threads | looove 04-16-2024 01:18 PM 04-16-2024 01:18 PM 0 Replies, 484 Views | | | lolita porn 04-13-2024 11:45 PM 04-13-2024 11:45 PM 0 Replies, 223 Views | lolita porn 04-13-2024 11:43 PM 04-13-2024 11:44 PM 1 Replies, 143 Views | lolita porn 04-13-2024 11:40 PM 04-13-2024 11:41 PM 1 Replies, 150 Views | lolita porn 04-13-2024 11:38 PM 04-13-2024 11:39 PM 1 Replies, 151 Views | lolita porn 04-13-2024 11:36 PM 04-13-2024 11:37 PM 1 Replies, 148 Views | lolita porn 04-13-2024 11:35 PM 04-13-2024 11:35 PM 0 Replies, 130 Views | lolita porn 04-13-2024 11:34 PM 04-13-2024 11:34 PM 0 Replies, 132 Views | lolita porn 04-13-2024 11:33 PM 04-13-2024 11:33 PM 0 Replies, 129 Views | |  |  |  |  04-06-2006, 08:29 PM | #1 | | Senior Member Join Date: Apr 2005 Location: Southern California Posts: 420 |  Yahoo! Slurp Spider ?
What's a Yahoo! Slurp Spider ? Every time I come to the site I see 7 to 10 of these viewing several forms at one time?  __________________  "Success is Never Final, Defeat is Never Permanent, it is the Courage to Continue that Matters!" - Winston Churchill
Mothman 
[SIGPIC] |  |  | | 04-06-2006, 10:32 PM | #2 | | Senior Member Join Date: Jun 2003 Location: Greenville, SC Posts: 9,356 |
It's indexing the message board.
Google also hits the site hard. __________________ ...steven
BMW CCA #146825
1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i
www.bmwcca.org
| | | | | 04-06-2006, 11:06 PM | #3 | | Senior Member Join Date: Aug 2004 Location: state college, pa Posts: 3,431 |
Quote: | Originally Posted by 1996 328ti It's indexing the message board.
Google also hits the site hard. | You know about robots.txt? I suppose you want the site to show up on search, but you could always **** tag the splash page. __________________
I scream, you scream, we all scream for ZOMBIES. | | | | | 04-07-2006, 12:39 AM | #4 | | Senior Member Join Date: Jun 2003 Location: Greenville, SC Posts: 9,356 |
Quote: | Originally Posted by aceyx You know about robots.txt?
I suppose you want the site to show up on search, but you could always **** tag the splash page. | Yes. msnbots are forbidden.  There was a time that msn was consuming 30% of my bandwidth. It caused the site to go down a few times. http://www.318ti.org/robots.txt __________________ ...steven
BMW CCA #146825
1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i
www.bmwcca.org
| | | | |
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | | |
 Posting Rules | You may not post new threads You may not post replies You may not post attachments You may not edit your posts
HTML code is Off
| | |
|
All times are GMT +1. The time now is 06:29 PM.
Linear Mode
