» Site Navigation | | » Recent Threads | looove 04-16-2024 01:18 PM 04-16-2024 01:18 PM 0 Replies, 500 Views | | lolita porn 04-13-2024 11:45 PM 04-13-2024 11:45 PM 0 Replies, 225 Views | lolita porn 04-13-2024 11:43 PM 04-13-2024 11:44 PM 1 Replies, 143 Views | lolita porn 04-13-2024 11:40 PM 04-13-2024 11:41 PM 1 Replies, 152 Views | lolita porn 04-13-2024 11:38 PM 04-13-2024 11:39 PM 1 Replies, 153 Views | lolita porn 04-13-2024 11:36 PM 04-13-2024 11:37 PM 1 Replies, 150 Views | lolita porn 04-13-2024 11:35 PM 04-13-2024 11:35 PM 0 Replies, 132 Views | lolita porn 04-13-2024 11:34 PM 04-13-2024 11:34 PM 0 Replies, 135 Views | lolita porn 04-13-2024 11:33 PM 04-13-2024 11:33 PM 0 Replies, 131 Views | | | | | 04-06-2006, 08:29 PM | #1 | Senior Member Join Date: Apr 2005 Location: Southern California Posts: 420 | Yahoo! Slurp Spider ? What's a Yahoo! Slurp Spider ? Every time I come to the site I see 7 to 10 of these viewing several forms at one time? __________________ "Success is Never Final, Defeat is Never Permanent, it is the Courage to Continue that Matters!" - Winston Churchill Mothman [SIGPIC] | | | 04-06-2006, 10:32 PM | #2 | Senior Member Join Date: Jun 2003 Location: Greenville, SC Posts: 9,356 | It's indexing the message board. Google also hits the site hard. __________________ ...steven BMW CCA #146825 1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i www.bmwcca.org | | | 04-06-2006, 11:06 PM | #3 | Senior Member Join Date: Aug 2004 Location: state college, pa Posts: 3,431 | Quote: Originally Posted by 1996 328ti It's indexing the message board. Google also hits the site hard. | You know about robots.txt? I suppose you want the site to show up on search, but you could always **** tag the splash page. __________________ I scream, you scream, we all scream for ZOMBIES. | | | 04-07-2006, 12:39 AM | #4 | Senior Member Join Date: Jun 2003 Location: Greenville, SC Posts: 9,356 | Quote: Originally Posted by aceyx You know about robots.txt? I suppose you want the site to show up on search, but you could always **** tag the splash page. | Yes. msnbots are forbidden. There was a time that msn was consuming 30% of my bandwidth. It caused the site to go down a few times. http://www.318ti.org/robots.txt __________________ ...steven BMW CCA #146825 1996 BMW 328ti • 2003 MINI Cooper S • 2016 M235i www.bmwcca.org | | | | Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | | Posting Rules | You may not post new threads You may not post replies You may not post attachments You may not edit your posts HTML code is Off | | | |
All times are GMT +1. The time now is 08:55 PM.