Results 1 to 12 of 12

Thread: Site List / Spider Page

  1. #1
    Join Date
    Apr 2003
    Location
    NY
    Posts
    331

    Default Site List / Spider Page

    http://www.hudsonnights.com/sitelist.php

    i made this so spiders find all my links easy. its all self contained, you just have to drop it in your root dir.
    and add it to your footer.html.(make a 1px x 1px image, and link it to sitelist.php if you dont want people to see it.)
    Attached Files Attached Files

  2. #2
    Join Date
    Feb 2004
    Posts
    455

    Default

    Hello,

    Great idea!

  3. #3
    Join Date
    Apr 2003
    Location
    NY
    Posts
    331

    Default

    let me know if it works for your site

  4. #4
    Join Date
    Feb 2004
    Posts
    455

    Default

    I did use something like that some time ago but the created page is just too large.

  5. #5
    Join Date
    Apr 2003
    Location
    NY
    Posts
    331

    Default

    i am working on something now for larger sites. my drinks section has 25000 links. i am going to creat html pages with propagation so it will have 2500 links on a page.

  6. #6
    Join Date
    Feb 2004
    Posts
    455

    Default

    A lot of drinking in Huston!
    Please let me know how it works out.

  7. #7
    Join Date
    Apr 2003
    Location
    NY
    Posts
    331

    Default

    well its been up for about a week now, and i am seeing a increse of search hits about 30-40 a day just from the sitelist.php

  8. #8
    Join Date
    Apr 2003
    Location
    NY
    Posts
    331

    Default

    This is great google just searched my site a weekago and i got all 1200+ links on google now.....!!!!

    my freind has a site with the same script. he has 25000 links and after one month he had 5000 link spiderd and this month it jumped up to 8500 links....

    sweet!

  9. #9
    Join Date
    Aug 2002
    Location
    Germany
    Posts
    1,180

    Default nop

    Hello,

    nearly 100kb - I think G. will cut after 100kb and if the page is to lartge the risk to be a spammer is high - because of that I asked for the show_all-hack again

    Frank

  10. #10
    Join Date
    Sep 2004
    Posts
    162

    Default

    The code works great. What code would i need to make it multiple pages? or would that defeat the purpose?

    brickholius

  11. #11
    Join Date
    Feb 2005
    Posts
    2

    Default

    Thats a great hack! Anyone come up with a way to do multiple pages or better yet, pages by letter? i.e. A listings - B listing ----- Z Listings?

  12. #12
    Join Date
    Nov 2004
    Posts
    1,822

    Default

    cant remember the user that posted this tip but it was useful to me :

    if you type "---" into the search box it will output all your catagories. from this you can copy the source code and then manaully split it into smaller chunks quite easily. I have 300ish catagories so I will spilt them into logical thirds. Just an alternative
    Main IndexU sites : | Campsite Directory | Tourist Guide | Places2B | AfterDirectory <-- Half price submission using coupon DP50 (from just $11 premium, and $10 basic permanent )

Similar Threads

  1. Replies: 0
    Last Post: 02-13-2004, 08:56 PM
  2. Addition of a framed return to site on top
    By lordkinjo in forum v3.2
    Replies: 3
    Last Post: 07-09-2003, 09:28 AM
  3. Modify Site Problem
    By sulaco in forum v5.x
    Replies: 0
    Last Post: 04-02-2003, 02:04 PM
  4. Check this out (The Big List)
    By RichardDuboi in forum v3.2
    Replies: 0
    Last Post: 09-29-2002, 01:50 PM
  5. Header & Footer on "My Account" page
    By joyorudis in forum v5.x
    Replies: 5
    Last Post: 08-04-2002, 09:04 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •