I saw this cool feature in INDEXU competitors website.

[roy]

Hi guys,

I would like to share a feature that I thought can be implemented into Dody's INDEXU v4.

It crawls google and automatically add links and describtion by grabbing the META tags.

http://www.mrcgiguy.com/spider-readme.htm

Describtion:
So I've finally got around to making a nice little link dumping tool for Hot Links SQL. If you're scratching your head wondering what the heck this does, here's the idea in a nutshell
This script will query Google with whatever search terms you enter, dump all the links it finds into a temporary file, then it spiders the links for the meta info and adds them into your database. This makes finding new links (new link partners perhaps) insanely easy. All you have to do is approve the links. You can choose to pre-sort the links into a specific category. You can also choose to let the script assume that the email address belonging to the link will be webmaster@whatever.com (9 times out of 10 that will be a valid email address). That way, when you approve the link, the link addition email with your recip link info goes to the link owner. Easy way to get new reciprocal links, I'd say.

[imno007]

I haven't used it, but I can guess the big amount of time it'll take on average to weed out all the crap from the good stuff....

[ccreighton]

Roy,

Can you share your script?

[roy]

What script?

Roy,

Can you share your script?

[ccreighton]

Above you mentioned a feature or script that would crawl google with whatever search terms you enter, dump all the links it finds into a temporary file, then it spiders the links for the meta info and adds them into your database. That's what I'm referring to. Is it a script or what? Can you make it available?

[roy]

Ahhh, read the first post. I think you misunderstood.