Indexing Spider

[hermit36]

Hi Dody is there a way that we can include an indexing spider to crawl web pages? I am interested in it. Please PM me ASAP on this

[hermit36]

still no answer?

[ezykiwi]

Im just going to take a guess and would presume this would nearly need to be a seperate system.... a indexing spider would nearly be a script in itself.... have you used any other spiders and maybe looked at using the output and putting it over to indexu

[hermit36]

We will only develop it if Indexu can't do it. Anyway Indexu is the main developer that develop the software in which they should be the one to know how to integrate an indexing spider better than anyone else. For us to develop it will take much longer time to go through Indexu scripts and fully understand its script first before we can even start to develop the indexing script. we are willing to pay for it anyway. As for the system....... we know what we are doing..... Using other indexing script may not be good........