Any Indexu with >20000 links? How is it?

[gurame]

I am using indexu 304 and there is more 20000 links in database. The problem now is it very slow when we validating the new links. I have to approve one by one if there is more than 1 link submitted. If I click more than 1 then press the approve button it process to long and always time out error.
Seems to me the problem that make the script slow is when transferring from the table idx_link_temp to table idx_link . There are no prblem when rejecting/editing link as it only delete/edit from the idx_link_temp.

The other problem is searching is becoming slow and slow. When the database have 10K links there are no problems But now with 20K links in database......it is too slow.

I used to use the GTlinks2-nonmysql then transfer to indexu, it seems to me I will move back to GTlinks-mysql if there is no solution for this problem.

Another programmer said the database design should be improved as some of tables of indexu is not indexed. And also the script should rewrited to increase the speed.

I know you will say "You got what you paid", but when I paid $99 ......I expect a better script than this one.

Thanks

[Heiko]

[QUOTE]Originally posted by gurame
[B]I am using indexu 304 and there is more 20000 links in database. The problem now is it very slow when we validating the new links. I have to approve one by one if there is more than

Another programmer said the database design should be improved as some of tables of indexu is not indexed. And also the script should rewrited to increase the speed.

I know you will say "You got what you paid", but when I paid $99 ......I expect a better script than this one.


i have the same problem...even with 8.000 links :-(

heiko

[dody]

We tested with real data 3700 links and 127 categories. The result is good. You may have many categories. It's known that indexu will going slow when maintain over 400 categories which have many depth level.

It will perform slow when loading page which have "drop down list of categories" such as:
- add/edit category
- add/edit/validate link

If you look at the html source code (right click) you'll notice that it contain huge list of categories. You know what I mean. The slow caused by time consumed to download the page itself, not by indexu progress. But the download time.

If you switch back to GT, I'm sure you will have the same problem. When you perform search (in public page) or when browsing categories did you notice indexu run slow? I'm sure it's not. Please let me know if I miss something. And also I'd like to visit your website for evaluation. Please tell me you website url. Thank you.

[Frank71]

Dody !!!!!!!!!!!!
You are alive !!
Heiko do you use DSL ?
IF yes this is strange, if not, Dody is right.

No one is using the dmoz-database ?
I think in this must be really a lot of links.

Dody, whats about my questions to test and translate V3.1 into german and spanish ?

Greetings
Frank

[Heiko]

Originally posted by Frank71
Dody !!!!!!!!!!!!
You are alive !!
Heiko do you use DSL ?
IF yes this is strange, if not, Dody is right.

No one is using the dmoz-database ?
I think in this must be really a lot of links.

Dody, whats about my questions to test and translate V3.1 into german and spanish ?

Greetings
Frank

Don´t even think of it...Running Dmoz Catalog with indexu will not work...you are joking aren´t you.

I consider of buying new proffessional software...

i don´t have the time to wait 1 year for some small updates

[Frank71]

Hi Heiko,
which one is better for a good price ?
And wahts about your hacks you wanted only give away for money ?
Frank

[Heiko]

[QUOTE]Originally posted by Frank71
[B]Hi Heiko,
which one is better for a good price ?


Hi Frank.


well..not sure for now...if i knew...i would feel much better :-)

I have had some trouble with my database..got messed up...as
soon i have everything running i will post my hacks..ok

[dody]

Don´t even think of it...Running Dmoz Catalog with indexu will not work....

Yes you're correct. Indexu is not designed to run such extrimely large database like dmoz has. But indexu could able to maintain up to 50000 links.

However when you dealing with such as huge database there're many other factor that will effect the performance specially on hardware and cpu resource management. If you plan to have large database, like dmoz, you may need dedicated server instead on shared hosting. Always keep in mind that in shared hosting, other users may also perform complex computation that require cpu and memory resource.

The other important thing is how many visitors you have. Having 100 unique visitors /day is not the same with having 1000/day. Well combination both tons of visitors and tons of database should make your server very busy although you have dedicated server. At this time you'll need 2 servers, one serving www and another serving database queries.

Mysql itself is very fast, it can handle million records that require tera byte disk space. See www.mysql.com for detail. So I think it's not about database server issue.

[dody]

Dody, whats about my questions to test and translate V3.1 into german and spanish ?

Frank, thank you for your interest. We're now still on close beta test for indexu 3.1 where only qualified people / moderators can test it. Perhaps in late February we'll release beta test where current customer can test it.

We're considering your request on translating new version into german and spanish. Let see next until indexu 3.1 stable and released. Thank you.

[Veg]

Originally posted by Heiko



Don´t even think of it...Running Dmoz Catalog with indexu will not work...you are joking aren´t you.

I consider of buying new proffessional software...

i don´t have the time to wait 1 year for some small updates

To run the dmoz catalog using Indexu (or GT) would require you to run your own server. A shared server would not cope with it. Google and other search engines run a 'server farm' to be able to cope with search request etc.

Regards,

Veg
http://www.imm.com.au
Indexu Installations: US$20

[Frank71]

<where only qualified people / moderators

???
Moderators ok, but qualified people ?
What do you think about me ?

I offer you again free translating into german and perhaps into spanish, but if you wait until i have reworked my site again, it is not useful for me to translate YOUR templates, because then i will never use them again. If you say late february it is ok for me, but my experience is, that you mean late march
Or did you change your language support ?
This could be your chance to get it easy, perhaps also with special language "variables"...

I don't understand why you hesitate.

Greetings
Frank

[Frank71]

<Perhaps in late February

ai,
Dody, whats going on ?
Please tell us something about the beta tests, i think we are waiting really a long time.
Greetings
(Today from spain )
Frank

[Heiko]

Greetings
(Today from spain )
Frank [/B][/QUOTE]

On Holiday lucky guy ??


Ciao
Heiko

[dody]

We tested with real data 3700 links and 127 categories. The result is good. You may have many categories. It's known that indexu will going slow when maintain over 400 categories which have many depth level.

It will perform slow when loading page which have "drop down list of categories" such as:
- add/edit category
- add/edit/validate link

We have solved this problem. We have implement new algorithm and speed up this process twice as before. How deep your level will no more effect the speed. And the loading speed will be effected by how many categories you have and your internet connection.

[Heiko]

Originally posted by dody


We have solved this problem. We have implement new algorithm and speed up this process twice as before. How deep your level will no more effect the speed. And the loading speed will be effected by how many categories you have and your internet connection.

This sounds good