A Indexu Website Crawl Feature

[Hart_House]

Make indexu help us build our links database much easier by adding a website crawl feature.

For example, this crawl feature should allow the admin or end user to enter a url and the scripts crawls the website for a title and short description and adds it to its database.

This is what some of the other top web indexing sites have added and indexu must follow with in order to stay up as a premier script that we all know it to be.


Hart

Any suggestions or comments would be great.

[dody]

Thanks Hart_House, that's good idea. We'll consider it.

[ideavirus]

should be a great addition, when completed...Hopefully soon or in one of the next releases...!

thanks

[kservik]

It is a very good idea. Improving searhc engine for larger sites is important.

[inspireme]

Try this, gets meta keywords, title, and description from website. I only did it for the admin section, but look at the code and you could easily use it as a base to make it for the public area as well.

I ended up doing something different with indexu than I first expected, so this never got completed so it has a few rough edges.

[esm]

I developed one a little different than yours ...


.

[kservik]

Can I take a look at the site you have implemented it on, esm?

Kim

[inspireme]

can i have a look esm? your is probably loads better :P

[landuyt]

is there someone who get this worked for 5.0.3?

I tried but it shows only the metatags, it doesn't fill them in the formfields

it worked very well in v3

greetings peter

[inspireme]

I been thinking about doing this again for v.5, I would recommend using esms hack addlinks - its super for adding your own listigns quickly. this is really just to make visitors life a little easier when adding information, I may give it a go on v5 a little later.

by the way, havent looked but im thinking its the way the variable is passed to the template differently now, the code wont have changed.

[inspireme]

very little needed to be changed, just to make it work with smarty.

I will do one for the public area later.

[landuyt]

Thx!!!!!!!!!
It works perfect !

let me know if the public one is ready !

greetings peter

[inspireme]

no problem. i think the public one will take a bit longer - that oens a bit rough but it doesnt so much matter if its jsut for the admin panel.

I will have a go next week.

[inspireme]

public one :

http://www.theleisureguide.co.uk/addselect.php?cat=45

tell me what you think - i want to improve it so it gets the title tag and maybe email... I need to say this is nothing like what esm has done, his is piles better as it can also browse through your database records get more information, crawl multiple pages, crawl multiple sites Its something completly different. I have purchased esms addlinks and its a superb piece of software. The hack i have done is filling a gap that esms software doesnt- making it easier for business owners to add their site. Esm has concentrated on giving the webmaster super quick ways of adding links.

If you want this then please PM me, or email (matt@erfiedesign.co.uk) Its free with a nice email, but donations appreciated via paypal (address above) $30 if you want me to install it.

Have a few hours work to get it working nice but im a designer and have 3 client sites to finish this week so should stop playing around on my hobby sites and do something that pays!!!

Kind Request :
Please dont type in your postcode and press submit, i pay for the geocoding data and everytime its done i get charged, no worries if thats a listing - but dont really want people "just testing"

[esm]

I'm working on a MOD to allow markup of the description field in addition to adding the meta info.

for a demo see http://www.indexuhelp.com/indexu51/a...add_select.php



.