mod rewrite ,rss and sitemap. please help

[MichaelOstrovsk]

hello.

we have a huge directory of feeds , and a file feed.php that parses some feed and shows it as internal block , with link to the site that provides that feed ( feed.php?id=2361781 for example).

i managed to make mod rewrite working with this file - by adding
" RewriteRule ^feed(.*).html feed.php?id=$1 " to .htaccess.
i also managed to change the internal links to that pages in rows.html.

now, i want the search engines to recognize those pages as internal, so all those links in the feed headers ( to the actual sites ) will be recognized. also i need to add all those feed-pages to sitemap. please give me a clue on how can i achieve that, or alert me if im missing something.

thanks in advance.

[Bruceper]

IndexU is able to parse feeds in a block using <%block_rss_feed url="

You're using this feed.php just for SEO purposes, that's fine too.

I'm a bit lost on the last part though. If the URL is yourdomain.com/feed.php?id=1234 search engines WILL see that as "your" page, even if the links go somewhere else. It's yours because it's your domain the page is fed from.

As for adding them to the sitemap that would require quite a bit of modification as far as I know. It's possible you could use a third party application to spider all those and add the sitemap to your robots.txt

[MichaelOstrovsk]

the built-in rss parser isn't good enough, so we are using our own..
about the site map - we want search engines to be able to see all those links in hundreds of thousands of feeds .. . is it ok to make such huge sitemap o is there some quirks to tell the robots that we have , for example , pages .../feed1 to .../feed231563 ? tnx

[Bruceper]

You'd have to check with individual search engines, many of them have a limit as to how many url's they will look at in a single sitemap.

[MichaelOstrovsk]

thanks.

by 'search engines' i definitely mean 'Google'

If someone had experience with such directory-sitemaps ill be glad to here it ( although it's may not be directly related to indexu )