#Disallow all acces to asp's, directories containg Film & People Info, since all these are generated dynamically. # Essentialy, only robot-rules.[htm|asp] should be indexed (and press_release.doc, if supported) # robot-rules.[htm|asp] contain Title, Description and Keywords - Summary for the entire site... # .asp (intended) and .htm (crippled) files included just in case robots have specific intructions NOT to index .asp files (sensible enough) # also disallow access to film.txt & people.txt indices for fuzzy search # and of course... global.asa, nothing to find there... User-agent: * Disallow: /banners/ Disallow: /FilmImages/ Disallow: /FilmSounds/ Disallow: /FilmTxt/ Disallow: /images/ Disallow: /last/ Disallow: /oscars2000/ Disallow: /PeopleImages/ Disallow: /PeopleTxt/ Disallow: /scripts/ Disallow: /TvProgs/ Disallow: /update/ Disallow: /user_uploads/ Disallow: film.txt Disallow: people.txt Disallow: global.asa Disallow: advertise.asp Disallow: awards.asp Disallow: banners.asp Disallow: bottom10.asp Disallow: color.asp Disallow: comment.asp Disallow: contact.asp Disallow: credits.asp Disallow: film.asp Disallow: film_footer.asp Disallow: film_redir.asp Disallow: footer.asp Disallow: genres.asp Disallow: help.asp Disallow: index.asp Disallow: legal.asp Disallow: makestart.asp Disallow: movies.asp Disallow: news.asp Disallow: oscar2000.asp Disallow: oscars2000.asp Disallow: oscar_contest.asp Disallow: oscar_graph.asp Disallow: oscar_image.asp Disallow: oscar_submit.asp Disallow: people.asp Disallow: people_footer.asp Disallow: prog.asp Disallow: rate.asp Disallow: redir.asp Disallow: results.asp Disallow: results_long.asp Disallow: search.asp Disallow: sendmail.asp Disallow: sound.asp Disallow: subscribe.asp Disallow: top10.asp Disallow: tvprog.asp Disallow: ucomments.asp