# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /berlinermauermultilingual Disallow: /bestellung Disallow: /diemauer Disallow: /digimarcdeutsch Disallow: /indexdeutsch Disallow: /infodominicmiller Disallow: /kontakt Disallow: /ftpserver Disallow: /gaestebuch Disallow: /christiane/upb/