# robots.txt for http://www.cyric.tohoku.ac.jp/ User-agent: * Disallow: /local/ Disallow: /pub/ Disallow: /today/