User-agent:linkCheck
Disallow:/_private/
Disallow:/cgi-bin/
User-agent:*
Disallow:/cgi-bin/
Disallow:/webalizer/
Disallow:/search/
Disallow:/popup/
revisit-after:14 days