UK University Website Visibility - responding to the quirks of the crawler

I've got this idea for an app

The University in a Bind

The Delicious Discomfort Of Not Knowing: How to Lead Effectively Through Uncertainty

Going Online - Do Universities Really Understand The Internet?

IWMW 2013: Welcome

Beyond WCAG: Implementing BS8878

Collecting Geographical Metadata

Online Privacy

What Do You Really Want?

The Good, the Bad and the Ugly: Two Years of Running a Content Management Service

IWMW and the birth of a Content Strategist

Web 2.0 and Brand: Theory and Practice, James Souttar and Dean Russell, Precedent

Search Engines in the fight against Institutional Impecuniousness

Marketing Man takes off his Tie: Customers, Communities and Communication

Let the Students do the Talking...

Trends in Web Attacks

Building Highly Scalable Web Applications

Stop Trying to Avoid Losing and Start Winning: How BS 8878 Reframes the Accessibility Question

Are web managers still needed when everyone is a web 'expert'?