In the grand tradition of exclusivity, visitors aren't allowed inside the colleges in Oxford. This man made sure of it.