Periodically recrawl all the links given to AI, as well as the entire site to get up-to-date info.