These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
NEW - HAL wins innovation award Hawaii Ant Lab was honored at the 2018 Hawaii Conservation Conference by receiving an innovation award for their work in managing the Little Fire Ant menace on the Big Island and neighbor islands. Many thanks for the nomination!
Pictured above with the award is the HAL team (from left): Michelle Montgomery, Ersel Hensley, Cas Vanderwoude, Heather Forester, Jack Fields, Alison Wagner and Kiyoshi Adachi. (HAL staffers Matthew Sandrich and Mikey Bunyan not pictured)