Locality, Hierarchy, and Bidirectionality in the Web

The World Wide Web has been previously observed to be a "small world net- work" in which nodes are clustered together. We provide evidence, based on a crawl of over a billion pages, that such a clustering eect corresponds very closely to the hierarchical nature of URLs. We also show that bidirectionality on the web graph is much more common than previous models predicted. We then propose a new paradigm for models of the Web that incorporates the hierarchical evolution and structure that is evident in the Web.