Starting in 1996, Alexa Internet has been donating their crawl data to the Internet Archive. Flowing in every day, these data are added to the Wayback Machine after an embargo period.

Collection: 51_crawl

this data is currently not publicly accessible.

Company: BJ Services

Search Engine Optimization Mistakes:

Using frames in website design.

The Web is based on the concept of having the webpage as the smallest unit of information and using links for navigation between pages. This simplicity helped the Internet become extremely popular.

Frames deviate from this concept. With frames, the web page is divided into segments. Within a single segment, the user may navigate to different content areas, all the while remaining on the same page.

Linking navigation does not work on framed websites: the URL in the address bar remains constant and therefore does not properly represent the information on the page. As a result, visitors can’t bookmark an individual page to visit it later.

Search engine robots are similarly frustrated by frames. They cannot follow up framed pages to index them. For example, at right is a cached homepage of a website with frames. As you can see, the framed page has been indexed without cached information.

Websites with framed pages will have a very hard time achieving good search engine ranking.

 

What should be done?

The best way to fix problems with frames is to redesign the website. Remove all frames and use a flat structure for the website. Doing so will increase both search engine rankings and website usability.