Google’s ever-active search bots, which scour the Web constantly for new pages, have begun a new, more active phase of their indexing jobs.
In a blog post Friday, Jayant Madhavan and Alon Halevy of Google’s crawling and indexing team said the company has begun an experiment in which its indexing software experimentally enters text in Web site forms to see what previously undiscovered pages may appear.
“In the past few months, we have been exploring some HTML forms to try to discover new Web pages and URLs that we otherwise couldn’t find and index for users who search on Google,” they wrote. “This experiment is part of Google’s broader effort to increase its coverage of the Web. In fact, HTML forms have long been thought to be the gateway to large volumes of data beyond the normal scope of search engines.”