Google Search Appliance Getting the Most from Your Google Search Appliance - Manual (Page 25)

Google Search Appliance: Getting the Most from Your Google Search Appliance Crawling and Indexing 25
6. If required by the connector, configuring secure crawling of the content management system by
using the Admin Console page that is appropriate for the specific connector.
7. Restarting the connector.
8. Verifying that the search appliance is indexing URLs from the connector by using the Index >
Diagnostics > Index Diagnostics page.
Learn More about Connectors
For in-depth information about connectors, refer to the Google Search Appliance connector documents.
Indexing Hard-to-Find Content
During crawl, the search appliance finds most of the content that it indexes by following links within
documents. However, many organizations have content that cannot be found this way because it is not
linked from other documents. If your organization has content that cannot be found through links on
crawled web pages, you can ensure that the Google Search Appliance indexes it by using Feeds. Feeds
are also useful for the following types of content:
• Documents that should be crawled at specific times that are different from those set in the crawl
schedule
• Documents that could be crawled, but are much more quickly uploaded using feeds.
You can also use feeds to delete data from the index on the search appliance.
The Google Search Appliance Supports two types of feeds, as described in the following table.
Type Description
Web feed A web feed does not provide content to the Google Search Appliance. Instead, a web
feed provides a list of URLs to the search appliance. Optionally, a web feed may
include metadata. The crawler queues the URLs listed in the web feed and fetches
content for each document listed in the feed. Web feeds are incremental. The
search appliance recrawls web feeds periodically, based on the crawl settings for
your search appliance.
Content Feed A content feed provides both URLs and their content to the search appliance. A
content feed may include metadata. A content feed can be either full or
incremental. The search appliance only crawls content feeds when they are pushed.