beautypg.com

Google Search Appliance Administrative API Developers Guide: Protocol User Manual

Page 35

background image

Google Search Appliance: Administrative API Developer’s Guide: Protocol

35

Crawl Errors:

Crawl Exclusions:

Value

Description

7

Redirect with no location header

11

Document not found (404)

12

Other HTTP 400 Errors

14

HTTP 0 error

15

Permanent DNS failure

16

Empty document

17

Image conversion failed

22

Authentication failed

25

Conversion error

32

HTTP 500 error

33

Robots.txt unreachable

35

Temporary DNS failure

36

Connection failed

37

Connection timeout

38

Connection closed

40

Connection refused

41

Connection reset

43

No route to host

50

Other error

Value

Description

3

Not in URLs to crawl

4

In URLs not to crawl

5

Off domain redirect

6

Long redirect chain

8

Infinite URL space

9

Unhandled protocol

10

URL too long

13

Robots no-index

18

Rejected by rewrite rules

19

Unknown extension

20

Disallowed by a meta tag

24

Disallowed by robots