beautypg.com

3 absolute resistance accuracy, 4 measurement current accuracy, Table 3 resistor stability specifications – Fluke 1595A User Manual

Page 17: Absolute resistance accuracy, Measurement current accuracy, Introduction and specifications

background image

7

Introduction and Specifications

Specifications

Table 3 Resistor Stability Specifications

Resistor (Rs) Accuracy (ppm of reading),

95 % confidence level
24 hours

30 days

1 W

5 ppm

10 ppm

10 W

0.5 ppm

2 ppm

25 W

0.25 ppm

1 ppm

100 W

0.2 ppm

1 ppm

10 kW

0.25 ppm

1 ppm

2.2.2.3 Absolute Resistance Accuracy

Absolute resistance accuracy is the ability of the instrument to measure absolute resistance, Rx, using the

internal reference resistors. The following specifications apply using the given reference resistor, Rs, and

excitation current.
The 1-year specifications include calibration uncertainty, reference resistor drift, ambient temperature sensitiv-

ity, resistance ratio uncertainty, and measurement noise using 1-minute average and a 2-second sample period

(n = 30).
Performance verification is guaranteed for 99% confidence level, 1-year specifications within the specified

operating temperature range of 15°C to 30°C, maintaining a calibration interval of 6 months for the first year

and 1 year thereafter.

Table 4 Absolute Resistance Accuracy Specifications

Resistance range (Rs, current)

Accuracy (ppm of reading)

95% confidence level, 1-year

W to 1.2 W (1 W, 10 mA)

Greater of 40 ppm or 0.000012 

W

W to 12 W (10 W, 3 mA)

Greater of 10 ppm or 0.000024 

W

W to 120 W (25 W, 1 mA)

Greater of 5 ppm or 0.000024 

W

W to 400 W (100 W, 1 mA)

Greater of 4 ppm or 0.00008 

W

0

W to 10 kW (10 kW, 10 mA)

Greater of 5 ppm or 0.000012 k

W

10 k

W to 40 kW (10 kW, 10 mA)

8 ppm

40 k

W to 100 kW (10 kW, 2 mA)

20 ppm

100 k

W to 500 kW (10 kW, 1 mA)

80 ppm

99% confidence level, 1-year

W to 1.2 W (1 W, 10 mA)

Greater of 50 ppm or 0.000015 

W

W to 12 W (10 W, 3 mA)

Greater of 13 ppm or 0.00003 

W

W to 120 W (25 W, 1 mA)

Greater of 6.3 ppm or 0.00003 

W

W to 400 W (100 W, 1 mA)

Greater of 5 ppm or 0.0001 

W

0 k

W to 10 kW (10 kW, 10 mA)

Greater of 6.3 ppm or 0.000015 k

W

10 k

W to 40 kW (10 kW, 10 mA)

10 ppm

40 k

W to 100 kW (10 kW, 2 mA)

25 ppm

100 k

W to 500 kW (10 kW, 1 mA)

100 ppm

2.2.2.4 Measurement Current Accuracy

Measurement current accuracy is guaranteed to meet the following specifications. The specifications are stated

as percent of selected current or in absolute mA.

This manual is related to the following products: