To: NIRS Consortium
From:
Paolo Berzaghi
Date: 8-28-00
First Evaluation of the
Instrument Standardization Procedure:
As you may remember, at the Consortium annual meeting we discussed the importance of instrument standardization. At that time it was proposed to include a forage standardization set (14 sealed cells) instead of only the characterization set (30 sealed cells) normally used. Before using the new standardization procedure on all the instruments, we had agreed to test it on the 6 alfalfa breeders and make an evaluation comparing the standardization performances with the 2 sets of sealed cells.
Following Mark Matteson’s advice, the 2 standardization sets available to the Consortium were tested for leaks. As a result of those tests, all the cells had to be repaired. The 30 cell characterization set was repacked with the same samples that the cells originally contained. In the 14 cell forage set, six new forage samples were selected from the Alfalfa breeders, including both 1 and 2mm grind, to replace some outdated samples.
The two standardization sets were scanned twice on each breeder’s instrument and samples that did not show good spectra repeatability were scanned again. The same process was carried out on the Consortium Master at US Dairy Forage Research Center before and after each breeder visit. Spectral matching between the Master and each breeder’s instrument was performed using the entire characterization set and also using the 6 cups filled with the breeder’s samples. Comparison of the two standardization techniques were made using breeders equation (99alf2.eqa) to predict the remaining 8 cups of the forage set, which function as an independent set to evaluate instrument differences after standardization. The new standardizations were then compared with the old standardization, already present in the instrument computer, which was developed using only the characterization set.
Summary statistics of the prediction made by the 6 alfalfa breeder instruments using different standardizations are shown in Table 1. The variation among instruments using the standardization already in place was quite large. For example the prediction of the 8 validation samples averaged 21.42 % for CP, but the lowest instrument was predicting 20.78 and the highest 22.23 with a difference of 1.5 %. Large variations were also evident for ADF and NDF.
Running a new standardization with the repaired characterization set reduced the variability as exhibited by the decrease in standard deviation (SD) values. In particular, the new characterization reduced the spread among instruments by improving the performance of the instrument with the oldest standardization file. This instrument with the oldest standardization was consistently extreme in the range of values in the old standardization. This improvement outlines the importance of running the standardization procedure on a regular basis, every one or two years.
The greatest improvement in the network performance, however, was obtained with the forage standardization, which reduced the SD to 0.1 for CP and lower than 0.25 for the fiber fractions. ISI recommends that the check cell predictions that indicate instrument variation should have a maximum SD of 0.30. The SD obtained with the forage standardization set indicates variability among Consortium instruments that is within the variation limits normally accepted for a single instrument.
Further, the 14 cell forage set, repaired and with 6 new samples, has showed consistent scanning in all components. This indicates that leaks are not present and the set is ready to use for standardization on commercial labs.
Moving
to the second phase of the standardization process, I would suggest that we use
the forage set to standardize the commercial lab instruments. For those labs
that also use Consortium non-forage calibrations (i.e. roasted soybean
equation), standardization with the characterization set will also be
used. The forage standardization is recommended
for scanning forage samples, and the characterization standardization is
recommended for scanning non-forage products.
The appropriate standardization may be chosen; depending on what type of
sample is being scanned.
Considering the outcome of this first evaluation, I would suggest the Consortium develop a third standardization for corn silage. This would require the participation of labs in the search for corn silage standards. More details of this CS Standardization will follow, after consensus and input from commercial labs.
Table 1. Mean, Minimum, maximum and standard
deviation of prediction of 8 forage standardization set samples by the
breeder’s instrument using different standardizations.
|
|
Before STD |
STD with Characterization
set |
STD with Forage set |
|
CP |
|
|
|
|
Mean |
21.42 |
20.92 |
20.89 |
|
Min |
20.78 |
20.17 |
20.76 |
|
Max |
22.23 |
21.16 |
21.00 |
|
SD |
0.53 |
0.36 |
0.10 |
|
ADF |
|
|
|
|
Mean |
33.18 |
33.25 |
33.44 |
|
Min |
32.27 |
32.10 |
33.13 |
|
Max |
34.53 |
34.67 |
33.76 |
|
SD |
0.86 |
0.77 |
0.23 |
|
NDF |
|
|
|
|
Mean |
40.37 |
40.25 |
40.48 |
|
Min |
39.08 |
39.30 |
40.11 |
|
Max |
41.24 |
41.68 |
40.70 |
|
SD |
0.84 |
0.78 |
0.24 |