| Abstract|| |
Context: The International Consensus Group for Hematology Review (ICGHR) are essentially review criteria designed to reduce the number of manual smear reviews following analysis in automated hematology analyzers (AHAs). Although AHAs are an indispensable part of the present-day clinical laboratory, manual smear reviews still play an integral role in identifying morphological abnormalities and to confirm the results of the analyzers. Aims: The aim of this study is to evaluate the efficacy of the ICGHR criteria and our laboratory criteria using the Sysmex XN-1000 for manual peripheral smear review (MSR). Study Design: A prospective cross-sectional comparative study between the two sets of criteria for MSR was performed. Material and Methods: A total of 860 whole blood samples sent over a period of 19 months for complete blood count testing to our laboratory were collected using systematic random sampling. Truth tables were prepared for each set of criteria. Tests of proportion were used to compare performance specifications between both sets of criteria. Results: Using ICGHR criteria, sensitivity was 81.58%, specificity was 84.61%, 83.38% positive predictive value, and 82.92% negative predictive value. The microscopic smear review rate was 47.56% and efficiency was 83.14%. Using our laboratory criteria, sensitivity was 98.80%, specificity was 41.40%, positive predictive value of 61.46%, and negative predictive value of 97.34%. The microscopic smear review rate was 78.14% and efficiency 69.30%. Conclusions: There was a significant reduction in the microscopic smear review rates using the ICGHR criteria compared to our laboratory criteria. The ICGHR criteria can thus be adapted to daily laboratory practice provided they are first optimized and locally validated before use.
Keywords: Automated hematology analyzers, International Consensus Group for Hematology Review criteria (ICGHR), manual peripheral smear review
|How to cite this article:|
Palur K, Arakeri SU. Effectiveness of the International Consensus Group criteria for manual peripheral smear review. Indian J Pathol Microbiol 2018;61:360-5
|How to cite this URL:|
Palur K, Arakeri SU. Effectiveness of the International Consensus Group criteria for manual peripheral smear review. Indian J Pathol Microbiol [serial online] 2018 [cited 2020 Jan 20];61:360-5. Available from: http://www.ijpmonline.org/text.asp?2018/61/3/360/236596
| Introduction|| |
Automated hematology analyzers (AHA) have reduced the number of manual hematology procedures and increased the speed of reporting without sacrificing the quality of results. In the era of sophisticated AHAs, it is, therefore, unnecessary to perform manual peripheral smear review (MSR) for each and every hematology sample.
AHAs are superior to manual methods for the count of white blood cells (WBCs), red blood cells (RBCs), and platelets and for differential counting of mature WBC. Despite great precision, high accuracy and expandability of AHAs, MSR still plays an important role in identifying morphological abnormalities, immature cells, and certain sample characteristics such as platelet clumps. MSRs are also used to confirm the results produced by the analyzer.,,,
To reduce the rate of MSR, the International Society for Laboratory Hematology (ISLH) through the International Consensus Group for Hematology Review (ICGHR) published a set of rules for peripheral smear review following analysis of samples on AHAs. These rules are essentially review criteria for automated blood count analysis and have since been considered an international standard for MSR. The ICGHR has also put forth procedures to follow when complete blood count (CBC) results do not meet the criteria, which specifically include preparation of a peripheral blood smear followed by MSR. These rules take into account gender and age of the patients, whether the sample is sent for the first time or a subsequent sample has been sent to monitor the CBCs and whether there has been a significant difference between the results., Application of these criteria will, in turn, reduce the laboratory cost and turnaround time thus improving productivity.
The aim of this study was to evaluate the effectiveness of the ICGHR criteria alongside our laboratory criteria for MSR to determine optimal review criteria for our laboratory to enhance productivity and cost-effectiveness.
| Subjects and Methods|| |
A prospective cross-sectional comparative study was performed on whole blood samples sent for CBC testing to the central laboratory in our hospital. The study included a total of 860 blood samples collected from both inpatients and outpatients from all the departments in the hospital during 19 months. The study has been approved by the institutional ethical committee.
Under aseptic precautions, 2 ml of venous blood was collected from antecubital vein into K3 EDTA (tripotassium salt of ethylenediaminetetraacetic acid) vacutainers and mixed well by gentle inversion. Using systematic random sampling, first ten samples were collected from the daily workload and analyzed within 1 h of collection. Analysis of all blood samples was performed using the 6-part differential automated hematology analyzer, Sysmex XN-1000. Procedures for quality control and quality assurance were followed during the entire period of this study.
Thin blood smears were prepared for all the samples in the study and were stained with Leishman stain. MSR along with a 100-cell manual differential count was performed to identify morphological abnormalities, immature cells and to confirm results produced by the analyzer. Each sample was reviewed according to adapted ICGHR criteria and our laboratory criteria. A rule in the criteria would be triggered when the result was beyond the specified range and/or a specified flag appeared.
Samples showing sampling errors such as inappropriate blood to anticoagulant proportion, tiny clots or inadequate blood sample were excluded from the study. Samples from the pediatric population were also excluded as the ICGHR criteria in the study were taken with respect to adults.
With respect to the ICGHR review criteria, certain adaptations were made as per the study done by Comar et al. [Table 1], henceforth referred to as the ICGHR criteria. These main adaptations were made with regard to delta check rules and rules for reticulocytes owing to the limitations in the instrument used in this study and record systems during the study period. The AHA's results were also reviewed according to our laboratory criteria which have been adapted from the normal reference ranges specified in Dacie  and Wintrobe. Criteria for positive smear followed in this study are shown in [Table 2].
|Table 1: Adapted International Consensus Group for Hematology Review criteria and our laboratory criteria for automated complete blood counts - Screening Criteria|
Click here to view
|Table 2: Criteria for a positive smear based on cell morphology and cell type|
Click here to view
A sample was classified as true positive (TP) if it was positive for the screening criteria with positive findings on the peripheral smear, false positive (FP) if it was positive for screening criteria with no abnormal findings on the peripheral smear, false negative (FN) if it was negative for screening criteria but with abnormal findings on the peripheral smear and true negative (TN) if it was negative for both screening criteria and MSR.
Tabulation of data was done using Microsoft Excel software. TP, TN, FP and FN rates, efficiency, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and microscopic smear review rates (MRRs) for both the ICGHR criteria and the laboratory criteria were calculated and truth tables were prepared accordingly. The various parameters calculated were sensitivity (%) = (TP/[TP + FN]) × 100, specificity (%) = (TN/[TN + FP]) × 100, positive predictive value (%) = (TP/[TP + FP]) × 100, negative predictive value (%) = (TN/[TN + FN]) × 100, efficiency (%) = ([TP + TN]/[TP + FP + FN + TN]) × 100 and microscopic review rate (%) = ([TP + FP]/[TP + FP + FN + TN]) × 100. Further statistical analysis was performed using tests of proportion to compare the different performance specifications between both sets of criteria. A value of P < 0.05 was considered statistically significant.
| Results|| |
Of the total of 860 samples analyzed in this study, 409 samples (47.56%) were positive and 451 samples (52.44%) were negative for the ICGHR review criteria. Out of the total number of samples positive for the review criteria, 341 samples out of 409 (83.37%) had positive smear findings and 68 samples (16.63%) were negative for smear findings. Among the samples that did not trigger any review criteria (451 samples), 374 (82.92%) were truly negative on peripheral smear examination, but 77 out of 451 (17.07%) had positive smear findings. An MRR of 47.56% was observed using the ICGHR review criteria.
Using our laboratory review criteria, 672 out of 860 were positive (78.14%) and 188 were negative (21.86%). Of all the positive samples, 413 samples (61.46%) showed positive smear findings, and 259 samples out of 672 (38.54%) were negative for smear findings. Five samples (2.66%) out of the 188 samples negative for the laboratory review criteria showed positive smear findings, i.e., morphological abnormalities and 183 samples (97.34%) were negative for both our laboratory's review criteria and positive smear criteria. A higher MRR of 78.14% was observed with the use of the laboratory criteria.
The samples that required review were further analyzed according to the criteria triggered, i.e., the total number of triggers for each parameter was analyzed regardless of the other parameters triggered in that sample, to analyze the most common reasons for MSR.
There were a total of 1323 and 3232 positive occurrences using the ICGHR and our laboratory criteria, respectively. The proportions of the commonly triggered criteria with respect to the total number of positive occurrences were then calculated accordingly. With the ICGHR criteria, the suspect flags (522 samples; 39.46%) were most commonly triggered followed by RBC (456 samples; 34.46%), platelet (211 samples; 15.97%), and WBC parameters (134 samples; 10.11%). With our laboratory criteria, the RBC parameters (1245 samples; 38.52%) were the most common causes for positive samples followed by WBC parameters (1073 samples; 33.20%), suspect flags (522 samples; 16.15%) and platelet parameters (392 samples; 12.13%).
The three most common flags triggered contributing to MSR were immature granulocytes (IG) suspect flag (151 samples; 11.41%) followed by mean corpuscular volume <75 fL (117 samples; 8.84%) and platelet flags excluding platelet clumps (117 samples; 8.84%) using the ICGHR criteria and red cell distribution width - coefficient of variation >14% (412 samples; 12.75%), absolute neutrophil count (ANC) >7 × 103/μL (315 samples; 9.75%) and hemoglobin <11 g/dL (275 samples; 8.51%) using our laboratory criteria.
The three most common triggers for MSR among the RBC parameters, WBC parameters, platelet parameters and suspect flags are shown in [Tables 3]. The suspect flags for both the ICGHR and our laboratory criteria were the same but as the total number of positive occurrences in either criteria were different, the proportion of each of the suspect flags responsible for triggering MSR in either criteria were varied.
|Table 3: Three most common parameters triggering MSR by the adapted ICGHR criteria and our laboratory criteria|
Click here to view
The “Truth Table” comparing the ICGHR and our laboratory criteria is shown in [Table 4]. All the parameters obtained from our laboratory criteria were significantly different from the ICGHR criteria with a value of P < 0.001.
|Table 4: The “Truth Table” comparing of performance of the adapted ICGHR criteria with our laboratory criteria|
Click here to view
| Discussion|| |
AHAs have undergone impressive development over the past 3 decades. Changes in software along with the introduction of new principles in cell analysis have been foremost in this regard. AHAs provide rapid analysis of the blood samples, they are more precise for cell counts, efficient, reliable, and cost-effective and preferred for counting WBCs, RBCs, and platelets with differential counts of mature forms. For the above reasons, AHAs are now the preferred method for CBC and WBC differentials thereby sidestepping MSR without sacrificing the quality of results. The results produced by the AHAs, however, require validation while analyzing cells with morphological abnormalities as the results are not confirmatory.,,
The MSR is an essential diagnostic tool, a gold standard to confirm the morphological assessment of abnormal cells, especially IG, blasts, atypical lymphocytes or cell count (granulocytes and platelets) when the AHAs detect abnormalities, thereby providing a definitive diagnosis. It can also detect or identify cells that the AHA may not be able to classify. On the other hand, examination of the manual smear is tedious, imprecise and time-consuming, labor-intensive and has higher overall laboratory costs when compared to the AHAs, thereby increasing turnaround time.,,
The commission on laboratory accreditation of the College of American Pathologists (CAP) recommends that each laboratory should establish certain criteria to determine when to perform MSR following automated blood count analysis. In 2002, Dr. Berend Houwen invited 20 experts to generate internationally acceptable guidelines (“rules”) as there were no uniform criteria applied to AHAs for MSR. Dr. Houwen founded the ICGHR and published a set of 41 rules as review criteria for peripheral blood smear review. They also recommended validation of these rules first, before implementing them for use on patient samples.,
It has however been found that many laboratories have adopted the ICGHR criteria without validation and optimization despite the fact that they are not standardized for use. In order to maximize efficiency, the review criteria should first be validated before use, taking into consideration the following points: The type of facility, laboratory budget, laboratory requirements, instrument model and characteristics, workload and sample volume, number of staff members capable of operating the AHA and carrying out the MSR, rate of review of MSRs, turnaround time and type of patient population in that area., Failure to consider the above points before validation and implementation of these criteria may, in fact, lead to an increase in false results or an unnecessary MSR thus leading to an increase in the workload and turnaround time.
The use of the ICGHR criteria in the present study generated an MRR of 47.56%. This is comparable to the MRR of 46.06% as reported by Comar et al., and 54.25% in the study done by Eldanasoury et al., using the ICGHR criteria.
A MRR of 30% has been recommended by the CAP. The MRR using our laboratory criteria was higher (78.14%) than the ICGHR criteria (47.56%) due to a greater number of positive samples (672 samples) out of which 413 samples (61.46%) were TP and 259 (38.54%) were FP.
The type of hospital along with the population attending for healthcare services varies from place to place, and this can lead to differing results with the ICGHR's smear review criteria if they have been introduced without validation. Comar et al. stated that local peculiarities should be taken into account during the analysis of samples with positive smear findings so as not to overlook them. A majority of our patients are from the rural population and although our hospital provides a variety of clinical and laboratory services, most patients tend to present clinically in the late stage possibly due to low socioeconomic status. We have hence found a higher percentage of positive samples which in turn has led to high MRR.
The MRR also depends on the patient composition, i.e., inpatients versus outpatients. This study was conducted on samples from both inpatients and outpatients. Application of delta check rules is another criterion that can lower the MRR., Due to limitations in the hospital's instrument and record systems, rules for delta check could not be applied in this study and all the patient's samples were considered first-time samples.
To obtain a comprehensive and effective evaluation of the review criteria, the FN rate is of paramount importance which reveals the effectiveness with which the review criteria can screen samples with positive smear findings, i.e., samples with morphological abnormalities. Barnes et al. recommended a maximum acceptable FN rate of 5% to ensure patient safety. FN rate of 0.58% and 8.95% was obtained using our laboratory and the ICGHR criteria, respectively. The threshold cutoffs for our laboratory criteria were more sensitive than the ICGHR criteria which would probably explain the low false negativity of our laboratory criteria [Table 5].
|Table 5: Causes for FP and FN occurrences with the adapted ICGHR criteria and our laboratory criteria|
Click here to view
Sireci et al. optimized thresholds for WBC flags based on the ICGHR criteria. These optimized criteria, however, missed cases with abnormalities, which would have been flagged by factory default settings. These included myeloid precursors including band count as was the case with the present study. Considering the debatable clinical utility of the band count and limited reproducibility of the atypical lymphocyte count, Sireci et al. felt that underreporting of band forms or some cases with increased numbers of atypical lymphocytes was acceptable.
Analysis of FNs also includes looking into whether any hematologic malignancies have been missed. In the study done by Cui et al., two cases of acute leukemia on chemotherapy were missed. Comar et al. revealed that one FN sample contained blasts in a case of acute leukemia in their study. Both authors stated that it was unacceptable to miss a case of serious hematologic disease, whether on treatment or undiagnosed. They recommended that each institution evaluate the need to perform MSR in all patients in the hematology unit even at the expense of an increased MRR. There were 5 cases of hematologic malignancy in the present study, and none were missed by either the ICGHR or our laboratory criteria.,
FP samples are responsible for increasing the MRRs and decreasing the specificity. The FP rate of 30.12% and 7.91% was obtained using our laboratory and the ICGHR criteria, respectively. The difference in the parameters causing false positivity for the ICGHR and our laboratory criteria can be explained by the fact that the threshold cutoffs for all the parameters were not the same for both sets of criteria [Table 5]. The cutoffs for our laboratory criteria were more sensitive than the ICGHR criteria.
Hematology analyzers use suspect flags to notify the user that the automated differential WBC count may not be correct and requires review. Eldanasoury et al. showed that suspect flags were responsible for 60.2% of their FP results using the ICGHR criteria. This indicated that the hematology analyzers used were guilty of over flagging, i.e. they gave more warnings than necessary thus responsible for an increase in unnecessary MSR. The same was the case with the present study where the suspect flags alone were responsible for 59.09% of FP results with the ICGHR criteria. Our laboratory criteria, however, showed that 7.01% of the FP results were due to suspect flags indicating that triggers from the other parameters were responsible for the majority of the FP samples. This point again emphasizes the downside of having strict threshold cutoffs, as with our laboratory criteria, which of course have greater sensitivity but at the cost of a higher MRR.
As the sensitivity of the suspect flags is adjusted by technicians of the hematology analyzer's manufacturer, Comar et al. suggested that each laboratory should first evaluate the efficiency of each suspect flag from the analyzers and then make proper adjustments to the sensitivity of the hematology analyzer or define whether a suspect flag is actually useful as a screening criterion.
In the same line of thought, Kim et al. stated that the rates of slide review have distinct characteristics among the studied analyzers and that individual laboratories should consider selecting the most appropriate analyzer in accordance with clinical characteristics including clinic size and patient population. In the present study, however, as only one analyzer was used, the above aspect could not be reviewed.
The sensitivity using our laboratory criteria (98.80%) was much higher than the specificity (41.40%). This may be in view of the high MRR (78.13%) using our laboratory criteria. The sensitivity using the ICGHR criteria in their study was, however, lower than the specificity and accordingly, the MRR was lower (47.56%).
The greatest modification made to the ICGHR criteria in the present study was regarding the delta check rules. These rules are important for the efficiency and reliability of the CBC results directly released without an MSR. Due to high software development costs, many clinical laboratories cannot implement the delta check rules in their electronic records or interfacing systems.
| Conclusions|| |
In the present day and scene where the sophistication of the AHAs is only improving with the launch of every new analyzer, it is essential for clinical laboratories to consider methods for reducing the number of MSRs to improve their productivity and efficiency.
The ICGHR criteria are ideal to decrease the number of MSRs in the clinical laboratory. Although our laboratory criteria performed better with regard to sensitivity and negative predictive value, it came at the expense of a very high MRR which in turn may lead to decrease in laboratory productivity and increase in the turnaround time. Therefore, development of optimized criteria based on the ICGHR criteria followed by their validation will improve turnaround time and efficiency in our laboratory.
It is therefore advisable for all laboratories to develop their own criteria for smear review. These laboratory criteria can be based on the criteria established by ICGHR but should be verified before adoption or optimized to be suitable for different requirements. Manual microscopic examination of a stained blood film complementing automated analysis can help to validate these established criteria and thus improve the accuracy.
We are grateful for the support and encouragement provided during the study period by our Head of Department of Pathology, Dr. B. R. Yelikar, our teaching faculty and colleagues. We are also very grateful for assistance from the technical staff of our laboratory.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Barnes PW, McFadden SL, Machin SJ, Simson E; International Consensus Group for Hematology. The international consensus group for hematology review: Suggested criteria for action following automated CBC and WBC differential analysis. Lab Hematol 2005;11:83-90.
Comar SR, Malvezzi M, Pasquini R. Are the review criteria for automated complete blood counts of the international society of laboratory hematology suitable for all hematology laboratories? Rev Bras Hematol Hemoter 2014;36:219-25.
Pratumvinit B, Wongkrajang P, Reesukumal K, Klinbua C, Niamjoy P. Validation and optimization of criteria for manual smear review following automated blood cell analysis in a large university hospital. Arch Pathol Lab Med 2013;137:408-14.
Cui W, Wu W, Wang X, Wang G, Hao YY, Chen Y, et al.
Development of the personalized criteria for microscopic review following four different series of hematology analyzer in a Chinese large scale hospital. Chin Med J (Engl) 2010;123:3231-7.
Kim SJ, Kim Y, Shin S, Song J, Choi JR. Comparison study of the rates of manual peripheral blood smear review from 3 automated hematology analyzers, unicel dxH 800, ADVIA 2120i, and XE 2100, using international consensus group guidelines. Arch Pathol Lab Med 2012;136:1408-13.
Bates I, Lewis SM. Reference ranges and normal values. In: Bain BJ, Bates I, Laffan MA, Lewis SM, editors. Dacie and Lewis Practical Haematology. 11th
ed. Philadelphia: Elsevier Churchill Livingstone; 2012. p. 11-22.
Geaghan SM. Appendix B: Normal blood values: Selected health-associated values for neonatal, pediatric, and adult. In: Greer JP, Arber DA, Glader BE, List AF, Means RT, Paraskevas F, et al
., editors. Wintrobe's Clinical Hematology. 12th
ed., Vol. 2. Philadelphia: Lippincott Williams & Wilkins; 2009. p. 2585-94.
Eldanasoury AS, Boshnak NH, El Monem RA. Validation of criteria for smear review following automated blood cell analysis in Ain Shams University. Int J Sci Res (Raipur) 2016;5:484-93.
Novis DA, Walsh M, Wilkinson D, St Louis M, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review: A College of American Pathologists Q-Probes study of 95,141 complete blood count determinations performed in 263 institutions. Arch Pathol Lab Med 2006;130:596-601.
Sireci A, Schlaberg R, Kratz A. A method for optimizing and validating institution-specific flagging criteria for automated cell counters. Arch Pathol Lab Med 2010;134:1528-33.
Department of Pathology, BLDEU's Shri BM Patil Medical College, Vijayapura, Karnataka
Source of Support: None, Conflict of Interest: None
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]