Indan Journal of Medical Research Indan Journal of Medical Research Indan Journal of Medical Research Indan Journal of Medical Research
  Home About us Editorial board Search Ahead of print Current issue Archives Submit article Instructions Subscribe Contacts Login  
  Home Print this page Email this page Small font sizeDefault font sizeIncrease font size Users Online: 738       

   Table of Contents      
CORRESPONDENCE
Year : 2019  |  Volume : 149  |  Issue : 1  |  Page : 74-75

Development & validation of the Chandigarh autism screening instrument


1 Department of Psychopharmacology, National Institute of Mental Health & Neurosciences, Bengaluru 560 029, India
2 Department of Psychiatry, All India Institute of Medical Sciences, Bhubaneswar 751 019, Odisha, India
3 Department of Psychiatry, Gujarat Medical Education and Research Society, Medical College, Gandhinagar 382 012, Gujarat, India
4 Department of Psychiatry, National Institute of Mental Health & Neurosciences, Bengaluru 560 029, India
5 Department of Psychiatry, Dr. D. Y. Patil Medical College, Hospital & Research Centre, Kolhapur 416 006, India
6 Mpower Foundation, Mumbai 400 007, Maharashtra, India
7 Department of Child & Adolescent Psychiatry, National Institute of Mental Health & Neurosciences, Bengaluru 560 029, India
8 Department of Psychiatry, Karnataka Institute of Medical Sciences, Hubballi 580 021, Karnataka, India
9 Department of Psychiatry, Government Medical College, Kozhikode 673 008, Kerala, India

Date of Submission02-Sep-2018
Date of Web Publication22-Apr-2019

Correspondence Address:
Chittaranjan Andrade
Department of Psychopharmacology, National Institute of Mental Health & Neurosciences, Bengaluru 560 029
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/ijmr.IJMR_1648_18

Rights and Permissions

How to cite this article:
Andrade C, Sahoo S, Solanki C, Narasimha VL, Nagendrappa S, Harshe D, Suhas S, Dharmadhikari A, Karki U, Pinto EF, Garag S, Tharayil HM, Mahadevan J. Development & validation of the Chandigarh autism screening instrument. Indian J Med Res 2019;149:74-5

How to cite this URL:
Andrade C, Sahoo S, Solanki C, Narasimha VL, Nagendrappa S, Harshe D, Suhas S, Dharmadhikari A, Karki U, Pinto EF, Garag S, Tharayil HM, Mahadevan J. Development & validation of the Chandigarh autism screening instrument. Indian J Med Res [serial online] 2019 [cited 2019 Oct 13];149:74-5. Available from: http://www.ijmr.org.in/text.asp?2019/149/1/74/256700

Sir,

The Chandigarh Autism Screening Instrument (CASI) was developed to screen for autism spectrum disorders (ASD)[1]. The study was reviewed in electronic Journal Club India (eJCIndia)[2], and concerns related to sampling, reporting, interpretation and validation were raised in a discussion across the country.

ASD is more prevalent in males than in females, and the clinical features may change as the child grows up. In this context, no attempt was made by the CASI authors to age match and sex match the ASD and control groups. The authors provided almost no demographic description of the case and control groups. They also did not state how many cases had ASD with versus without mental retardation and how the CASI functioned in these ASD subgroups[1]. It is therefore, unclear to what population the results of the study can be generalized.

Of considerable concern is that the authors used a retrospectively ascertained chart diagnosis of ASD as the gold standard. In validation exercises, it is necessary for the gold standard to be prospectively established using recognized instruments, such as a diagnostic interview schedule. The gold standard must be truly valid. A diagnostic interview schedule should also have been applied to define the sample in the other groups and, in particular, to confirm the absence of psychiatric disorder in the sample of normally developing children. A teacher's report of the absence of problem behaviour and a parent's report of the absence of concern cannot confirm normal development.

Because the age range of the sample was wide (1.5-10 yr), items in the CASI may have varied in age specificity. It is to be seen whether having separate versions of CASI for different age groups, comprising different items and with different cut-offs, would be a better approach, as with already existing instruments in the field.

The authors validated the CASI in a convenience sample of arbitrarily chosen case and comparison subjects rather than in the population. While their approach may provide an understanding of the sensitivity and specificity of the instrument, it cannot offer an understanding of the positive and negative predictive values (PPV, NPV), both of which are sensitive to the prevalence in the population of the disorder being screened for, and both of which are important to know in the context of a screening instrument. In short, the PPV and NPV values that were reported could be wildly wrong.

With regard to other aspects of study execution, pilot testing was not conducted in the target population. The Autism Behaviour Checklist (ABC), chosen for external validation, has been found to have poor sensitivity at the generally recommended cut-offs[3]. As additional limitations, the CASI was administered without blinding to the different groups of study participants. This could have resulted in rater bias in scoring and response bias in the ASD caregivers who endorsed CASI items because of familiarity arising from knowledge about the diagnosis. Of further concern, the CASI was in some cases self-administered by caregivers and in other cases, clinician administered; both were inconsistent with the intended method of administration stated in the abstract. Finally, the items comprising CASI Bref were not listed, nor was their selection justified; nor was the sensitivity and specificity of CASI Bref stated for scores of 3 and 4. We also consider that, in their analysis, a cut-off that prioritized sensitivity over specificity might have been better than the one that they chose to optimize sensitivity and specificity. This is because the primary purpose of a screening instrument is not to miss a case (sensitivity), especially when the condition is serious and rare. Perhaps, the authors could have reported the sensitivity and specificity values for different cut-offs instead of for the single cut-off that they selected.

It is surprising that the authors did not present CASI scores that compared ASD in cases with and without mental retardation separately, along with the scores in the different comparison groups. The correlations between CASI and the existing ASD screening instruments are also necessary to examine but were not presented; these are measures of convergent validity, and not external validity, as the authors have mistakenly stated[4].

It is hoped that these concerns will be considered in future iterations of validation of the CASI. In this context, it is suggested that other measures, such as test-retest reliability and inter-rater reliability, are also necessary, as is the validation of the instrument in a sample different from the one in which it was derived.

Conflicts of Interest: None.



 
   References Top

1.
Arun P, Chavan BS. Development of a screening instrument for autism spectrum disorder: Chandigarh Autism Screening Instrument. Indian J Med Res 2018; 147 : 369-75.  Back to cited text no. 1
    
2.
Thakurdesai A, Ghosh A, Menon V, Sahoo S, Tripathi A, Harshe D, et al. Electronic journal clubs for capacity building: A case study in psychiatry as a model for medical disciplines in developing countries. Asian J Psychiatr 2018; 34 : 93-7.  Back to cited text no. 2
    
3.
Marteleto MR, Pedromônico MR. Validity of autism behavior checklist (ABC): Preliminary study. Braz J Psychiatry 2005; 27 : 295-301.  Back to cited text no. 3
    
4.
Andrade C. Internal, external, and ecological validity in research design, conduct, and evaluation. Indian J Psychol Med 2018; 40 : 498-9.  Back to cited text no. 4
    




 

Top
 
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
    References

 Article Access Statistics
    Viewed264    
    Printed0    
    Emailed0    
    PDF Downloaded106    
    Comments [Add]    

Recommend this journal