Content Validity Analyses of Qualitative Feedback on the Revised Assessment, Evaluation, and Programming System for Infants and Children (AEPS) Test
DOI:
https://doi.org/10.6000/2292-2598.2015.03.04.3Keywords:
Validity, AEPS®, early intervention, early childhood assessment.Abstract
Early childhood assessment practices, procedures, and tools can lay the foundation for an effective intervention program. The purpose of this article is to report the results of a content validity study conducted on a revision of Assessment, Evaluation, and Programming System for infants and children (AEPS®) Test, a widely used early childhood assessment/evaluation instrument. A panel of early childhood and early childhood special educator experts was assembled and asked to provide qualitative feedback on the content of the revised AEPS Test. Experts were asked to address five specific questions about item content, developmental sequences, and if assessment items represented quality teaching targets for young children. Qualitative results were used to modify items, developmental sequences, and area content.
References
Bagnato SJ, Goins DD, Pretti-Frontczak KL, Neisworth JT. Authentic assessment as 'best practice' for early childhood intervention: National consumer social validity research. Topics Early Child Spec Educ 2014; 34: 116-127. http://dx.doi.org/10.1177/0271121414523652 DOI: https://doi.org/10.1177/0271121414523652
Copple C, Bredekamp S. Developmentally appropriate practice in early childhood programs: Serving children from birth through age 8. Washington, DC: National Association for the Education of Young Children 2009.
Kowalski K, Brown RD, Pretti-Frontczak K. The effects of using formal assessment on preschool teachers' beliefs about the importance of various developmental skills and abilities. Contemporary Educational Psychology 2005; 30: 23-42. http://dx.doi.org/10.1016/j.cedpsych.2004.05.001 DOI: https://doi.org/10.1016/j.cedpsych.2004.05.001
Pretti-Frontczak K, Kowalski K, Brown RD. Preschool teachers' use of assessments and curricula: A statewide examination. Exceptional Children 2002; 69: 109-123. DOI: https://doi.org/10.1177/001440290206900108
Macy M, Bagnato S. Keeping it “R-E-A-L” with authentic assessment. National Head Start Association Dialog 2010; 13: 1-21. http://dx.doi.org/10.1080/15240750903458105 DOI: https://doi.org/10.1080/15240750903458105
Bricker D, Clifford J, Yovanoff P, Pretti-Frontczak K, Waddell M, Allen D, Hoselton R. Eligibility determination using a curriculum-based assessment: A further examination. J Early Interv 2008; 31: 3-21. http://dx.doi.org/10.1177/1053815108324422 DOI: https://doi.org/10.1177/1053815108324422
Bricker D, Macy M, Squires J, Marks K. Developmental screening in your community: An integrated approach for connecting children with services. Baltimore: Brookes Publishing 2013.
Snyder PA, Hemmeter ML, Fox L, Bishop CC, Miller MD. Developing and gathering psychometric evidence for a fidelity instrument: The Teaching Pyramid Observation Tool - Pilot Version. J Early Interv 2013; 35(2): 150-172. http://dx.doi.org/10.1177/1053815113516794 DOI: https://doi.org/10.1177/1053815113516794
Kane M. All validity is construct validity. Or is it? Measurement 2012; 10: 66-70. http://dx.doi.org/10.1080/15366367.2012.681977 DOI: https://doi.org/10.1080/15366367.2012.681977
Cronbach LJ. Test validation. In R. L. Thorndike (Ed.), Educational Measurement (2nd ed.) 1971; pp. 443-507.
Newton PE, Shaw SD. Standards for talking and thinking about validity. Psychological Methods 2013; 18(3): 301-319. http://dx.doi.org/10.1037/a0032969 DOI: https://doi.org/10.1037/a0032969
Hallam R, Lyons AN, Pretti-Frontczak K. Grisham-Brown J. Comparing apples and oranges: The mismeasurement of young children through the mismatch of assessment purpose and interpretation of results. Topics Early Child Spec Educ 2014; 34(2): 106-115. http://dx.doi.org/10.1177/0271121414524283 DOI: https://doi.org/10.1177/0271121414524283
Bagnato SJ, McLean M, Macy M, Neisworth JT. Identifying instructional targets for early childhood via authentic assessment: Alignment of professional standards and practice-based evidence. Journal of Early Intervention 2011; 33(4): 245-253. http://dx.doi.org/10.1177/1053815111427565 DOI: https://doi.org/10.1177/1053815111427565
Gall MD, Borg WR, Gall JP. Educational Research: An Introduction (6th ed.). White Plains, NY: Longman Publishers USA 1996.
Bricker D. Assessment, Evaluation, and Programming System for Infants and Children, 2nd ed. (AEPS®). Baltimore: Brookes Publishing 2002. DOI: https://doi.org/10.1037/t11481-000
Grisham-Brown JL, Pretti-Fronczak K, Hallam R. Measuring child outcomes using authentic assessment practice. J Early Interv 2008; 30(4): 207-11. DOI: https://doi.org/10.1177/1053815108320689
Slentz K, Horn K, Macy M. Assessment, Evaluation, and Programming System Overview: Tour of Multiple Uses. Annual Infant and Early Childhood Conference; Bellevue, Washington 2008.
Macy M. Interactive online assessment options: A review of the AEPSi. International Journal of Early Childhood Special Education 2010; 2(3): 254-7. DOI: https://doi.org/10.20489/intjecse.107973
Bagnato SJ, Neisworth J, Pretti-Frontczak KL. LINKing authentic assessment and early childhood intervention. Baltimore: Brookes Publishing 2010.
Slentz K. Evaluating the instructional needs of young children with handicaps: Psychometric adequacy of the Evaluation and Programming System-Assessment Level II. Dissertation Abstracts International 1986; 47(11): 4072A.
Bailey E, Bricker D. A psychometric study of a criterion-referenced assessment instrument designed for infants and young children. J Early Interv 1986; 10(2): 124-134. http://dx.doi.org/10.1177/105381518601000204
Bricker D, Bailey E, Slentz K. Reliability, validity, and utility of the Evaluation and Programming System: For Infants and Young Children (EPS-I). J Early Interv 1990; 14(2): 147-60. http://dx.doi.org/10.1177/105381519001400204
Macy M, Bricker D, Squires J. Validity and reliability of a curriculum-based assessment approach to determine eligibility for part C services. J Early Interv 2005; 28(1): 1-16. http://dx.doi.org/10.1177/105381510502800101 DOI: https://doi.org/10.1177/105381510502800101
Gao X. Validity of an authentic assessment in order to report young children's accountability data on early language, literacy and pre-math areas. Unpublished doctoral dissertation, University of Kentucky, Lexington, Kentucky 2008.
Noh J. Examining the psychometric properties of the second edition of the Assessment, Evaluation, and Programming System for Three to Six Years: AEPS® Test 2nd Edition (3-6). Unpublished dissertation, University of Oregon, Eugene, Oregon 2005.
Hsia T. Evaluating the Psychometric Properties of the Assessment, Evaluation, and Programming System for Three to Six Years: AEPS® Test. Unpublished doctoral dissertation, University of Oregon, Eugene, Oregon 1993.
Bailey E, Bricker D. A psychometric study of a criterion-referenced assessment instrument designed for infants and young children. Journal of the Division of Early Childhood 1986; 10(2): 124-134. http://dx.doi.org/10.1177/105381518601000204 DOI: https://doi.org/10.1177/105381518601000204
Bricker DD, Bailey EJ, Slentz K. Reliability, validity, and utility of the Evaluation and Programming System: For Infants and Young Children (EPS—I). Journal of Early Intervention 1990; 14(2): 147-160. http://dx.doi.org/10.1177/105381519001400204 DOI: https://doi.org/10.1177/105381519001400204
Notari AR, Bricker DD. The utility of a curriculum-based assessment instrument in the development of individualized education plans for infants and young children. Journal of Early Intervention 1990; 14(2): 117-132. http://dx.doi.org/10.1177/105381519001400202 DOI: https://doi.org/10.1177/105381519001400202
Notari AR, Drinkwater SG. Best practices for writing child outcomes: An evaluation of two methods. Topics in Early Childhood Special Education 1991; 11(3): 92-106. http://dx.doi.org/10.1177/027112149101100309 DOI: https://doi.org/10.1177/027112149101100309
Pretti-Frontczak K, Bricker D. Enhancing the quality of Individualized Education Program (IEP) goals and objectives. Journal of Early Intervention 2000; 23(2): 92-105. http://dx.doi.org/10.1177/105381510002300204 DOI: https://doi.org/10.1177/105381510002300204
Macy M, Thorndike-Christ T, Lin Y. Parental reports of perceived assessment utility: A comparison of authentic and conventional approaches. Infants & Young Children 2010; 23(4): 286-302. http://dx.doi.org/10.1097/IYC.0b013e3181f1ec1b DOI: https://doi.org/10.1097/IYC.0b013e3181f1ec1b
Bricker D, Grisham-Brown J, Dionne C, Pretti-Frontczak K, Johnson JJ, Macy M, Slentz, K, Thorndike-Christ T, Waddell M. Using the Assessment, Evaluation, and Programming System to meet federal accountability requirements. EMRG White Paper No. 6. Eugene, OR: Early Intervention Management and Research Group (EMRG) 2010.
Bricker D, Pretti-Frontczak K, Grisham-Brown J, Johnson JJ, Macy M, Slentz K, Waddell M. Original purposes and expanded uses of AEPS®. EMRG White Paper No. 2. Eugene, OR: Early Intervention Management and Research Group 2008.
Ferguson DL, Ferguson PM. Qualitative research in special education: Notes toward an open inquiry instead of a new orthodoxy? Journal of the Association for Persons with Severe Handicaps 2000; 25(3): 180-5. http://dx.doi.org/10.2511/rpsd.25.3.180 DOI: https://doi.org/10.2511/rpsd.25.3.180
Ferguson PM, Ferguson DL, Taylor SJ. Interpreting Disability: A Qualitative Reader. New York: Teachers College Press 1992.
Patton MQ. Qualitative Research and Evaluation Methods. Thousand Oaks, CA: Sage 2015.
Dixon M, Wang S, Calvin J, Dineen B, Tomlinson E. The panel interview: A review of empirical research and guidelines for practice. Public Personnel Management 2002; 31(3): 397-428. http://dx.doi.org/10.1177/009102600203100310 DOI: https://doi.org/10.1177/009102600203100310
Handels RH, Wolfs CG, Aalten P, Bossuyt PM, Joore MA, Leentjens AG, Severens JL, Verhey FJ. Optimizing the use of expert panel reference diagnoses in diagnostic studies of multidimensional syndromes. BMC Neurology 2014; 14. http://dx.doi.org/10.1186/s12883-014-0190-3 DOI: https://doi.org/10.1186/s12883-014-0190-3
Schilling LS, Dixon JK, Knafl KA, Grey M, Ives B, Lynn MR. Determining content validity of a self-report instrument for adolescents using a heterogeneous expert panel. Nursing Research 2007; 56(5): 361-6. http://dx.doi.org/10.1097/01.NNR.0000289505.30037.91 DOI: https://doi.org/10.1097/01.NNR.0000289505.30037.91
Luckner JL. Using the dynamic indicators of basic early literacy skills with students who are deaf or hard of hearing: Perspectives of a panel of experts. American Annals of the Deaf 2013; 158(1): 7-19. http://dx.doi.org/10.1353/aad.2013.0012 DOI: https://doi.org/10.1353/aad.2013.0012
Macy M, Grisham-Brown J, Dionne C, Johnson J, Bricker D, Slentz K, Waddell MA. Content validity study on the AEPS® third edition. Poster presented at the 7th Biannual Conference on Research Innovations in Early Intervention (CRIEI) 2014; San Diego, California.
McCardle P, Chhabra V. The Voice of Evidence in Reading Research. Baltimore: Brookes Publishing 2004.
National Research Council. Preventing Reading Difficulties in young Children. National Academy Press. Washington DC 1998.
Winchell B. A critical examination of the technical adequacy of a curriculum-based assessment using Rasch analysis. Unpublished dissertation, Kent State University, Kent, Ohio 2011.
Bricker D. (with assistance from Grisham-Brown J, Dionne C, Pretti-Frontczak K, Johnson JJ, Macy M, Slentz K, Thorndike Christ T, Waddell M.) A brief history of the Early Intervention Management and Research Group (EMRG). EMRG White Paper No. 4. Eugene, OR: Early Intervention Management and Research Group 2009.
Downloads
Published
How to Cite
Issue
Section
