Average Review: 3 (3.3)

Programme for International Student Assessment (PISA)

Supplemental Information:

Assessment Type:

multiple-choice

Scale:

various 4-point scales

Publication Date:

Nov 07, 2008

Respondent:

15-and 16-year olds

Domain(s) Evaluated:

Engagement, Attitude, Competence, Career

Sample items:

How much do you agree with the statement(s) below? I am interested in learning about science. Broad science is valuable to me. My teachers equip me with the basic skills and knowledge I need for a science-related career.

Reliability:

Interfactor correlations for PISA (TLI=0.93; CFI=0.96)

Validity:

Fit between the theoretical construct and the empirical model is unsatisfactory (TLI=0.83; CFI=0.837; RMSEA=0.07)

Frequency:

frequently

Administration time:

120 minutes

Requires a Computer:

No

Requires Internet Access:

No

Primary reference:

Assessing Scientific, Reading and Mathematical Literacy: A framework for PISA 2006 (2006). Organisation for Economic Co-operation and Development (OECD).

Comments:

You can read more about the PISA here: http://www.pisa.oecd.org/pages/0,3417,en_32252351_32235907_1_1_1_1_1,00.html

You can browse sample questions from the Science PISA here: http://pisa-sq.acer.edu.au/showQuestion.php?testId=2300&questionId=1

Assessment occurs every three years with one of three subjects (reading, math, or science) being the focus of the assessment.

57 countries participated in 2006 PISA survey, with 4,500-10,000 students in each country completing the survey.

Other Reference:
Caro, D. H., Sandoval-Hernández, A. & Lüdtke, O. (2014). Cultural, social and economic capital constructs in international assessments: an evaluation using exploratory structural equation modeling. An International Journal of Research, Policy and Practice, 25(3), 433-450.
This study makes use of exploratory structural equation modeling (ESEM) evaluating the large scale assessment of PISA. There were 500 students per education system (14 educational systems were used). The study found that for PISA the fit between the theoretical construct and the empirical model is unsatisfactory (TLI=0.83; CFI=0.837; RMSEA=0.07), the CFA did not support an acceptable fit to the data of PISA. However using ESEM there was acceptable fit indices and interfactor correlations for PISA (TLI=0.93; CFI=0.96).

STEM Criteria

Science

Yes

Technology

No

Engineering

No

Math

No