Validity of the overclaiming technique as a method to account for response bias in self-assessment questions : analysis on the basis of the PISA 2012 data

thesis
dc.abstract.enThe presented work is devoted to study the validity of overclaiming technique (OCT) as a measure of response (positivity) bias. Three main aims of the analyses performed were: a) assess methods' utility to enhance predictive validity of self-report by accounting for response biases, b) investigate proposed mechanisms of overclaiming, c) expand nomological network of the method by presenting a wide set of both individual-level and cluster-level (school) correlates. The obtained results pointed that OCT can be used in order to account for response biases in self-report data. Important differences regarding use and interpretation of the different OCT scoring systems were found and commented. Two systems, one based of signal detection theory (SDT), other on item response theory model (IRT), were proposed as viable scorings of OCT. Choice between them is not trivial as it influences results' interpretation and model specification. Three possible mechanisms of overclaiming were tested: a) motivated response bias (self-favouring bias, socially desirable responding), b) memory bias (overgeneralised knowledge or faulty memory control) and c) response styles and careless responding. The results pointed that all three mechanisms are probable and that overclaiming is most probably a heterogenous phenomenon of multiple causes. However, the analyses pointed out that one of the memory bias hypotheses, the overgeneralised knowledge account, does not hold and that there is much more evidence for the competitive metacognitive account. It is to said that overclaiming is at least partially attributable to insufficient monitoring of one's knowledge. Evidence for a relation between careless responding and overclaiming was also obtained, indicating that at least some of the overclaimed responses can be attributed due to inattentive responding. Obtained results on the relations between response styles and overclaiming were complicated; they warrant further studies as the results here probably greatly depend on the technical details of analysis, e.g. response style definition and coding adopted. The analysed cluster-level covariates demonstrated that only very limited portion of OCT variance can be ascribed to the school-level of analysis. Gender, socio-economic status and locus of control proved to be significantly related to overclaiming among the individual-level correlates assessed. Boys yielded higher overclaiming bias than girls and students of external locus of control were more biased in their self-reports in comparison to students of internal locus of control. The work comprises also analysis of the PISA's OCT latent structure. The results evidenced bifactor structure of the scale, with the general factor interpreted as math ability while the two specific factors were given a tentative explanation concentrated around item difficulty (one specific factor emerged for easy items, one for hard items). These findings point to a multi-dimensional character of OCT and a large role played by domain ability in OCT responding. Moreover, latent class analysis (LCA) performed identified an "overclaiming" group among the participants which was characterised by high overclaiming and unwarrantedly high self-report profile regarding math-related abilities and social life. However, this group counted only around 9% of the total sample. Implications of these findings are commented in the work, along with theoretical integration and ideas for future studies with the use of OCT.pl
dc.affiliationWydział Filozoficzny : Instytut Socjologiipl
dc.contributor.advisorGórniak, Jarosław - 102582 pl
dc.contributor.authorMuszyński, Marek - 115512 pl
dc.contributor.institutionJagiellonian University. Institute of Sociologypl
dc.contributor.reviewerJabkowski, PIotrpl
dc.contributor.reviewerKonarski, Romanpl
dc.date.accessioned2020-10-27T08:39:56Z
dc.date.available2020-10-27T08:39:56Z
dc.date.openaccess0
dc.date.submitted2020-10-30pl
dc.description.accesstimew momencie opublikowania
dc.description.additionalBibliogr. s. 213-275pl
dc.description.physicalXVI , 276pl
dc.description.versionostateczna wersja autorska (postprint)
dc.identifier.projectROD UJ / OPpl
dc.identifier.urihttps://ruj.uj.edu.pl/xmlui/handle/item/251494
dc.languageengpl
dc.placeKrakówpl
dc.rightsCopyright*
dc.rights.licenceInna otwarta licencja
dc.rights.simpleviewWolny dostęp
dc.rights.urihttp://ruj.uj.edu.pl/4dspace/License/copyright/licencja_copyright.pdf*
dc.share.typeotwarte repozytorium
dc.titleValidity of the overclaiming technique as a method to account for response bias in self-assessment questions : analysis on the basis of the PISA 2012 datapl
dc.typeThesispl
dspace.entity.typePublication
dc.abstract.enpl
The presented work is devoted to study the validity of overclaiming technique (OCT) as a measure of response (positivity) bias. Three main aims of the analyses performed were: a) assess methods' utility to enhance predictive validity of self-report by accounting for response biases, b) investigate proposed mechanisms of overclaiming, c) expand nomological network of the method by presenting a wide set of both individual-level and cluster-level (school) correlates. The obtained results pointed that OCT can be used in order to account for response biases in self-report data. Important differences regarding use and interpretation of the different OCT scoring systems were found and commented. Two systems, one based of signal detection theory (SDT), other on item response theory model (IRT), were proposed as viable scorings of OCT. Choice between them is not trivial as it influences results' interpretation and model specification. Three possible mechanisms of overclaiming were tested: a) motivated response bias (self-favouring bias, socially desirable responding), b) memory bias (overgeneralised knowledge or faulty memory control) and c) response styles and careless responding. The results pointed that all three mechanisms are probable and that overclaiming is most probably a heterogenous phenomenon of multiple causes. However, the analyses pointed out that one of the memory bias hypotheses, the overgeneralised knowledge account, does not hold and that there is much more evidence for the competitive metacognitive account. It is to said that overclaiming is at least partially attributable to insufficient monitoring of one's knowledge. Evidence for a relation between careless responding and overclaiming was also obtained, indicating that at least some of the overclaimed responses can be attributed due to inattentive responding. Obtained results on the relations between response styles and overclaiming were complicated; they warrant further studies as the results here probably greatly depend on the technical details of analysis, e.g. response style definition and coding adopted. The analysed cluster-level covariates demonstrated that only very limited portion of OCT variance can be ascribed to the school-level of analysis. Gender, socio-economic status and locus of control proved to be significantly related to overclaiming among the individual-level correlates assessed. Boys yielded higher overclaiming bias than girls and students of external locus of control were more biased in their self-reports in comparison to students of internal locus of control. The work comprises also analysis of the PISA's OCT latent structure. The results evidenced bifactor structure of the scale, with the general factor interpreted as math ability while the two specific factors were given a tentative explanation concentrated around item difficulty (one specific factor emerged for easy items, one for hard items). These findings point to a multi-dimensional character of OCT and a large role played by domain ability in OCT responding. Moreover, latent class analysis (LCA) performed identified an "overclaiming" group among the participants which was characterised by high overclaiming and unwarrantedly high self-report profile regarding math-related abilities and social life. However, this group counted only around 9% of the total sample. Implications of these findings are commented in the work, along with theoretical integration and ideas for future studies with the use of OCT.
dc.affiliationpl
Wydział Filozoficzny : Instytut Socjologii
dc.contributor.advisorpl
Górniak, Jarosław - 102582
dc.contributor.authorpl
Muszyński, Marek - 115512
dc.contributor.institutionpl
Jagiellonian University. Institute of Sociology
dc.contributor.reviewerpl
Jabkowski, PIotr
dc.contributor.reviewerpl
Konarski, Roman
dc.date.accessioned
2020-10-27T08:39:56Z
dc.date.available
2020-10-27T08:39:56Z
dc.date.openaccess
0
dc.date.submittedpl
2020-10-30
dc.description.accesstime
w momencie opublikowania
dc.description.additionalpl
Bibliogr. s. 213-275
dc.description.physicalpl
XVI , 276
dc.description.version
ostateczna wersja autorska (postprint)
dc.identifier.projectpl
ROD UJ / OP
dc.identifier.uri
https://ruj.uj.edu.pl/xmlui/handle/item/251494
dc.languagepl
eng
dc.placepl
Kraków
dc.rights*
Copyright
dc.rights.licence
Inna otwarta licencja
dc.rights.simpleview
Wolny dostęp
dc.rights.uri*
http://ruj.uj.edu.pl/4dspace/License/copyright/licencja_copyright.pdf
dc.share.type
otwarte repozytorium
dc.titlepl
Validity of the overclaiming technique as a method to account for response bias in self-assessment questions : analysis on the basis of the PISA 2012 data
dc.typepl
Thesis
dspace.entity.type
Publication
Affiliations

* The migration of download and view statistics prior to the date of April 8, 2024 is in progress.

Views
210
Views per month
Views per city
Warsaw
11
Dublin
7
Central
6
Champaign
6
Sapporo
6
Las Vegas
5
Prague
5
Leicester
4
Perth
4
Wroclaw
4
Downloads
muszynski_validity_of_the_overclaiming_technique_as_a_method_2020.pdf
247
muszynski_validity_of_the_overclaiming_technique_as_a_method_2020.odt
19