Tobias Lieberei

Tobias Lieberei

Auto-generated profile, based on publicly available information

Tobias Lieberei

IPN - Leibniz Institute for Science and Mathematics Education

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 October 2023 in Frontiers in Psychology
Verified
Journal Article
Open access
TLTobias Lieberei
Tobias Lieberei
VWVirginia Deborah Elaine Welter
Virginia Deborah Elaine Welter
LGLeroy Großmann
Leroy Großmann
MKMoritz Krell
Moritz Krell
Pedagogical content knowledge (PCK) is one core dimension of teachers’ professional knowledge and comprises knowledge about conceptual ideas of learners and appropriate instructions. However, several challenges regarding the assessment of PCK are discussed in the literature: For example, PCK is a topic-specific construct and contains differentiable subdomains, which must be considered during test development. In addition, the choice of test type needs to be considered. While open-ended instruments can capture a broader range of cognitions, they often require a high level of interpretation; in contrast, multiple-choice instruments have advantages in terms of objectivity and test economy. Some challenges of assessing PCK are particularly related to multiple-choice instruments, such as an insufficient focus on specific components or the accidental assessment of teachers’ beliefs instead of PCK. To better understand and explain these challenges in developing multiple-choice PCK instruments, we exemparly used an instrument to assess PCK about scientific reasoning and considered the assumptions of the expert-novice paradigm to analyze differential response behavior betweenn = 10 researchers in the field of biology education (experts) andn = 10 undergraduate pre-service biology teachers (novices). As expected, experts scored significantly higher than novices. At the same time, experts answered the items more consistently than novices, i.e., showed less variance. However, the difference found was statistically insignificant. Regarding the explanations for choosing a response option, experts more often correctly identified the quintessence of the items, which means that they more often understand the items as intended and argued based on their PCK. On the other hand, novices focused more on surface characteristics, i.e., they argued rather with surface knowledge like intuition or personal experience, than choosing the response option based on their PCK. These crucial differences in how experts and novices understand the items of the used PCK instrument and how they respond based on their understanding affect different test characteristics. In conclusion, we recommend ensuring that instruments address only a few, specific PCK aspects, considering the target group of a test, and take into account that target groups with larger variability among their responses require a higher number of items to achieve satisfactory discrimination and reliability indices.

26 December 2024 in Research in Science Education
Verified
Journal Article
Open access
PDF file
TLTobias Lieberei
Tobias Lieberei
LGLeroy Großmann
Leroy Großmann
VWVirginia Deborah Elaine Welter
Virginia Deborah Elaine Welter
DKDirk Krüger
Dirk Krüger
MKMoritz Krell
Moritz Krell
The use of multiple-choice (MC) instruments to assess pedagogical content knowledge (PCK) has advantages in terms of test economy and objectivity, but it also poses challenges, for example, in terms of adequately capturing the intended construct. To help address these challenges, we developed and evaluated a new instrument to assess science teachers’ PCK of scientific reasoning in biology contexts (PCKSR-bio), considering multiple sources of validity evidence. First, 12 MC items were developed to assess crucial PCK components for three scientific reasoning skills. Subsequently, the correlation of corresponding content knowledge (CK) with the PCKSR-bio score was tested with 67 master’s students. In addition, the instrument was used in a cross-sectional study with 165 students (n = 29 bachelor, n = 115 master, n = 21 school-based preservice teachers), and the internal consistency as well as the correlation of the test score with the educational level was determined. An analysis of the response processes of 10 bachelor’s students showed that they more often referred to PCK when selecting an attractor and more often (rather intuitively) to other knowledge when selecting a distractor. In the cross-sectional study, the internal consistency was relatively low but increased with higher educational level. A correlation was found between the test score and CK but not between the test score and the educational level. Our results show that considering multiple sources of validity evidence can help to address common challenges in developing MC–PCK instruments. The results and limitations are discussed, and recommendations are made for the development of MC instruments to assess PCK in general.

1 January 2024
Verified
Book Chapter
Closed access
RSRichard Sannert
Richard Sannert
VPVerena Petermann
Verena Petermann
TLTobias Lieberei
Tobias Lieberei
VWVirginia Deborah Elaine Welter
Virginia Deborah Elaine Welter
MKMoritz Krell
Moritz Krell

27 June 2026 in International Journal of Science Education
Verified
Journal Article
Open access
TLTobias Lieberei
Tobias Lieberei
VWVirginia Deborah Elaine Welter
Virginia Deborah Elaine Welter
MKMoritz Krell
Moritz Krell