Browsing by Author "Villagrán, Ignacio"

Now showing 1 - 4 of 4
  • Thumbnail Image
    Item
    Available assessment tools for evaluating feedback quality: a scoping review oriented to education in digital media
    (2024) Duran Espinoza, Valentina Alexandra; Rammsy Seron, Francisca Pia; Vargas, Juan Pablo; Petric Prado, Dominik; Montero Jaras, Isabella; Silva Peña, Felipe Andres; Olivares Valenzuela, Nicolás Hernán; Villagrán, Ignacio; Varas Cohen, Julián Emanuel; Fuentes-Cimma, Javiera
    In recent years, the use of digital platforms for surgical and medical training has increased. Quality feedback is essential when using these methodologies, as it serves as the primary form of interaction between trainers and students. Therefore, there is a need to evaluate feedback using valid and reliable instruments. This scoping review aims to identify assessment tools available in the literature for evaluating feedback in medical education
  • Thumbnail Image
    Item
    Developing an Innovative Medical Training Simulation Device for Peripheral Venous Access: A User-Centered Design Approach
    (2020) Miranda, Constanza ; Altermatt Couratier, Fernando René; Villagrán, Ignacio ; Goñi, Julián
    Nurses and other health students may lack the proper time for training procedural tasks, such as peripheral venous access. There is a need to develop these abilities in novices so that errors can be avoided when treating real patients. Nonetheless, from an experiential point of view, the simulation devices offered in the market do not always make sense for educators and trainees. This could make the adoption of new technology difficult. The purpose of this case study is to describe the development of an innovative simulation device and to propose concrete tactics for the involvement of the educators and trainees. We used a participative design based approach, with an ethnographic basis, where incremental cycles of user testing, development and iteration were involved. The study showcases methods from the field of design and anthropology that can be used to develop future simulation devices that resonate with students and educators to achieve a long term learning experience. Results could shed a light on new ways for the involvement of educators and students to create devices that resonate with them, making learning significant and effective.
  • No Thumbnail Available
    Item
    Evaluating the Performance of Large Language Models on the CONACEM Anesthesiology Certification Exam: A Comparison with Human Participants
    (2025) Altermatt Couratier, Fernando René; Neyem, Hugo Andrés; Sumonte Fuenzalida, Nicolás Ignacio; Villagrán, Ignacio; Mendoza, Marcelo; Lacassie Quiroga, Héctor Javier
    Large Language Models (LLMs) have demonstrated strong performance on English-language medical exams, but their effectiveness in non-English, high-stakes environments is less understood. This study benchmarks nine LLMs against human examinees on the Chilean Anesthesiology Certification Exam (CONACEM), a Spanish-language board examination. A curated set of 63 multiple-choice questions was used, categorized by Bloom’s taxonomy into four cognitive levels. Model responses were assessed using Item Response Theory and Classical Test Theory, complemented by additional error analysis, categorizing errors as reasoning-based, knowledge-based, or comprehension-related. Closed-source models surpassed open-source models, with GPT-o1 achieving the highest accuracy (88.7%). Deepseek-R1 is a strong performer among open-source options. Item difficulty significantly predicted the model accuracy, while discrimination did not. Most errors occurred in application and understanding tasks and were linked to flawed reasoning or knowledge misapplication. These results underscore LLMs’ potential for factual recall in Spanish medical exams but also their limitations in complex reasoning. Incorporating cognitive classification and error taxonomy provides deeper insights into model behavior and supports their cautious use as educational aids in clinical settings.
  • No Thumbnail Available
    Item
    Innovation Meets Practice: A Scalable Simulation-based Methodology for Massive Paracentesis Training
    (2025) Figueroa, Úrsula; Jarry, Cristián; Inzunza, Martín; Montero, Isabella; Garrido, Francisco; Villagrán, Ignacio; Belmar, Francisca; Escalona, Gabriel; Riquelme Pérez, Arnoldo; Varas Cohen, Julián