Validation of a form for assessing the professional performance of residents in cardiology by nurses

Autores
Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; Costabel, Juan P.; Durante, Eduardo Héctor; Gelpi, Ricardo Jorge; Alves de Lima, Alberto Enrique
Año de publicación
2023
Idioma
inglés
Tipo de recurso
artículo
Estado
versión publicada
Descripción
BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Ciambrone, Graciana. Hospital Alemán; Argentina
Fil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Durante, Eduardo Héctor. Hospital Italiano; Argentina
Fil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Materia
CARDIOLOGY
FEEDBACK
NURSES
OBSERVATION
Nivel de accesibilidad
acceso abierto
Condiciones de uso
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
Repositorio
CONICET Digital (CONICET)
Institución
Consejo Nacional de Investigaciones Científicas y Técnicas
OAI Identificador
oai:ri.conicet.gov.ar:11336/219782

id CONICETDig_72dcc9d02737dbd33b9a8b1062eeac80
oai_identifier_str oai:ri.conicet.gov.ar:11336/219782
network_acronym_str CONICETDig
repository_id_str 3498
network_name_str CONICET Digital (CONICET)
spelling Validation of a form for assessing the professional performance of residents in cardiology by nursesBusch, GermanRodríguez Borda, María V.Morales, Pablo I.Weiss, MónicaCiambrone, GracianaCostabel, Juan P.Durante, Eduardo HéctorGelpi, Ricardo JorgeAlves de Lima, Alberto EnriqueCARDIOLOGYFEEDBACKNURSESOBSERVATIONhttps://purl.org/becyt/ford/3.2https://purl.org/becyt/ford/3BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Ciambrone, Graciana. Hospital Alemán; ArgentinaFil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Durante, Eduardo Héctor. Hospital Italiano; ArgentinaFil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaWolters Kluwer Medknow PublicationS2023-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/219782Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-72277-95312319-6440CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.4103/jehp.jehp_44_23info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T09:55:21Zoai:ri.conicet.gov.ar:11336/219782instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 09:55:22.203CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse
dc.title.none.fl_str_mv Validation of a form for assessing the professional performance of residents in cardiology by nurses
title Validation of a form for assessing the professional performance of residents in cardiology by nurses
spellingShingle Validation of a form for assessing the professional performance of residents in cardiology by nurses
Busch, German
CARDIOLOGY
FEEDBACK
NURSES
OBSERVATION
title_short Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_full Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_fullStr Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_full_unstemmed Validation of a form for assessing the professional performance of residents in cardiology by nurses
title_sort Validation of a form for assessing the professional performance of residents in cardiology by nurses
dc.creator.none.fl_str_mv Busch, German
Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo Héctor
Gelpi, Ricardo Jorge
Alves de Lima, Alberto Enrique
author Busch, German
author_facet Busch, German
Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo Héctor
Gelpi, Ricardo Jorge
Alves de Lima, Alberto Enrique
author_role author
author2 Rodríguez Borda, María V.
Morales, Pablo I.
Weiss, Mónica
Ciambrone, Graciana
Costabel, Juan P.
Durante, Eduardo Héctor
Gelpi, Ricardo Jorge
Alves de Lima, Alberto Enrique
author2_role author
author
author
author
author
author
author
author
dc.subject.none.fl_str_mv CARDIOLOGY
FEEDBACK
NURSES
OBSERVATION
topic CARDIOLOGY
FEEDBACK
NURSES
OBSERVATION
purl_subject.fl_str_mv https://purl.org/becyt/ford/3.2
https://purl.org/becyt/ford/3
dc.description.none.fl_txt_mv BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Ciambrone, Graciana. Hospital Alemán; Argentina
Fil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Durante, Eduardo Héctor. Hospital Italiano; Argentina
Fil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
description BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
publishDate 2023
dc.date.none.fl_str_mv 2023-01
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
http://purl.org/coar/resource_type/c_6501
info:ar-repo/semantics/articulo
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/11336/219782
Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-7
2277-9531
2319-6440
CONICET Digital
CONICET
url http://hdl.handle.net/11336/219782
identifier_str_mv Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-7
2277-9531
2319-6440
CONICET Digital
CONICET
dc.language.none.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv info:eu-repo/semantics/altIdentifier/doi/10.4103/jehp.jehp_44_23
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
eu_rights_str_mv openAccess
rights_invalid_str_mv https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Wolters Kluwer Medknow PublicationS
publisher.none.fl_str_mv Wolters Kluwer Medknow PublicationS
dc.source.none.fl_str_mv reponame:CONICET Digital (CONICET)
instname:Consejo Nacional de Investigaciones Científicas y Técnicas
reponame_str CONICET Digital (CONICET)
collection CONICET Digital (CONICET)
instname_str Consejo Nacional de Investigaciones Científicas y Técnicas
repository.name.fl_str_mv CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas
repository.mail.fl_str_mv dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar
_version_ 1844613670306316288
score 13.070432