Validation of a form for assessing the professional performance of residents in cardiology by nurses
- Autores
- Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; Costabel, Juan P.; Durante, Eduardo Héctor; Gelpi, Ricardo Jorge; Alves de Lima, Alberto Enrique
- Año de publicación
- 2023
- Idioma
- inglés
- Tipo de recurso
- artículo
- Estado
- versión publicada
- Descripción
- BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.
Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Ciambrone, Graciana. Hospital Alemán; Argentina
Fil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; Argentina
Fil: Durante, Eduardo Héctor. Hospital Italiano; Argentina
Fil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina
Fil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina - Materia
-
CARDIOLOGY
FEEDBACK
NURSES
OBSERVATION - Nivel de accesibilidad
- acceso abierto
- Condiciones de uso
- https://creativecommons.org/licenses/by-nc-sa/2.5/ar/
- Repositorio
- Institución
- Consejo Nacional de Investigaciones Científicas y Técnicas
- OAI Identificador
- oai:ri.conicet.gov.ar:11336/219782
Ver los metadatos del registro completo
id |
CONICETDig_72dcc9d02737dbd33b9a8b1062eeac80 |
---|---|
oai_identifier_str |
oai:ri.conicet.gov.ar:11336/219782 |
network_acronym_str |
CONICETDig |
repository_id_str |
3498 |
network_name_str |
CONICET Digital (CONICET) |
spelling |
Validation of a form for assessing the professional performance of residents in cardiology by nursesBusch, GermanRodríguez Borda, María V.Morales, Pablo I.Weiss, MónicaCiambrone, GracianaCostabel, Juan P.Durante, Eduardo HéctorGelpi, Ricardo JorgeAlves de Lima, Alberto EnriqueCARDIOLOGYFEEDBACKNURSESOBSERVATIONhttps://purl.org/becyt/ford/3.2https://purl.org/becyt/ford/3BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability.Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Ciambrone, Graciana. Hospital Alemán; ArgentinaFil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; ArgentinaFil: Durante, Eduardo Héctor. Hospital Italiano; ArgentinaFil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaWolters Kluwer Medknow PublicationS2023-01info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersionhttp://purl.org/coar/resource_type/c_6501info:ar-repo/semantics/articuloapplication/pdfapplication/pdfhttp://hdl.handle.net/11336/219782Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-72277-95312319-6440CONICET DigitalCONICETenginfo:eu-repo/semantics/altIdentifier/doi/10.4103/jehp.jehp_44_23info:eu-repo/semantics/openAccesshttps://creativecommons.org/licenses/by-nc-sa/2.5/ar/reponame:CONICET Digital (CONICET)instname:Consejo Nacional de Investigaciones Científicas y Técnicas2025-09-29T09:55:21Zoai:ri.conicet.gov.ar:11336/219782instacron:CONICETInstitucionalhttp://ri.conicet.gov.ar/Organismo científico-tecnológicoNo correspondehttp://ri.conicet.gov.ar/oai/requestdasensio@conicet.gov.ar; lcarlino@conicet.gov.arArgentinaNo correspondeNo correspondeNo correspondeopendoar:34982025-09-29 09:55:22.203CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicasfalse |
dc.title.none.fl_str_mv |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
spellingShingle |
Validation of a form for assessing the professional performance of residents in cardiology by nurses Busch, German CARDIOLOGY FEEDBACK NURSES OBSERVATION |
title_short |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_full |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_fullStr |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_full_unstemmed |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
title_sort |
Validation of a form for assessing the professional performance of residents in cardiology by nurses |
dc.creator.none.fl_str_mv |
Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Héctor Gelpi, Ricardo Jorge Alves de Lima, Alberto Enrique |
author |
Busch, German |
author_facet |
Busch, German Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Héctor Gelpi, Ricardo Jorge Alves de Lima, Alberto Enrique |
author_role |
author |
author2 |
Rodríguez Borda, María V. Morales, Pablo I. Weiss, Mónica Ciambrone, Graciana Costabel, Juan P. Durante, Eduardo Héctor Gelpi, Ricardo Jorge Alves de Lima, Alberto Enrique |
author2_role |
author author author author author author author author |
dc.subject.none.fl_str_mv |
CARDIOLOGY FEEDBACK NURSES OBSERVATION |
topic |
CARDIOLOGY FEEDBACK NURSES OBSERVATION |
purl_subject.fl_str_mv |
https://purl.org/becyt/ford/3.2 https://purl.org/becyt/ford/3 |
dc.description.none.fl_txt_mv |
BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability. Fil: Busch, German. Instituto Cardiovascular de Buenos Aires; Argentina Fil: Rodríguez Borda, María V.. Instituto Cardiovascular de Buenos Aires; Argentina Fil: Morales, Pablo I.. Instituto Cardiovascular de Buenos Aires; Argentina Fil: Weiss, Mónica. Instituto Cardiovascular de Buenos Aires; Argentina Fil: Ciambrone, Graciana. Hospital Alemán; Argentina Fil: Costabel, Juan P.. Instituto Cardiovascular de Buenos Aires; Argentina Fil: Durante, Eduardo Héctor. Hospital Italiano; Argentina Fil: Gelpi, Ricardo Jorge. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina Fil: Alves de Lima, Alberto Enrique. Instituto Cardiovascular de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina |
description |
BACKGROUND: There is a strong need for transformation in our assessment systems from one that evaluates performance based on levels of training to another that focuses on professional competence to meet the expected requirements for the practice of the profession. The aim of this study is to validate for the first time a Spanish version of a new tool for assessing the professional performance of residents by nurses newly developed in the Ottawa Hospital (O-RON). MATERIALS AND METHODS: After the author's written authorization, the original O-RON form was translated and cross-culturally adapted. Then we conducted a prospective observational study in two cardiology centers in the city of Buenos Aires. The validity of the tools was evaluated by the ability of the instrument to discriminate the level of experience of the residents according to their post-graduate year level. Data is expressed as percentages and frequencies of the qualifications obtained in the different questions. The chi-square test was used to assess the significance of the differences obtained. A generalizability test was used to evaluate reliability. Feasibility was defined as a minimum of 4 assessments per resident per evaluation round. Satisfaction of evaluators was assessed using a survey with a 10-point scale designed by the authors. RESULTS: A total of 838 evaluations were performed. Regarding validity, the 15-item form could significantly discriminate the experience of the residents according to their postgraduate year level (P < 0,005). Thirty evaluations per resident are required to obtain reliable results. The tool is feasible to implement and an average of 4.55 assessment per resident per evaluation round were achieved throughout the entire experience. This value remained stable during the 8 rounds (1st: 4.65; 2nd: 4.34; 3rd: 4.47; 4th: 6.17; 5th: 4.56; 6th: 4.08; 7th: 4.36; 8th: 3.91). The levels of satisfaction among the evaluators were acceptable. CONCLUSION: The Spanish version of the O-RON form can provide residents with a valuable source of feedback from the eyes of nurses on important aspects of their professional training. This tool, positively assessed by the raters, significantly discriminates residents' experience. Its implementation is feasible in our environment, and it is user-friendly, though it requires a considerable number of assessments to achieve high reliability. |
publishDate |
2023 |
dc.date.none.fl_str_mv |
2023-01 |
dc.type.none.fl_str_mv |
info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion http://purl.org/coar/resource_type/c_6501 info:ar-repo/semantics/articulo |
format |
article |
status_str |
publishedVersion |
dc.identifier.none.fl_str_mv |
http://hdl.handle.net/11336/219782 Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-7 2277-9531 2319-6440 CONICET Digital CONICET |
url |
http://hdl.handle.net/11336/219782 |
identifier_str_mv |
Busch, German; Rodríguez Borda, María V.; Morales, Pablo I.; Weiss, Mónica; Ciambrone, Graciana; et al.; Validation of a form for assessing the professional performance of residents in cardiology by nurses; Wolters Kluwer Medknow PublicationS; Journal of Education and Health Promotion; 12; 1; 1-2023; 1-7 2277-9531 2319-6440 CONICET Digital CONICET |
dc.language.none.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
info:eu-repo/semantics/altIdentifier/doi/10.4103/jehp.jehp_44_23 |
dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
eu_rights_str_mv |
openAccess |
rights_invalid_str_mv |
https://creativecommons.org/licenses/by-nc-sa/2.5/ar/ |
dc.format.none.fl_str_mv |
application/pdf application/pdf |
dc.publisher.none.fl_str_mv |
Wolters Kluwer Medknow PublicationS |
publisher.none.fl_str_mv |
Wolters Kluwer Medknow PublicationS |
dc.source.none.fl_str_mv |
reponame:CONICET Digital (CONICET) instname:Consejo Nacional de Investigaciones Científicas y Técnicas |
reponame_str |
CONICET Digital (CONICET) |
collection |
CONICET Digital (CONICET) |
instname_str |
Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.name.fl_str_mv |
CONICET Digital (CONICET) - Consejo Nacional de Investigaciones Científicas y Técnicas |
repository.mail.fl_str_mv |
dasensio@conicet.gov.ar; lcarlino@conicet.gov.ar |
_version_ |
1844613670306316288 |
score |
13.070432 |