Program Evaluation

The core of quality improvement efforts of our program lies at its ability to systematically and critically evaluate multi-faceted components of our program. Residents may choose a topic of interest pertaining to our residency program to review current processes, develop assessment plan, collect/analyze data, and discuss results and next steps.

  • Examples:
    • e.g. Assessing resident experience in using Field Notes as a learning tool.
    • e.g. Evaluation of Academic half days in its relevance and efficacy to residents.

 

Method and Written Report Guidelines

(based on instructions for authors, Canadian Family Physician journal, July 12, 2011)

Program Evaluation

Manuscripts must be prepared in accordance with the “Uniform Requirements for Manuscripts Submitted to Biomedical Journals” available on the International Committee of Medical Journal Editors (ICMJE) website.

Data request/Resident Access Residents may request access to Family Practice resident data and/or request access to fellow family practice residents (e.g. distribute surveys, conduct interviews) for their resident scholar project. Please review the guidelines under ‘Data request/Resident Access’ and submit completed Data request/Resident access application form to Data Concierge Committee. For all other inquiries related to Data request/Resident access please contact the Data Concierge Committee at:  fmprpostgrad.research@familymed.ubc.ca

 

Abstract: Include Introduction (problem being addressed and objective of program), Description, Evaluation and Conclusion and do not exceed 300 words. Up to 4 key words (MeSH headings) should be included.

Program Evaluations should not exceed 2500 words, excluding abstract, tables and references.

Introduction: Clearly state the problem being addressed and why it is important to family physicians. Specific objectives of the program should be described and appropriate literature should be cited concisely.

Description: Provide sufficient detail for someone else to reproduce it. The original problem should be addressed by the program. A concise evaluation of the program should be described along with any data available.

Evaluation: Data should be presented concisely. Choice of mode of program evaluation (e.g. logic model, etc) is justified and described.

Discussion: Compare the program with others in the field and indicate why it is an improvement over existing programs.

Limitations: Planned improvements should be presented. Conclusion should summarize the main components of the program, relate to the problem addressed, and be justified by the information presented.

References: Must be current and complete. Check references for accuracy, completeness, and proper format (according to the Uniform Requirements for Manuscripts Submitted to Biomedical Journals; http://www.icmje.org/). References should be numbered in the order they appear in the text and should be limited to works cited in the article. List all authors when there are 6 or fewer; when there are 7 or more, list the first 6, followed by et al.

Key Points: Include a short, point-form “key points” section including 1 to 4 points in 50 to 100 words. Key points should not duplicate the abstract or summarize the article; they should highlight what is new, different, unexpected or surprising in the article.

Tables and figures: Attach separately from the main manuscript. Tables and figures should clarify and supplement, but not duplicate, the text. Tables must be self-explanatory and concise. Prepare each table or figure on a separate page. Give titles to tables and captions to figures and other illustrations. Ensure that all tables, figures, and illustrations are cited at appropriate places in the text. Prepare tables in Word; not spreadsheets. Use table structure, not spaces and tabs to format tables.

Images and any other visual material: Attach as separate electronic files (do not paste them into the manuscript). These may include photographs, digital illustrations or extra photographs for use if space is available. Images should be sent in a JPG file format.

Authorship: Include a description in written report of what each resident/author contributed to their Resident Scholar Project. In addition, if several residents are involved in one Resident Scholar Project, include a statement to describe the processes they underwent to decide the order of the authors on the Resident Scholar Project written report.

Acknowledgements: Name everyone (e.g. faculty, professionals, research assistants) who contributed to the work of the Resident Scholar Project who are not authors in the Acknowledgements section, describing what they did. Also, describe all financial support of the Resident Project in the acknowledgements.

Guidelines for Authorship and Acknowledgements

Please follow the latest authorship definition provided by the Uniform Requirements for Manuscripts Submitted to Biomedical Journals listed below from the website: www.icmje.org as follows:

“All persons designated as authors should qualify for authorship, and all those who qualify should be listed. Each author should have participated sufficiently in the work to take public responsibility for appropriate portions of the content. One or more authors should take responsibility for the integrity of the work as a whole, from inception to published article. Authorship credit should be based only on 1) substantial contributions to conception and design, or acquisition of data, or analysis and interpretation of data; 2) drafting the article or revising it critically for important intellectual content; and 3) final approval of the version to be published. Conditions 1, 2, and 3 must all be met. Acquisition of funding, the collection of data, or general supervision of the research group, by themselves, do not justify authorship.”

In addition, all residents and faculty should refer to the Department of Family Practice Authorship and Collaboration policy that was approved by the Post-Graduate Education Committee in 2003. This policy guides the order of authors for faculty and residents who work together on a Resident Scholar Project.

Note:

The Program Evaluation Committee would like to ensure that all resident scholar projects that focus on anything relevant to evaluation of the residency program are shared with the program evaluation committee. This could be projects where residents collect their own data about resident experiences, or projects that use departmental data, to evaluate various aspects of the program.

Please ensure you use ‘evaluation’ or ‘program evaluation’ in your keywords so that these papers can be searched in the online journal. Please also forward your final paper to: fmprpostgrad.research@familymed.ubc.ca

We will then use these findings to help improve the program.

This is an important part of end-of-project knowledge translation that serves to help the program with quality improvement and ensures residents are aware that their scholar project efforts are important contributions to our program. If you would like past resident scholar projects relating to Program Evaluation, please also send your request to:  fmprpostgrad.research@familymed.ubc.ca