A Centralized Clinical Outcome Measurement of Eating Disorders in

47
Clinical Outcome Measurement of Eating Disorders 1 The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO Le centre d’excellence provincial au CHEO en santé mentale des enfants et des ados Evaluation Implementation Grant EIG 1208 Final Report March 31 st , 2011 A Centralized Clinical Outcome Measurement of Eating Disorders in Youth across Ontario: A Multi-Site Partnership Written by: Dr. Katherine Henderson, PhD, C.Psych and Nicole Obeid, MA Co-Principal Investigators: Dr. Katherine Henderson and Dr. Annick Buchholz Co-Investigators: Dr. Wendy Spettigue, Dr. Mark Norris, Dr. Nick Barrowman, Dr. Margus Heinmaa, Dr. Leora Pinhas, Dr. Debra Katzman, Dr. Melissa Lieberman, Dr. Karin Jasper, Dr. Ahmed Boachie, Dr. Adele Lafrance

Transcript of A Centralized Clinical Outcome Measurement of Eating Disorders in

Page 1: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

1

The Provincial Centre of Excellence for Child and Youth Mental Health at CHEO

Le centre d’excellence provincial au CHEO en santé mentale des enfants et des ados

Evaluation Implementation Grant EIG 1208

Final Report March 31st, 2011

A Centralized Clinical Outcome

Measurement of Eating Disorders in Youth across Ontario:

A Multi-Site Partnership

Written by: Dr. Katherine Henderson, PhD, C.Psych and Nicole Obeid, MA

Co-Principal Investigators:

Dr. Katherine Henderson and Dr. Annick Buchholz

Co-Investigators: Dr. Wendy Spettigue, Dr. Mark Norris, Dr. Nick Barrowman, Dr. Margus Heinmaa, Dr. Leora Pinhas, Dr. Debra Katzman,

Dr. Melissa Lieberman, Dr. Karin Jasper, Dr. Ahmed Boachie, Dr. Adele Lafrance

Page 2: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

2

Table of Contents Page Contents

3 Executive Summary

6 Introduction

12 Results and Lessons Learned

23 Conclusion and Recommendations/Next Steps

24 Knowledge Exchange

27 References

28 Appendices

Page 3: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

3

Executive Summary

Eating disorders are chronic and life threatening illnesses. Despite the morbidity and

mortality of this condition, these disorders remain understudied and underserved, and there

is an absolute paucity of research examining outcomes in pediatric clinical populations.

Three pediatric eating disorder programs located in tertiary care hospitals in Ontario worked

collaboratively together to create a multisite research partnership that would allow for the

creation of knowledge about the children and youth served in Ontario and an evaluation of

the services provided to our children and youth.

In Ontario, three specialized pediatric eating disorder teams; the Children’s Hospital of

Eastern Ontario (CHEO), Southlake Regional Health Centre (SHRC), and the Hospital for

Sick Children (HSC), made a commitment to take action to address the lack of research

available for this vulnerable population. The vision for this multi-site partnership was

conceptualized by members from all sites and with the leadership of Dr. Henderson and

Buchholz from CHEO, the members were able to successfully implement the vision. The

three centres created an interdisciplinary, multi-institutional partnership with the goals of

greater research collaboration, shared resources, and shared data to attempt to close the

knowledge gap in research on outcomes and treatment in children and youth suffering from

eating disorders. This multi-institutional partnership received a Provincial Centre of

Excellence Program Implementation Grant in June of 2010 to formally develop a Centralized

Multisite Database Partnership (CMDP) and to develop capacity for research with the

creation of a multisite database.

Over the course of the granting period, the partnership met monthly via teleconference,

as well as in-person on three separate occasions. Through these meetings this team has

accomplished four main goals: 1) the establishment of a solid partnership across the three

sites with one representative from each site acting as a Steering Committee member, 2) the

creation and approval of all relevant authorship and ownership documents necessary to

Page 4: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

4

operate a multi-site partnership, 3) the establishment of a web-based database and data

definition dictionary which explicitly lists and defines all variables that are to be part of the

multi-site database, and 4) has contributed to knowledge translation at both a provincial and

national level.

A strong partnership is the cornerstone to the success of any longitudinal multisite

research program. Drs. Henderson and Buchholz, with Ms. Obeid as a research coordinator

worked within a collaborative participatory framework to establish a formal partnership that

was inclusive and sustainable. Interdisciplinary representatives from each site were invited

to join the research partnership. Interdisciplinary and inter-site relationships were fostered

and strengthened through bi-monthly teleconferences and 3 full day in-person meetings.

These meetings provided a forum for an exchange of knowledge and expertise and the

development and refinement of our common vision for the partnership. During these

meetings the detailed authorship agreement, methodology for the study, data dictionary, and

future knowledge dissemination and research plans were developed, discussed, and agreed

upon by all involved. Furthermore, the web-based database structure was successfully

designed and developed over the course of the grant. Unfortunately there was a significant

delay in moving the data base to the secure server at CHEO. This delay resulted in an

inability to enter and store data in the centralized web-based database, which prevented any

outcomes analyses of the data.

Through the funding for this grant, Dr. Henderson and Dr. Buchholz with their co-

investigators were successful in creating a formal multisite partnership for outcomes

research on pediatric eating disorders with clear terms of agreement on the use of the data

and authorship, developing a centralized web-based data-base, and in successfully

engaging in knowledge translation and exchange. The development of this multisite

partnership is extremely important. Through this partnership the CMDP will finally be able to

start to address the paucity of research examining outcomes in pediatric eating disorders.

Page 5: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

5

The knowledge generated over the upcoming years from this partnership and centralized

database will provide missing evidence to better guide the prevention and treatment of this

serious and chronic mental health illness affecting many children and youth in Ontario. This

knowledge will also be essential to our national and international partners who work hard to

provide excellent care and treatment to youth suffering from eating disorders.

The CMDP has learned from the challenges faced in implementing this grant and

continues to work to build upon the successes achieved. The delay in being able to

implement the web-based data base, was turned into an opportunity to apply for further

funding to pilot test the data and the feasibility of data collection once the data base has

been established. The team was successful in receiving funds from the Sick Kids Psychiatry

Endowment Fund ($25,000). The team further used the strength of the partnership to apply

for a CIHR grant to hold a national meeting (CIHR meetings and plannings grant, $9,999).

The partnership has set a goal of building on the results and success of the Centre of

Excellence Grant and the Hospital of Sick Children grant. To this end we are committed to

submitting a grant to CIHR in January in 2012 to provide funds for an extensive 3 year

evaluation of programs in Ontario and possibly across Canada.

Page 6: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

6

Introduction

Eating disorders are chronic and life threatening illnesses. Despite the morbidity and

mortality of this condition, these disorders remain understudied and underserved, and there

is an absolute paucity of research examining outcomes in pediatric clinical populations. The

shared vision of the current project was to create a forum in which to conduct a quasi-

experimental, multi-site, repeated measures design to examine recovery trajectories of

medical and psychological outcome variables across a number of organizations within

Ontario. Initially, four pediatric eating disorder programs located in tertiary care hospitals

worked collaboratively to address the shared goals of creating a centralized web-based

database to examine the clinical profiles of patients, 6-month recovery trajectories, as well

as predictors of clinical outcome.

Throughout the course of the granting period, numerous tasks related to the

formation of a solid partnership were established, as was the creation of a secure web-

based database that has the capacity to store, disseminate, and retrieve data from various

sources was created. Due to unexpected challenges and delays in the Children’s Hospital of

Eastern Ontario (CHEO) IS department, the timely establishment of an operational and

secure centralized database was not possible. A thorough explanation of the challenges and

delays encountered will be described later in this report. Without the secure operational

centralized database it has not been possible to complete any analyses. It is anticipated that

with ongoing support of the current partnership and an ongoing commitment to finalize the

secure centralized database, that the data that each site has gathered, will be entered into

the centralized database as soon as possible, and that analysis of this data will provide

valuable information on clinical outcomes from services that are provided by eating disorder

programs within Ontario. The data base and partnership will also provide a measurement

framework upon which to build a larger, potentially national, partnership among programs

offering treatment to children and youth struggling with eating disorders.

Page 7: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

7

This final report will focus the four main objectives that were accomplished during the

granting period and will discuss how the principal investigators addressed the challenges

presented by the delays in the technology. While discussing each of the objectives in turn,

this report will highlight the accomplishments and lessons learned. Although it is recognized

that a multisite evaluation of clinical populations of youth with eating disorders was not

successfully completed, the solid partnership that has grown and evolved from this ongoing

collaboration has been paramount in securing a platform in which multisite outcomes

research is now possible. The four main achievements of this project were: 1) the creation of

a formal a provincial inter-disciplinary multi-site partnership, 2) researching and creating

authorship and ownership guidelines to direct the partnership 3) consensus on common

outcome indicators including a data definition dictionary that would be placed in a

centralized database to be developed and maintained at CHEO, and 4) contribution to

knowledge translation.

Background

Physical and emotional development is profoundly affected in children and youth

suffering from eating disorders. Physical complications of the illness include bradycardia,

hypotension, hypothermia, cardiac arrhythmias, heart failure, amenorrhea, osteopenia,

neurological impairments, hormonal imbalances, growth deceleration, and impaired bone

density and fertility (Katzman, 1999). Psychological sequelae of an eating disorder include

depression, suicidality, mood lability, social withdrawal, cognitive impairment, insomnia,

irritability, agitation, and marked deterioration in family relationships (Neiderman, 2000).

Sullivan (Sullivan, 1995) reported mortality rates in individuals with eating disorders that

exceeded the expected incidence of death from all causes in women 15 to 24 years of age

by twelve-fold. In short, eating disorders in youth are associated with potentially devastating

psychosocial and medical outcomes, impaired quality of life, premature mortality, and

exorbitant costs to the health care system (Nielson & Bara-Carrill, 2003). Many youth

Page 8: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

8

diagnosed with a severe eating disorder are no longer capable of functioning at school or

with their peers and may require intensive interventions such as hospitalization.

Current treatment for an eating disorder typically involves a multidisciplinary

approach including medical and nutritional rehabilitation as well as psychological

interventions (Wilson & Shafran, 2005). More recently, rehabilitation centers for eating

disorders have adopted a treatment approach which has come out of the Maudsley Hospital

in England, and which has been expanded, modified, and systematically detailed by Lock

and LeGrange (Lock & le Grange, 2005). In this approach, family therapy is provided to

empower and support parents in the refeeding process of their child, as well as to address

underlying psychosocial issues. In parallel to the emergence of the Maudsley family-based

therapeutic approach, relatively new pediatric day treatment programs for the treatment of

eating disorders in youth have emerged in many provinces. Both family-based outpatient

therapies and day treatment programs have been developed, in part, to address historically

lengthy hospital stays and repeat admissions for youth struggling with an eating disorder.

However, to date, there has been no long-term outcome measurement examining the

effectiveness of these approaches, or predications of best outcome based on types of eating

disorders. There is also a lack of research on clinical pathway management, even though it

is acknowledged that there is a wide range of eating disorders requiring different levels of

intervention.

The paucity of research on treatment outcomes in eating disorders is partly related to

the prohibitive expense of creating a randomized control trial to compare one intensive and

comprehensive treatment approach to another. Single site studies do not have the power to

complete the research and the generalizability of the results would be limited. The current

study was acknowledged to be limited by its lack of randomization; however, it was

established to overcome the issues concerning power and generalizability that is afforded by

use of a multi-site study. Data from the participating sites is thought to provide results to help

Page 9: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

9

researchers understand the profile of patients presenting to tertiary care hospitals, 6 month

recovery trajectories, and predictors of outcome.

Existing Partnerships

At the beginning of this grant informal partnerships were being developed between

the Children’s Hospital of Eastern Ontario’s (CHEO) eating disorder program, and the

pediatric eating disorders programs located at McMaster Children’s Hospital (MCH),

Southlake Regional Health Centre (SRHC), and the Hospital for Sick Children (HSC), to

explore how to become a multisite team to allow for the examination of clinical profiles and

recovery trajectories of youth suffering from eating disorders. When this grant was

developed, all four pediatric centers provided outpatient services in the form of

comprehensive assessments, medical management, psychopharmacology, nutritional

counseling, family therapy, individual therapy, and group therapies. All four tertiary care

centers also had specialized interdisciplinary teams to care for patients who are medically

unstable and must be admitted to hospital. In addition, CHEO, SRHC and HSC eating

disorder programs offer intensive day treatment programs for youth suffering from severe

eating disorders. Although the particular range and nature of services available for youth

differ within each program, the programs treat the same population (youth younger than

age18), and the family/team based treatment model and philosophy of each program are

similar. The four partners had already demonstrated a capacity for single site program

evaluation activities and each had established databases with common measures across

sites. The following provides a brief description of the single site program activities that each

site was engaged in at the time of the grant application:

1) CHEO EDP had been actively collecting and evaluating clinical outcomes from their Day

Treatment Program since the program began in January 2000; clinical outcome findings had

been presented at provincial, national, and international conferences. Similarly, all

assessment, outpatient, and tracking data had also been collected and managed in a

Page 10: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

10

database since the opening of the program, providing further evidence of this site’s abilities

to participate in program evaluation and outcomes management. In January 2007, CHEO

received funding for a provincial inpatient eating disorder program and implemented a

program evaluation component to this service in April 2008; since that time, a steering

committee for ED program evaluation activities met on a weekly basis to discuss

implementation successes, challenges and changes. Similarly, the Mental Health Patient

Service Unit (MHPSU) at CHEO is strongly committed to program evaluation and had

developed a steering committee for outcomes measurement for which a representative from

each of the service units (including eating disorders) met on a monthly basis for the

purposes of knowledge exchange and the development of a common database. The

MHPSU had prioritized program evaluation activities across the full continuum of its

services. The Eating Disorders Team had taken a leadership role in the capacity building of

its program evaluation activities since January 2000.

2) SRHC EDP had been formally measuring outcomes since September 2008 for all

patients presenting to the Program for an assessment. Other evaluation activities also

ongoing included the evaluation of new adjunct therapies (emotion-focused therapy; multi-

family therapy and reflecting team family therapy) and an assessment of needs identified by

family physicians and psychologists in the community.

3) HSC EDP had recognized the importance of maintaining consistent and ongoing program

evaluation activities and had been evaluating outcome from all components of their

program. The EDP employed psychologists and a psychometrist for ongoing program

evaluation activities, and had the program evaluation infrastructure necessary for this study.

4) MCH Pediatric EDP highly valued clinically relevant research such as program

evaluation. Staff members of the EDP all actively participated in program evaluation work

through assisting with data collection, providing suggestions and feedback regarding

Page 11: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

11

specific evaluation questions. MCH has had considerable success to date with implementing

program evaluation practices.

The initial four participating organizations also created strong ties with the Ontario

Community Outreach Program for Eating Disorders. It was anticipated that through the

partnership and the resulting multi-site centralized database, a framework for the

amalgamation of data with others sites in Ontario would be possible. The director of the

Ontario Community Outreach program for Eating Disorders, Dr. Gail McVey, was fully

supportive of this initiative, and was invited to provide consultation to the partnership

regarding the broader needs of the province. It was anticipated that this liaison would lead to

excellent knowledge exchange opportunities within the province.

Recognizing that a centralized multi-site database requires expertise in technology,

privacy legislation, and ethics, the principal investigators had been in consultation with

experts on behalf of the partnership group. Mr. Tyson Roffey the Director of Information

Services and the Privacy Officer at CHEO and Dr. Khaled El-Emam, principal investigator

for the Electronic Health Information Laboratory at the University of Ottawa and CHEO

Research Institute had been consulted to ensure that the database could be created with

the appropriate security dimensions, with enough sophistication to handle at least four

separate sites, to be able to be enhanced over the years, and that all privacy legislation

could be considered. Finally, Dr. Carole Gentile, chair of the Research Ethics Board at

CHEO was a key consultation partner providing expert ethical guidance.

The proposed evaluation activities (see Appendix A and B for the Program Logic

Model and the Evaluation Plan) resulting from the development of this multi-site partnership

will have direct impact on child and youth mental health, with a focus on eating disorder

programs for children and youth at hospitals in Ontario. Eating disorders continue to be

chronic and life threatening illnesses for the children and youth of Ontario, with an ongoing

paucity of research examining clinical outcomes. This study was designed to build on the

Page 12: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

12

existing capacity for strong outcomes research in youth with eating disorders, by creating a

partnership in outcomes management between four provincial organizations who provide

intensive interdisciplinary treatment for eating disorders.

Results and Lessons Learned

In Ontario, four specialized pediatric eating disorder teams; the Children’s Hospital of

Eastern Ontario (CHEO), Southlake Regional Health Centre (SHRC), McMaster Children’s

Hospital (MCH) and the Hospital for Sick Children (HSC), made a commitment to take action

to address the lack of research available for this vulnerable population. The vision of this

multi-site partnership was conceptualized by members from all sites and with the leadership

of Dr. Katherine Henderson and Dr. Annick Buchholz at CHEO this vision has been realized.

At this time, only Dr. Katherine Henderson remains as the principal lead on this project, as

Dr. Buchholz has taken a leave of absence from her role on the Eating Disorder Team.

These initial four centres created an interdisciplinary, multi-institutional partnership with the

goals of greater research collaboration, shared resources, and shared data to attempt to

close the knowledge gap in research on outcomes and treatment in children and youth

suffering from eating disorders. This multi-institutional partnership received this Provincial

Centre of Excellence Program Implementation Grant in June of 2010 to formally develop a

Centralized Multisite Database Partnership (CMDP) and develop capacity for research with

the creation of a multisite database.

Over the course of the granting period, the partnership met monthly via

teleconference, as well as met in-person on four separate occasions. Through these

meetings this team has accomplished four major goals: 1) the establishment of a solid

partnership across the three sites with one representative from each site acting as a

Steering Committee member, 2) the creation and approval of all relevant authorship and

ownership documents necessary to operate a multi-site partnership, 3) the establishment of

Page 13: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

13

a web-based database and data definition dictionary which explicitly lists and defines all

variables that are to be part of the multi-site database, and 4) has contributed to knowledge

translation both provincially and nationally.

1) Evolution of the Partnership

A strong partnership is the cornerstone to the success of any longitudinal multisite

research program. Thus, a primary objective of this project was to formalize a multisite

partnership between the four interested pediatric eating disorder programs in Ontario. Prior

to being granted funding from the Centre of Excellence, colleagues from the initial four sites

discussed informally over the phone and met once face-to-face (during an annual provincial

network meeting) in order to establish interest in forming this partnership. With confirmed

interest, the four sites worked together to draft the proposal for the current grant. It was

agreed that CHEO would lead this research initiative with Dr. Henderson and Dr. Buchholz

as principal investigators.

Drs. Henderson and Buchholz, with Ms. Obeid as a research co-ordinator worked

within a collaborative participatory framework to establish a formal partnership that was

inclusive and sustainable. Interdisciplinary representatives from each site were invited to

join the research partnership. Interdisciplinary and inter-site relationships were fostered and

strengthened through bi-monthly teleconferences and 3 full-day in-person meetings. These

meetings provided a forum for an exchange of knowledge and expertise and the

development and refinement of our common vision for the partnership. During these

meetings the detailed authorship agreement, methodology for the study, data dictionary, and

future knowledge dissemination and research plans were developed, discussed, and agreed

upon (this will be reviewed in more detail in later sections).

Through their participation in the regular meetings and the development of the

structure of the partnership and the research program, the MCH representatives had to

make the very difficult decision that due to a lack of protected time and financial resources,

Page 14: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

14

they would not be able to collect the minimum data required to be part of the partnership.

They continue to be committed to joining the partnership should they or the partnership be

successful in securing more funds to provide the resources required.

The CMDP partnership currently consists of 3 pediatric eating disorder programs in

Ontario with a strong interdisciplinary representation. The CHEO program has 4 co-

investigators involved: 2 psychologists, 1 psychiatrist, 1 adolescent health physician, and

the support of 1 research coordinator and 1 software consultant. HSC has 4 co-investigators

including 2 psychologists, 1 psychiatrist, 1 adolescent health physician, and the support of a

psychometrist. SRHC has 2 co-investigators 1 Clinical Mental Health Specialist and 1

psychiatrist, and the support of a PhD student who helps with data entry and database

maintenance. A further partner to this collaboration is Dr. Adele Lafrance who originally held

the lead at SRHC, but in September 2010 she accepted a position at Laurentian University.

She has remained a co-investigator on the project, and has become an academic partner

(see Appendix C for a list of study partners).

In addition to the direct partners involved in the partnership, the CHEO site

investigators have also fostered important relationships with staff members with a breadth of

expertise within CHEO who have an ongoing central role in the maintenance and

sustainability of this partnership. The MHPSU Operations Director and the Chief Information

Officer at CHEO have committed to the development and on-going maintenance of the

provincial database for eating disorders beyond the timelines of this initiative. Although

funding from the current grant was sought to support software development and consultation

fees, CHEO has committed to supporting this proposal with in-kind funds for the

development and sustainability of this database (to be housed at CHEO). For example,

CHEO currently pays the $2000 fee for annual maintenance of the website server. Given

that the multi-site data collection process developed for this study has been designed to be

sustained beyond the terms of the current grant (i.e., resource infrastructures and web-

Page 15: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

15

based database), the partnering sites have also agreed to collect the common data set at

12-months post-assessment, speaking to the long-term collaboration created by this grant.

Furthermore, the Software Consultant, provided by Dr. Khaled El-Emam’s E Health

Information lab, has agreed to continue to provide in-kind support for the maintenance of the

web-based database.

The work and time dedicated to ensuring a strong, formal partnership between the

three sites will provide the foundation for a larger provincial and national partnership

between pediatric eating disorder programs. Following the presentation provided by Dr.

Henderson and Dr. Buchholz at the November 2010 annual provincial network meeting for

eating disorders in Ontario, the London Health Sciences Centre has contacted the CMDP to

express an interest in joining the partnership.

2) Creation of the authorship and ownership guidelines

Over the course of the grant the multi-site team focused on developing a solid

partnership, and an important component of formalizing the partnership was the creation of

authorship and ownership agreements. These agreements are complex and have been

designed to address the time frame of the current grant from the Centre of Excellence and

the long term vision for the database, which includes the current research proposal and the

possibility of the partnerships and database thriving for many years. Each site has

demonstrated incredible commitment to ensuring the success of this research project, and

with this level of commitment also comes a need to ensure that ownership and credit are

attributed fairly to all involved. Through the early stages of this partnership, it came to the

attention of the collaborators that the need for formalized agreements was necessary. The

process of establishing these agreements was lengthy and complicated. CMDP members

invested time in researching and consulting with other multi-site projects and teams, to

determine all of the important components to address when developing an authorship

agreement for a longitudinal multisite research program. Each site dedicated some time to

Page 16: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

16

this initiative, and together several relevant documents were shared with the partnership.

Through research and many lengthy discussions and debates, the CMDP was able to

establish the guidelines through consensus and collaboration. The formalization of the

authorship agreement represents a significant accomplishment of this partnership, and

forms the foundation for the ongoing success of the partnership.

The following documents were drafted and approved by the CMDP partnership (see

Appendix D):

1. Authorship, Acknowledgements, and Manuscripts Agreement

2. General Authorship and Manuscripts

3. Single Site versus Central Shared Dataset

4. Requesting Secondary Use of Data

5. Ancillary Studies

6. Designating a New Partner on the CMDP of PEDP of Ontario

7. Maintaining the Integrity of the Database

8. Intellectual Property and Data Sharing Agreement

Furthermore, the CMDP partners collaboratively prioritized the top 9 research papers that

would address the overall goals of the research program. It was agreed that each site would

take the lead on 3 separate projects that would follow from either the assessment data or

the follow-up data. The assignment of site and title of the 9 projects are available in

Appendix E.

3) Centralized Database

The third central objective that was achieved over the course of the grant was the

development of the web-based centralized database. This objective was achieved through

three steps: (a) achieving consensus on the central indicators to be evaluated, (b)

development of a detailed data definition dictionary, and (c) the software development of a

web-based database.

Page 17: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

17

Common Indicators

During the in-person meetings, the CMDP partners had extensive discussions and

engaged in knowledge exchange about which indicators were most appropriate for this

research initiative (based on research and clinical expertise) and how to best measure these

indicators. The common outcome indicators that were selected to be part of this centralized

database were agreed upon by all participating sites. Specifically, medical indicators include

body mass index and percent of healthy weight, including items to define how these are

calculated for each child and youth. Eating disorder behaviour and attitudes indicators are

measured using an internationally recognized and standardized self-report measure of

eating disorders and a relatively new clinician-report measure validated by CHEO

investigators (EDS3). Psychological indicators have been chosen to reflect the two most

common comorbidities in patients with eating disorders and include internationally

recognized and standardized self-report measures of depression (CDI) and anxiety (MASC)

in youth. Parents are also asked to complete a validated measure of self-efficacy in their

ability to support their child through recovery. Other predictor variables agreed upon include

demographic information (age, gender, region) and clinical variables (e.g., diagnosis,

chronicity of illness). Data collection is well underway at all three remaining sites, and is

currently being collected at the time of the initial assessment (a patient’s first presentation to

the treatment program, Time 1) and identical medical, eating disorder and psychological

outcome data is also currently being collected at six months post-assessment (Time 2).

Further, this study is also measuring whether the programs are providing family- and youth-

friendly services, by assessing parent and youth satisfaction with the treatment they receive

(Time 2 only). Finally, the feasibility of the data collection process is to be evaluated by all

those involved in the data collection process using a feasibility questionnaire (via web-based

survey-monkey). This feasibility survey will be distributed once the web-based data base is

operational.

Page 18: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

18

All programs have the resource infrastructure available to collect the data through

medical/dietetic appointments and/or follow-up appointments with therapists. Trained

therapists and psychometrists are administering and scoring the psychological measures,

and physicians/nurses/dieticians are collecting the medical data. The psychological

measures take approximately 20 minutes for patients to complete. The medical and

psychological data are also being used clinically to track the patient’s progress. Research

assistants (an existing resource at each site) at the respective sites have been involved in

scoring and entering the data into each site’s database, while waiting for the instalment of

the shared web-based statistical database. Raw data remains secured in psychology and

medical files at the respective sites.

Data Definition Dictionary

Once the common indicators were decided upon, a very detailed data definition

dictionary was created. This consisted of detailing the name of the variable as it appeared in

SPSS, the data type, the descriptive variable label, the value number, and the value labels.

This dictionary was created in Excel and describes all 835 variables contained in the

database. An excerpt of the data definition dictionary is provided in Appendix F. Generating

the data definition dictionary required collaboration across sites about each sites existing

data base and the best definition for the new multi-site data base that would still be feasible

for each site.

Web-based database

The centralized database and web application has been developed by the IT

professionals from the E-health Information Lab at CHEO’s Research Institute led by Dr.

Khaled El Emam at CHEO’s Research Institute and supported by Tyson Roffey, Chief

Information and Privacy Officer at CHEO. It has been designed so that each partner is able

to log into the web application through a web browser and then upload and enter all of their

Page 19: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

19

data into the centralized database. Data may be viewed and retrieved from the database,

via the web application, by those with the correct privileges. Data will be anonymized at the

user end as necessary and sent to the centralized database via a secure channel (i.e. using

128-bit SSL encryption). The database itself will be stored on a server within CHEO. The

server will have the appropriate security, monitoring, and backup systems in place. This set

up will ensure that only the study partners will be able to read and modify the database. The

IT professionals from the E-health Information lab have committed to continuing to provide

support during the pilot testing of the database to ensure that it is stable, user friendly and

secure. Given that the web-based database is maintained at CHEO, credentials and access

will be provided by CHEO researchers to the appropriate people (i.e., study investigators

and trained research assistants), and the CMDP partnership has agreed that CHEO will act

as a gatekeeper to this database. Data within the database will be identified by coded IDs

that correspond to participants at the respective sites. There will be no names or identifying

information stored within the centralized database. Privacy specialists from the E-Health

Information Lab at CHEO have been consulted to ensure that the data stored within the

database meets all privacy standards.

While the data base structure was successfully designed and developed over the

course of the grant, there was a significant delay in moving the data base to the secure

server at CHEO. We have been waiting for 12 months for the implementation of a secure

server that is to house the web-based database. This delay was due to the launch of an

electronic documentation (eclin Doc) system at CHEO which took priority of CHEO IS

resources. IS was unable to provide any personnel due to the time commitment required for

the launch of eClin Doc, resulting in a fairly significant delay in the installation of a secure

server devoted to this project. At this point in the time, the secure server has been

configured, passwords and access have been provided to our software developer, so it

appears reasonable to expect that the web-based database will be secured on the CHEO

Page 20: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

20

server by the end of April 2011. Once the secure server is established, data from each

respective site will be uploaded into the multi-site database in order for analyses to start.

Outcomes Evaluation

Although unique challenges arose throughout the course of the granting period that

delayed the acquisition of a secure multi-site database to be populated with data that would

allow for evaluative analyses, the vision and objectives for the partnership are still clear and

pressing. The paucity of research on pediatric treatment outcomes in eating disorders has

been noted by researchers over the last decade, and in order to optimize the power and

generalizability of outcomes data, the partnership agreed to work collaboratively to address

three shared objectives.

Data collection commenced at all sites in January of 2010, and ongoing collection is

still underway. Once the web-based database is secured on the CHEO server (expected

date: April 2011), data from each respective site will be uploaded into the multi-site

database in order for analyses to start.

The specific goals of this study were:

(1) To examine the clinical profiles of youth presenting for an eating disorder

assessment in tertiary care hospitals in Ontario;

(2) To examine recovery trajectories of medical and psychological outcome markers of

youth struggling with an eating disorder for six months following their initial

assessment;

(3) To evaluate predictors of outcome based on clinical profiles and treatment services

received over six months.

It is anticipated, that with the ongoing multisite partnership and the dedication of the

remaining sites that are currently committed to the partnership, that the above objectives will

be met in the upcoming months. At the current time, the establishment of the web-based

database on a secure server should be completed by the end of April 2011, and data from

Page 21: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

21

the respective sites will be imported into the database within the month of May 2011.

Analyses on the data, once available, are set to commence over the summer of 2011.

Feasibility of data collection

In addition to the communal indicators that are collected at each site, the partnership

is also committed to learning about the feasibility of this data collection. Specifically, the

CMDP is interested in knowing the estimation of the rates for patient/parent participation,

enrolment, and adherence/compliance at each of the three sites. In order to collect this

information, a mixed methods survey created through a participatory approach with all co-

investigators was created. Quantitative data will be collected on the number of participants

invited, the number who choose to participate, the number who decline, and the number lost

to attrition at the six-month follow-up time. Qualitative data regarding types of barriers and

facilitators that were felt by each member of the partnership will also be collected, as well as

a rank-ordering of which were felt to be the top 3 barriers or facilitators. Each site will be

asked to complete open-ended questions regarding suggestions to overcome any barriers

and how they felt the facilitators were helpful. This data will be analyzed to determine any

common or site specific themes. All feasibility surveys will be administered by the research

coordinator once the web-based database goes live. In order to evaluate the user-friendly

interface, security, and sustainability of the centralized database over time, as well as

assessing the feasibility of uploading the data in a timely manner, a survey will be

administered to all end-users and investigators at each site. Further, the survey will be

designed to collect the following information about the centralized web-based data base: a)

number of times unable to access the server; b) median time to upload data to the server;

and c) number of mistakes encountered at each site in the uploads. Any ongoing issues

detected from these feasibility surveys will be followed-up by our IT consultant.

Page 22: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

22

4) Contribution to KT

One of the final objectives of this project was to promote and contribute to knowledge

translation in this field. Thus, the interdisciplinary, multi-institutional provincial partnership of

the CMDP proposed, secured funding for, and executed a national meeting for specialized

pediatric eating disorder teams in tertiary care hospitals across Canada, with the goals of

connecting, collaborating, and ultimately creating a national outcomes research agenda in

pediatric eating disorders. The meeting, which was CIHR funded, directly addressed child

and youth mental health, with a focus on outcomes research on the treatment of eating

disorders in children and youth. Building on lessons learned and the strength of the

provincial partnership, the CMDP proposed a day that focused on knowledge sharing and

exchange, catalyzing new research initiatives, and creating a national consensus on the

research needs, gaps and opportunities in outcomes management of eating disorders in

children and youth. One of the aims of the meeting was that it would act as a catalyst for the

development of a national interdisciplinary, multi-institutional partnership that will work

toward a national research agenda on outcomes research in the treatment of pediatric

eating disorders. Using the lessons learned from the already formed provincial multi-site

partnership, it was felt that the knowledge gained through a multi-institute national research

initiative would create crucial evidence for the provincial, national, and international

communities regarding the effectiveness of the current standards of care for youth with

eating disorders, and enhance eating disorder treatment for children and youth in Canada

and the international community. Paramount to this initiative was the leadership that the

CMDP Steering Committee provided for the full-day meeting, and the vision that the

provincial partnership held to solidify and create firm stepping stones and guidelines for a

provincial partnership that could then be applied to a larger national platform.

Page 23: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

23

Conclusion and Recommendations/Next Steps

In conclusion, through the funding for this grant, Dr. Henderson and Dr. Buchholz

with their co-investigators were successful in creating a formal multisite partnership for

outcomes research on pediatric eating disorders with clear terms of agreement on the use of

the data and authorship, in developing a centralized web-based database, and in

successfully engaging in knowledge translation and exchange.

The development of this multisite partnership is extremely important. Through this

partnership the CMDP will finally be able to start to address the paucity of research

examining outcomes in pediatric eating disorders. The knowledge generated over the

upcoming years from this partnership and centralized database will provide missing

evidence to better guide the prevention and treatment of this serious and chronic mental

health illness affecting many children and youth in Ontario. This knowledge will also be

essential to our national and international partners who work hard to provide excellent care

and treatment to youth suffering from eating disorders.

As noted earlier, the success of the CMDP has allowed the partnership to be

successful in receiving a CIHR grant to hold a national meeting on outcomes research in

pediatric eating disorders. This meeting will help generate much needed interdisciplinary

and inter-site collaborations to enhance outcomes research in pediatric eating disorders

across Canada. The next steps from this meeting include regular working groups and a bi-

annual national meeting to continue to maintain and improve on a national research agenda

for outcomes research in pediatric eating disorders.

The CMDP has learned from the challenges faced in implementing this grant. The

delay in being able to implement the web-based database, was turned into an opportunity to

apply for further funding to pilot test the data and the feasibility of data collection once the

database was established. The team was successful in receiving funds from the Sick Kids

Psychiatry Endowment Fund ($25,000, January 2011- January 2012). The partnership also

Page 24: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

24

worked to strengthen the relationship and formal agreement with the CHEO IS department

to ensure the long term sustainability of the web-based database and to prevent future

challenges (as much as possible). The partnership has set the goal of building on the

results and successes of the Centre of Excellence Grant and the Hospital of Sick Children

grant. To this end we are committed to submitting a grant to CIHR in January of 2012 to

provide funds for an extensive 3 year evaluation of programs in Ontario and possibly across

Canada.

Knowledge Exchange

Knowledge exchange and dissemination from this project has focused on ensuring

the success of this centralized multi-site database, with the long term vision that its

successes will be the seed for the development of a province wide centralized multi-site

database for all pediatric eating disorder programs, greatly enhancing knowledge exchange

across the province. Knowledge gained through the process of creating a collaborative

network and a web-based centralized multi-site database has been shared between the

partnering agencies, within their hospitals, with the full Ontario network for eating disorder

providers, and at regional, provincial, and national meetings. It is anticipated that knowledge

and skills gained as a result of the data within this program evaluation project will be used to

better understand the presentation and treatment trajectories of youth with eating disorders

at specialized interdisciplinary eating disorder programs in the province. Having the large

multi-site sample size will allow important questions to be asked and answered regarding

the prognosis of different patients and how to best match treatment to youth at assessment

and throughout their treatment journey, to ensure the best success for each individual and

youth with an eating disorder. The expectation is that the innovative knowledge gained

through these research activities will be shared in the form of presentations, discussions,

face-to-face meetings, publications, etc, and may also lead to the creation of a community of

practice focused on pediatric eating disorders.

Page 25: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

25

Also, the partnering agencies and the director of the outreach program, Dr. McVey,

have been engaged in regular knowledge exchange over the course of the granting period,

and she has been kept abreast of the progress and outcomes of this partnership.

Knowledge exchange has occurred through regular teleconference calls and face-to-face

meetings. Further, the multisite partners have and will continue to share knowledge and

anecdotal experiences with one another regarding the process of creating and starting a

multi-site database, by means of regular conference calls which have allowed for the

exchange of new and creative ideas and ensure that each site learns from the experience of

the other sites. These opportunities for exchange have ensured the success of the

centralized database and the longevity of the partnership.

Knowledge and skills gained as a result of this project has been disseminated

through formal and informal presentations and written documents:

• Findings regarding the ongoing multi-site program evaluation project have been

shared with members of the eating disorder teams at each organization, during

weekly/monthly research meetings and bi-annual/annual team retreats.

• Acquired knowledge and skills related to program evaluation generally, the creation

of a multi-site partnership, and of the programs specifically, have been presented to

key hospital staff across the country during a national meeting of all eating disorder

programs. It has also been presented to all pediatric and adult eating disorder

programs at the Annual Provincial Outreach Conference in November 2010.

• It is also anticipated that information will be disseminated through The Provincial

Centre for Excellence’s required Final Outcomes Report and Plain Language

Summary of project outcomes.

Page 26: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

26

• As the results of the outcomes evaluation become available, further knowledge

exchange will occur in the form of manuscripts in applied scholarly journals and

presentations at provincial, national, and international conferences.

• Teams at London Health Sciences Centre, the Central West Eating Disorder

Program and an eating disorder team in Newfoundland have consulted the CMDP

principal investigators on outcomes research for children and youth with eating

disorders.

Page 27: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

27

References

Katzman, D. K. (1999). Preventing Eating Disorders: A handbook of interventions and

special challenges. Philidelphia, PA: Taylor & Francis Group.

Lock, J. & le Grange, D. (2005). Family-based treatment of eating disorders. Int.J

Eat.Disord., 37 Suppl, S64-S67.

Neiderman, M. (2000). Anorexia Nervosa and Related Eating Disorders in Childhood and

Adolescence. (2nd edition ed.) East Sussex, UK: Psychology Press.

Nielson, S. & Bara-Carrill, N. (2003). Family, Burden of Care and Social Consequences. In

J.Treasure, U. Schmidt, & E. van Furth (Eds.), Handbook of Eating Disorders (2nd

ed., West Sussex: John Wiley & Sons.

Sullivan, P. F. (1995). Mortality in Anorexia Nervosa. American Journal of Psychiatry, 152,

1073-1076.

Wilson, G. T. & Shafran, R. (2005). Eating Disorder guidelines from NICE. The Lancet, 365,

79-81.

Page 28: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

28

APPENDIX A

___________________________________

Program Logic Model

Page 29: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

29

Evaluation Outcomes ► Medical

stabilization

► Reduction in eating disorder symptoms

► Improved psychological functioning: reduced depression

► Improved psychological functioning: reduced anxiety

► Increase in parent’s self-efficacy in ability to support child/youth

Process Outcomes ► Demographics/

patient profile

► Satisfaction

► Feasibility of outcomes measurement

I N P U T S O U T C O M E S

► Resources specific to program evaluation activities within overall fiscal resources:

○ Children’s Hospital of Eastern Ontario

(CHEO): 0.2 FTE psychologist/psychiatrist; 0.2 FTE psychometrist

○ Hospital for Sick Children (HSK): 0.2 FTE psychologist/psychiatrist; 0.4 FTE psychometrist

○ Southlake Regional Health Centre (SRHC): 0.4 FTE psychologist

► Human Resources:

○ Specialized interdisciplinary team at each of the four sites. Core clinical disciplines include:

- Psychologists - Nurses - Psychiatrists - Dietitians - Pediatricians/Adolescent Health Specialists - CYCs

Program Goals: Improved medical and mental health through specialized pediatric family-based services across the continuum of care for eating disorders

Program Logic Model An evaluation of pediatric eating disorder programs in Ontario:

A multisite approach

• Regular

appointments for nutritional & medical monitoring

• Individual &

group therapy provided in intensive (inpatient & day hospital) and outpatient settings

• Parents/ caregivers & family therapy & education groups

O U T P U T S

Activities Target Group

• Children/

Youth under 18 years of age

• Children/

Youth under 18 years of age

• Parents/

caregivers & families

CO

MPO

NEN

TS

▪ Men

tal h

ealth

ser

vice

s

▪ M

edic

al in

terv

entio

n an

d

n

utrit

iona

l man

agem

ent

Page 30: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

30

APPENDIX B

____________________________________

Evaluation Plan

Page 31: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

31

Evaluation Plan

● Outcome indicators: Focus on medical stabilization, reduction in eating disorder symptoms, mental health improvement, and increase in parental feelings of self-efficacy toward recovery from eating disorders.

Outcomes Indicator(s) Source of data

Method to collect data

Who collects data

When collects data

E V A L U A T I O N O U T C O M E S

Medical stabilization

Movement toward targeted ideal BMI

Scale & stadiometer

Weight and Height

Team nurse, physician or

team clinician

Assessment and 6 months post-

assessment

Reduction in eating disorder symptoms

Decrease in scores on a self-report &

clinician measures of eating disorder

symptoms

EDI 3 (child/youth)

EDS3 (clinician)

Validated self-report

questionnaire EDS3:

validated clinician rating

scale

Team clinician, psychometrist;

or research assistant

Assessment and 6 months post-

assessment

Improved psychological functioning: Reduced Depression

Decrease in scores on a validated self-report measure of child & adolescent

depression

CDI (child/youth)

Validated self-report

questionnaire

Team clinician, psychometrist,

or research assistant

Assessment and 6 months post-

assessment

Improved psychological functioning: Reduced Anxiety

Decrease in scores on a validated self-report measure of child & adolescent

anxiety

MASC (child/youth)

Validated self-report

questionnaire

Team clinician, psychometrist,

or research assistant

Assessment and 6 months post-

assessment

Increase in parent’s self-efficacy in ability to support child/youth

Increase in scores on a measure of self-efficacy for

parents/caregivers

PVA (parent/

caregiver)

Validated self-report

questionnaire

Team clinician, psychometrist,

or research assistant

Assessment and 6-months post-

assessment

P R O C E S S O U T C O M E S

Demographics/patient profile

Demographic & clinical patient

profiles

Interview checklist

Clinician completes intake form

Team clinician Assessment

Satisfaction Scores on

Satisfaction Measure: CSQ

CSQ (youth & parents)

Validated self-report

questionnaire

Team clinician, psychometrist,

or research assistant

6 months post-assessment

Page 32: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

32

APPENDIX C ____________________________________

Centralized Multi-site Database Partners

Page 33: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

33

Partners

Site Partner Title

Children’s Hospital of Eastern Ontario

Dr. Katherine Henderson Psychologist Dr. Annick Buchholz Psychologist Dr. Mark Norris Pediatrician Dr. Wendy Spettigue Psychiatrist Dr. Nick Barrowman Senior Statistician

Southlake Regional Health Centre

Dr. Karin Jasper Clinical Mental Health Specialist

Dr. Ahmed Boachie Psychiatrist

Hospital for Sick Children

Dr. Leora Pinhas Psychiatrist Dr. Margus Heinmaa Psychologist Dr. Melissa Lieberman Psychologist Dr. Debra Katzman Adolescent Health Physician

Laurentian University Dr. Adele Lafrance Psychologist

Page 34: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

34

APPENDIX D

____________________________________

CMDP Partnership Agreements

Page 35: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

35

CENTRALIZED MULTI-SITE PARTNERSHIP OF PEDIATRIC EATING DISORDERS PROGRAM’S IN ONTARIO

- AUTHORSHIP GUIDELINES, ROLE DEFINITIONS AND PROCEDURES MANUAL -

Background/Reference Material Regarding Authorship

The Committee on Public Ethics Report on Authorship Disputes recommends that authorship issues should be discussed right at the start. “Start gathering views of all team members and if possible discuss authorship at a face-to-face meeting. Even before a study is finished, you should have some idea of the publications that might come out of it, such as a conference abstract, the full paper, then some supplementary papers, and who is likely to be most involved in these. Continue to discuss ideas about authorship as the project evolves, and especially if new people get involved. Keep a written record of your decisions.” Decide authorship before you start each article. Many authorship difficulties arise because of misplaced expectations and poor communication. So it is important that, before you start to write up your project, you confirm in writing who will be doing what and by when. Ideally you should do this face to face, though this may not always be possible. Keep everyone informed of any changes with a written note. (http://publicationethics.org/files/u2/2003pdf12.pdf) According to the International Committee of Medical Journal Editors (ICMJE) (www.icmje.org), “…an author is generally considered to be someone who has made substantive intellectual contributions to a published study”. Authorship applies to all publications, abstracts and presentations and any other published or presented material (will be referred to as papers throughout this agreement). As detailed in the ICMJE’s Uniform Requirements for Manuscripts Submitted to Biomedical Journals: Writing and Editing for Biomedical Publication (2008):

• Authorship credit should be based on 1. substantial contributions to conception and design, acquisition of data, or

analysis and interpretation of data; 2. drafting the article or revising it critically for important intellectual content;

and 3. final approval of the version to be published.

Authors should meet conditions 1, 2, and 3. • When a large, multi-center group has conducted the work, the group should

identify the individuals who accept direct responsibility for the manuscript. • Acquisition of funding, collection of data, or general supervision of the research

group alone does not constitute authorship. • All persons designated as authors should qualify for authorship, and all those

who qualify should be listed. • Each author should have participated sufficiently in the work to take public

responsibility for appropriate portions of the content.

According to Tri Council Policy on Integrity in Research and Scholarship (www.nserc-crsng.gc.ca)

• All papers will recognize the substantive contributions of collaborators and students.

Page 36: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

36

• All papers will ensure that authorship of published work includes all those who have materially contributed to, and share responsibility for, the contents of the publication, and only those people.

Background/Reference Material Regarding Contributors Listed in

Acknowledgments All contributors who do not meet the criteria for authorship should be listed in an acknowledgment section. Examples of those who might be acknowledged include a person who provided purely technical help, writing assistance, or a department chair that provided only general support. Corresponding authors should declare whether they had assistance with study design, data collection, data analysis, or manuscript preparation. If such assistance was available, the authors should disclose the identity of the individuals who provided this assistance and the entity that supported it in the published article. Financial and material support should also be acknowledged. Groups of persons who have contributed materially to the paper but whose contributions do not justify authorship may be listed under such headings as “clinical investigators” or “participating investigators,” and their function or contribution should be described—for example, “served as scientific advisors,” “critically reviewed the study proposal,” “collected data,” or “provided and cared for study patients.” Because readers may infer their endorsement of the data and conclusions, these persons must give written permission to be acknowledged. As recommended by the Council of Science Editors’ Recommendations for Group Author Articles in Scientific Journals and Bibliometric Databases, the CMDP team will use the following byline style when the number of contributing authors exceeds that requested by a specific journal. Byline: Steven Q Smith, MD, Yoko Suzuki, MD, J T Mann, PhD, Klaus T Schulze, MD, Christine DeAngelo, MD, Charles Davis, MD, PhD, Katherine J Jones, MD, and CMDP of PEDP in Ontario.

Page 37: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

37

Centralized Multi-Site Partnership of Pediatric Eating Disorders Program’s in Ontario’s

Additional Processes Regarding Authorship, Acknowledgements, and Manuscripts Agreement

Our approach to authorship is inclusive in that all partners/investigators will have the opportunity to be co-authors on papers and presentations. Decisions about lead authorship on papers that address primary research questions are/were discussed when the CMDP group met/meets on XXX and are documented in the “People & Projects” document. Any changes to the documented decisions will be made by the research team by 100% consensus. Decisions about lead authorship on papers that address secondary research questions will also be made by the research team by consensus. The CMDP investigators will establish a PI lead group. The investigators will each choose ____ from each site to sit on the PI lead group committee. This committee will meet regularly to review research proposals, authorship, and timelines for research papers.

• The investigator team will prepare and approve a list of potential manuscripts and presentations, lead authors and timeframes that will be approved by all investigators.

• The list of proposed manuscripts will identify a corresponding “lead” author who will meet the criteria above and will hold responsibility for drafting the first version, managing input from other authors, manuscript submission and editorial process.

• Investigators who take a key role in the writing of any paper of the full study findings will be listed according to their contribution following the lead author. If contributions are equal, authors will be listed alphabetically.

• Site Investigators will have the first option to be the lead author on papers that report results from an individual site.

• All authors have the right to opt-out of any paper where they feel they have not contributed by informing the lead author in writing at the time of the first manuscript review.

• The lead author should inform any co-authors who have not participated or contributed to the paper or to the review process following the designated review timeline that they will be removed from the author list and included in the Acknowledgments.

• The PI Lead Group and all co-investigators will be informed of any proposed manuscripts or presentations stemming from the CMDP’s database that have not already been vetted by the team. All proposed papers will be submitted to the PI Lead Group with a title, proposed list of authors, short abstract, intended journal and timeframe for submission. This will be circulated to the investigator team for review and approval. The PI Lead Group will provide written permission via email to the investigative team to proceed with manuscript submission, after an in-person or conference call discussion. Manuscripts will be prepared and submitted in a 12 month period from the time of outline approval, unless otherwise indicated in the Application for Requesting Secondary Use of Data.

• All authors involved with a paper will be responsible for reviewing and making

Page 38: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

38

contributions within a timely manner including: o 2 weeks for manuscripts o 1 week for abstracts

Students and Learners

• All students and other learners who have contributed to the project will be acknowledged in the Acknowledgement section.

• If a student or learner assumes a major role in a secondary project associated with the CMSP database, under the supervision of a Partner, the student or learner may request to co-lead authorship. Under this circumstance, the student or learner would have to play a major role in the initial draft.

Any concerns regarding authorship decisions should be discussed with the PI Lead Group.

Designating a New Partner on the CMDP of PEDP of Ontario To be considered as a partner the candidate must meet the following criteria:

• Be nominated by a partner of the CMDP • Be a clinician/treatment provider with one of the partnering organizations

Decision making regarding the designation of a new partner will include the following;

• Information is presented to the PI Lead Group for discussion and a recommendation.

• If the PI Lead Group agrees on a recommendation, the information and PI Lead Group’s recommendation is shared with all partners via email and feedback is requested (options: agree with recommendation or prefer to discuss with all partners).

• If the PI Lead Group do not agree on a recommendation, the information is shared with the all partners and is discussed during a teleconference or in-person meeting.

Formalizing the designation of a new partner will include the following;

• A member of the PI Lead Group will invite the candidate to join the partnership via email and outline anticipated contributions and collaborations, and send the candidate relevant documents (e.g. this manual, Research Projects & People, and Application for Requesting Secondary Use of Data).

• Once the candidate confirms this agreement to join the partnership, a member of the PI Lead Group will ensure that the candidate completes the Partnership Letter of Agreement.

• The Research Projects & People document will be updated.

Page 39: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

39

Background/Reference Material Regarding Intellectual Property and Data Sharing According to Tri Council Policy Statement: Ethical Conduct for Research Involving Humans 1998(TCPS) www.pre.ethics.gc.ca, the following principles will be followed. Article 11.11 With respect to research findings:

(a) Institutions and research ethics boards should take necessary measures to ensure that researchers and institutions share research results and publish or otherwise disseminate the analysis and interpretation of research findings in a timely manner without undue restriction.

Article 11.11 further states: 4. Provide that all confidentiality and publication clauses: (a) Are consistent with the researcher’s duty to share new information from

clinical trials with REBs and trial participants in a timely manner (Section D [“Sharing New Information”]);

(b) Are reasonable in terms of any limitations or restrictions on the publication or other dissemination or communication of information; and

(c) Permit researchers to access study data.

Centralized Multi-Site Partnership of Pediatric Eating Disorders Program’s in Ontario’s

Intellectual Property and Data Sharing Agreement All data will be shared with co-investigators through remote access to the centralized

multi-site database. Note that this does not permit an investigator to publish from this data unless agreed upon in the process detailed in this document.

Each site will send a copy of raw data to the research team lead at the Children’s Hospital of Eastern Ontario’s Eating Disorders Program.

Page 40: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

40

Application for Requesting Secondary Use of Data Compiled by the

Centralized Multi-Site Partnership of Pediatric Eating Disorders Program’s in Ontario

The Centralized Multi-Site Partnership (CMSP) of Pediatric Eating Disorders Program’s in Ontario fosters a collaborative atmosphere. This self-governing group makes decisions based on 100% consensus. While the group operates on an honor system, there are requirements and conditions of participation that have evolved and which must be met if the privileges of access to CMSP data sets are to be granted. These conditions are outlined in this document, the Partnership Letter of Agreement, and the Authorship Guidelines, Role Definitions, and Procedures Manual, each of which must be read before signing this Application. Partner use of data from the CMSP database is contingent upon adherence to the following stipulations: 1. A brief research proposal outlining the title, proposed list of authors, a short abstract (detailing the research question(s), relevant hypotheses, sub-sample or groups, variables, and proposed statistical methods), intended journal for submission, and a timeframe must be submitted to the CMSP PI Lead Group for approval. The PI Lead Group may work to refine the research topic and questions to prevent duplication or overlap with existing projects. 2. The proposal must also identify how this study adheres to the purposes of CMSP and might be of benefit to youth struggling with an eating disorder. 3. Ethics review must be obtained from an accredited Research Ethics Board at the partner’s institution, prior to submission to the Research Ethics Board at the Children’s Hospital of Eastern Ontario. 4. All data analyses must be conducted by remote access to the Centralized Multi-Site Database housed by the Children’s Hospital of Eastern Ontario. No dataset or subset may be copied or removed. 5. Partners agree to hold all data as confidential, and will neither conduct analyses nor report data in such a way that individual participants could be identified or identifiable. 6. Any reports, manuscripts, presentations, or posters must be approved in writing by the PI Lead Group of the CMSP prior to submission; requests for review and approval must be made at least 3 weeks before the submission deadline. 7. Acknowledgment of the CMSP as the source of the data must be made in any reports, manuscripts, presentations, or posters. 8. Approval is for a particular purpose and research question(s) and cannot be transferred to another person or extended to include other uses. If you wish to expand the scope of the project to include other questions, you must first discuss this with the PI Lead Group, have the approval of all partners, and have approval in writing from the CMSP Lead. 9. CMSP encourages the dissemination of research to the wider community. It is expected that each project will conclude with a brief fact sheet or abstract of results for general audiences that the CMSP can distribute to policymakers, professionals who work with this population, and youth themselves.

Page 41: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

41

10. Permission for the use of data is given for a specified period of time. If the project is not completed during this time period, the permission is rescinded, unless an extension has been approved by the CMSP. The specific time period will be discussed and agreed on by all partners of the CMSP. 11. In order to promote timely reporting of research, if a partner contracts to submit a manuscript for publication from their project, and such a manuscript is not submitted within the approved timeline, the PI Lead Group reserves the right to approve/assign a new lead to that particular project who will prepare this manuscript for publication on the partners behalf. In such a circumstance, author order may need to be renegotiated to reflect the efforts of the CMSP partner who assumes the lead role on this project. 12. A copy of any reports, manuscripts, presentations, posters, or fact sheets must be given to all CMSP partners.

The Centralized Multi-Site Partnership of Pediatric Eating Disorders Program’s in Ontario gives permission to:

Name ______________________________________________________________________ To use the following variable(s) from the data set _____________________________________ For the proposed project entitled: _____________________________________________________________________________________________________________________________ which has been submitted to the Centralized Multi-Site Partnership (see attached) and has been approved by all partners of the Centralized Multi-Site Partnership on (date) ________________ The permission is given for the time period of __________ to _____________________ I have read all the requirements in this contract and I agree to adhere to them. Signature ________________________________ Date _________________________ Name ___________________________________ Title _________________________ Partnering Site __________________________________

Page 42: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

42

As a member of the PI Lead Group, my signature below indicates that I have agreed to allow the data from my site to be included in the data analyses conducted by the above stated partner, for the above stated purpose(s). Signature _______________________________ Date _________________________ Dr. Annick Buchholz, Children’s Hospital of Eastern Ontario, Eating Disorders Program Signature ________________________________ Date _________________________ Dr. Sherry Van Blyderveen, McMaster Children’s Hospital, Pediatric Eating Disorders Program Signature ________________________________ Date _________________________ xxx Signature ________________________________ Date _________________________ xxx

Page 43: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

43

APPENDIX E

____________________________________

Assignment of Research Studies

Page 44: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

44

Research Projects

Project Lead Site Brief Description Publications

Assessment Data

CHEO

Clinical profile by diagnostic category (AN-R, AN-BP, etc.) of youth presenting for an eating disorder assessment at a tertiary care hospital in Ontario.

CHEO Examining parent variables at assessment.

Southlake Satisfaction with assessment services provided.

Southlake Presence of abuse at assessment.

HSK Using assessment data for the purposes of improving the system of diagnostic classification, using latent class analysis.

Follow-up Data

CHEO Trajectory of different diagnostic category (psychological focus).

Southlake

Exploration of how assessment results relate to treatment recommendations and how recommendations map onto services offered and accepted.

HSK Predictors of short term medical outcomes.

HSK Determination of ideal body weight.

Page 45: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

45

APPENDIX F

____________________________________

Excerpt from Data Definition Dictionary

Page 46: A Centralized Clinical Outcome Measurement of Eating Disorders in

Clinical Outcome Measurement of Eating Disorders

46

Page 47: A Centralized Clinical Outcome Measurement of Eating Disorders in