View source for Journal:Codesign of the Population Health Information Management System to measure reach and practice change of childhood obesity programs

{{Infobox journal article
|name         = 
|image        = 
|alt          = <!-- Alternative text for images -->
|caption      = 
|title_full   = Codesign of the Population Health Information Management System to measure reach and practice change of childhood obesity programs
|journal      = ''Public Health Research & Practice''
|authors      = Green, Amanda M.; Innes-Hughes, Christine; Rissel, Chris; Mitchell, Jo; Milat, Andrew J.;<br />Williams, Mandy; Persson, Lina; Thackway, Sarah; Lewis, Nicola; Wiggers, John
|affiliations = NSW Ministry of Health, University of Sydney, South Western Sydney Local Health District,<br />Hunter New England Local Health District, University of Newcastle
|contact      = Email: Amanda dot Green at health dot nsw dot gov dot au
|editors      = 
|pub_year     = 2018
|vol_iss      = '''28'''(3)
|pages        = e2831822
|doi          = [http://10.17061/phrp2831822 10.17061/phrp2831822]
|issn         = 2204-2091
|license      = [http://creativecommons.org/licenses/by-nc-sa/4.0/ Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International]
|website      = [http://www.phrp.com.au/issues/september-2018-volume-28-issue-3/codesign-of-the-population-health-information-management-system-to-measure-reach-and-practice-change-of-childhood-obesity-programs/ http://www.phrp.com.au/issues/september-2018-volume-28-issue-3/]
|download     = [http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf] (PDF)
}}
{{ombox	
| type      = content	
| style    = width: 500px;	
| text      = This article should not be considered complete until this message box has been removed. This is a work in progress.	
}}
==Abstract==
'''Introduction''': Childhood obesity prevalence is an issue of international public health concern, and governments have a significant role to play in its reduction. The Healthy Children Initiative (HCI) has been delivered in New South Wales (NSW), Australia, since 2011 to support implementation of childhood obesity prevention programs at scale. Consequently, a system to support local implementation and data collection, analysis, and reporting at local and state levels was necessary. The Population Health Information Management System (PHIMS) was developed to meet this need.

'''Design and development''': A collaborative and iterative process was applied to the design and development of the system. The process comprised identifying technical requirements, building system infrastructure, delivering training, deploying the system, and implementing quality measures.

'''Use of PHIMS''': Implementation of PHIMS resulted in rapid data retrieval and reporting against agreed performance measures for the HCI. The system has 150 users who account for the monitoring and reporting of more than 6000 HCI intervention sites (early childhood services and primary schools).

'''Lessons learned''': Developing and implementing PHIMS presented a number of complexities including: applying an information technology (IT) development methodology to a traditional health promotion setting; [[Information security management|data access and confidentiality issues]]; and managing [[Systems development life cycle|system development and deployment]] to intended timelines and budget. PHIMS was successfully codesigned as a flexible, scalable, and sustainable IT solution that supports state-wide HCI program implementation, monitoring, and reporting.

==Introduction==
Childhood overweight and obesity is of international public health concern, and governments have a significant role to play in addressing the issue.<ref name="WHOReport16">{{cite book |title=Report on the Commission on Ending Childhood Obesity |author=Commission on Ending Childhood Obesity |publisher=World Health Organization |year=2016 |pages=50 |isbn=9789241510066 |url=http://apps.who.int/iris/bitstream/handle/10665/204176/9789241510066_eng.pdf;jsessionid=4EA7FECA778E7E3B8C7BA4420E1B2412?sequence=1 |accessdate=07 February 2018}}</ref> In New South Wales (NSW), Australia, the prevalence of childhood overweight and obesity remains high, at 21 percent.<ref name="NSWOver18">{{cite web |url=http://www.healthstats.nsw.gov.au/Indicator/beh_bmikid_cat |title=Overweight and obesity in children aged 5–16 years, NSW 2007 to 2017 |work=HealthStats NSW |publisher=NSW Government |date=08 May 2018 |accessdate=10 July 2018}}</ref>

From 2011 to 2014, the Australian Government implemented the National Partnership Agreement on Preventive Health, which provided a historic increase in funding to prevent chronic disease. In NSW, this coordinated prevention effort for children was delivered through the Healthy Children Initiative (HCI) by the NSW Ministry of Health (the Ministry). The HCI involves the implementation of primary and secondary obesity prevention programs across the state in settings attended by children, for example, early childhood services and primary schools.<ref name="Innes-HughesNSWHealthy17">{{cite book |title=NSW Healthy Children Initiative: The first five years July 2011 – June 2016 |author=Innes-Hughes, C.; Bravo, A. Buffett, K. et al. |publisher=NSW Ministry of Health |year=2017 |pages=43 |isbn=9781760007263 |url=https://www.health.nsw.gov.au/heal/Publications/HCI-report.pdf |accessdate=08 February 2018}}</ref>

A well-established health promotion workforce existed in NSW that had designed and implemented programs in these settings and had the potential to achieve state-wide population-level reach and outcomes. However, a significant scaling up of delivery and monitoring of these programs was required to effect population-level change. To facilitate this, enhanced funding was provided to all 15 NSW Government Local Health District (LHD) health promotion services to support local implementation of these programs.<ref name="AGImplement12">{{cite web |url=http://www.federalfinancialrelations.gov.au/content/npa/health/_archive/healthy_workers/healthy_children/NSW_IP_2013.pdf |format=PDF |title=Implementation Plan for The Health Children Initiative |publisher=Commonwealth of Australia |date=December 2012 |accessdate=08 February 2018}}</ref>

Two programs—''Munch & Move'' and ''Live Life Well @ School'' (''LLW@S'')—were identified from pilot programs to be delivered at scale across NSW as part of the HCI. ''Munch & Move'' had a potential reach of more than 3,500 center-based early childhood services and more than 190,000 children aged 0–5 years. ''LLW@S'' had a potential reach of more than 2,400 primary schools with more than 675,000 students.

Initial implementation of both ''Munch & Move'' and ''LLW@S'' involved training of educators and teachers to embed the promotion of healthy behaviors in their organizational policy and routine practice. To ensure the successful translation into routine practice, educators and teachers were supported by their local LHD through regular visits or phone calls, and they were monitored through a set of program adoption indicators referred to as "practices." These evidence based practices refer to organizational policies and practices related to nutrition, physical activity, and sedentary behavior (see Tables 1 and 2).<ref name="LockeridgeMunch15">{{cite book |title=''Munch & Move'': Evidence and Evaluation Summary |author=Lockeridge, A.; Innes-Hughes, C.; O'Hara, B.J. et al. |publisher=NSW Ministry of Health |year=2015 |pages=26 |isbn=9781760003029 |url=https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf |accessdate=08 February 2018}}</ref><ref name="BravoLive16">{{cite book |title=''Live Life Well @ School'': Evidence and Evaluation Summary 2008-2015 |author=Bravo, A.; Innes-Hughes, C.; O'Hara, B.J. et al. |publisher=NSW Ministry of Health |year=2016 |pages=31 |isbn=99781760004750 |url=https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf |accessdate=08 February 2018}}</ref>

{| 
 | STYLE="vertical-align:top;"|
{| class="wikitable" border="1" cellpadding="5" cellspacing="0" width="100%"
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;" colspan="2"|'''Table 1.''' ''Munch & Move'' practices
 |- 
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="5"|'''Encouraging healthy eating'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Lunchboxes monitored daily
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Fruit and vegetables at least once per day
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Only healthy snacks on the menu
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Water or age-appropriate drinks every day
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Healthy eating learning experiences at least twice per week
 |- 
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Daily physical activity'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Tummy time for babies every day
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Physical activity for at least 25% of opening hours (ages 1−5 years)
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Fundamental movement skills every day (ages 3−5 years)
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Appropriate use of small-screen recreation (ages 3–5 years)
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="3"|'''Policies in place'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Written nutrition policy
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Written physical activity policy
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Written policy restricting small-screen recreation
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="3"|'''Professional development and monitoring'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Health information provided to families
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Nutrition and physical activity training for staff
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Annual monitoring and reporting
 |-
|}
|}

{| 
 | STYLE="vertical-align:top;"|
{| class="wikitable" border="1" cellpadding="5" cellspacing="0" width="100%"
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;" colspan="2"|'''Table 2.''' ''Live Life Well @ School'' (''LLW@S'') practices
 |- 
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="2"|'''Curriculum'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Healthy eating and physical activity learning experiences
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Personal development, health and physical education includes fundamental movement skills
 |- 
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Encouraging healthy eating and physical activity'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Fruit, vegetables and water breaks
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Physical activity during breaks
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Supportive environment for healthy eating
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Communication with families
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Professional development and monitoring'''
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Professional development of staff
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|School team supports ''LLW@S''
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|School plans incorporate ''LLW@S'' strategies
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"|Annual monitoring and reporting
 |-
|}
|}

Consistent with World Health Organization recommendations, a comprehensive HCI monitoring framework was developed to guide the review of program implementation in early childhood services and primary schools. This framework included HCI measures in the annual service agreements between the Ministry (the funder) and LHDs (the providers). Achievement against the measure was reviewed quarterly.

Contemporary and effective delivery of population-level health interventions requires innovative technology and fresh approaches to monitoring and reporting. Conte ''et al.''<ref name="ConteDynamics17">{{cite journal |title=Dynamics behind the scale up of evidence-based obesity prevention: protocol for a multi-site case study of an electronic implementation monitoring system in health promotion practice |journal=Implementation Science |author=Conte, K.P.; Groen, S.; Loblay, V. et al. |volume=12 |issue=1 |pages=146 |year=2017 |doi=10.1186/s13012-017-0686-5 |pmid=29208000 |pmc=PMC5718021}}</ref> described the lack of evidence about whether an e-monitoring system improved the implementation of evidence-based preventive programs. However, because performance measures were included in the LHD service agreements, a system was needed to support the implementation of the HCI at the local level, and the collection, recording, analysis, and reporting of this data at both local and state levels. To achieve this, an information technology (IT) system called the Population Health Information Management System (PHIMS) was developed to perform these functions for both LHD and Ministry staff.

==Design and development==
===Governance===
In July 2011, a project board was formed with representatives from each of the project stakeholder groups across the Ministry and LHDs. The purpose of the board was to facilitate collaboration and guide the development of an overarching performance monitoring framework. A dedicated business analyst was engaged to consult with future users and to develop the business requirements document.

===Development process===
Codesign was undertaken between the Ministry and LHDs, who contributed to the development of the business requirements and monitored the implementation of the new system. A third-party vendor was contracted to undertake the build, user acceptance testing, and deployment support.

Development involved an iterative process. The system’s dual purposes (local and state-level application) were first clarified, with subsequent identification of related needs and operational priorities to be included in the business requirements document. This was completed in May 2012 and used by the solution architect and system developers to guide the design of the functional architecture. A commercial off-the-shelf solution was adapted to build a "fit-for-purpose" system that met the needs of stakeholders and could be integrated into an existing organizational system.

User acceptance testing, training of LHD staff, and deployment followed, with the system going live in August 2014. Project initiation to deployment took just over three years; the stages of development are depicted in Figure 1.


[[File:Fig1 Green PubHlthRsPract2018 28-3.jpg|900px]]
{{clear}}
{| 
 | STYLE="vertical-align:top;"|
{| border="0" cellpadding="5" cellspacing="0" width="900px"
 |-
  | style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Figure 1.''' Timeline GANTT chart</blockquote>
 |- 
|}
|}

===Technical requirements and specifications===
The business analysis stage of the project identified two key requirements of the system: to support local delivery of HCI programs across NSW by providing contact management and scheduling capabilities for health promotion officers (HPOs); and to support the Ministry performance management framework.8

The system uses a Windows-based application that uses Microsoft Dynamics Customer Relationship Management (CRM), Select Survey (questionnaire component), SSRS (SQL Server Reporting Services) for reporting, and a state-wide login service.

===User acceptance testing===
User input and feedback was obtained from state-level program managers and through demonstration visits with LHD health promotion services. This ensured user needs were met and questions about the new system were addressed.

===Training and deployment===
Deployment of PHIMS was supported by representatives from each of the 15 LHDs (referred to as "champions") and 11 staff within the Ministry. The business analyst conducted a two-day training course with the LHD champions and Ministry staff. Then, prior to system deployment, webinar training was conducted for each LHD, consisting of 40 sessions (lasting one to two hours each) with approximately 100 attendees. A set of tip sheets was also developed.

The system was deployed in six stages from August 2014, starting with a pilot in one LHD and subsequent sequential roll-out to the remaining 14 LHDs, completed in September 2014.

Data cleaning and migration took more than 12 months, running in parallel with the build, user acceptance testing, and deployment stages. Identifying and addressing data migration issues was a key factor in the successful deployment of PHIMS. Various interim data systems were in place in LHDs and needed to be integrated during the data migration process. Most issues were noncritical and occurred after data migration or within the first three months after deployment. Most of the system issues (550/566, 97%) had been resolved within 12 months of deployment.

===User interface and reporting===
The user views a dashboard screen that contains a bulletin board for system announcements, website links, and real-time program adoption graphs for the ''Munch & Move'' and ''LLW@S'' programs. The system is made up of a hierarchy of forms (windows) that present information and enable the user to perform various actions.

PHIMS has the following key features that are used by HPOs to support local implementation of HCI programs:

1. '''Contact management''': supports HPO workflows for managing interactions with sites (i.e., early childhood services and primary schools) and allows the user to record details in the one location. This has improved record keeping and retrieval and is a well-used function of the system with more than 54,000 entries.

2. '''Capacity to record each site’s training''': demonstrates program reach (i.e., sites formally trained in ''Munch & Move'' or ''LLW@S'')

3. '''Scheduled follow-up alerts and recording of program adoption''': alerts an HPO to when a site visit is due at one-, six- and 12-month intervals. During the visit, the HPO collects data on the program practices and enters it into the scheduled follow-up summary form (which links to the questionnaire [Select Survey] component). This data is then used for the performance monitoring reports. Other details from the visits are captured in the contact notes.

4. '''Operational reporting''': allows HPOs to see which sites need additional support. Examples of reports are summaries of training entries, scheduled follow-ups, practice achievement, and program adoption over time.

PHIMS has the capability to support reporting at state level by monitoring program reach (e.g., number of sites trained), practice achievement, and program adoption.

The reports are generated in real time and allow the user to search and display data by specific criteria, for example, NSW, LHD, or local government area, or sites in disadvantaged areas.

==Use of PHIMS==





==Acknowledgements==
We acknowledge the contributions of Liz King, Neil Orr, Louise Farrell, Bev Lloyd, Andy Bravo, Masela Draper, Deni Fukunishi, Andy Lui, Rita Lagaluga, Evan Freeman, Elena Ouspenskaia, Claudine Lyons, Kym Buffett, Rhonda Matthews, Project Advisory Board Members, Steering Committee Members, Transition Group and Reference Group Members and the Directors and staff of Local Health District Health Promotion Services across NSW.

This paper was developed as part of a program of research on monitoring health promotion practice within The Australian Prevention Partnership Centre. It was funded through the National Health and Medical Research Council Partnership Centre Grants Scheme (ID GNT 9100001) with the Australian Government Department of Health, the NSW Ministry of Health, ACT Health and the HCF Research Foundation.

===Author contributions===
AG and CI-H drafted the manuscript. CR, JM, AM, MW, LP, ST, NL and JW reviewed and contributed to editing the manuscript. All authors read, revised and approved the final manuscript. All authors contributed to the development and/or implementation of PHIMS.

===Competing interests===
None declared.

===Peer review and provenance===
Externally peer reviewed, commissioned.

==References==
{{Reflist|colwidth=30em}}

==Notes==
This presentation is faithful to the original, with only a few minor changes to presentation, spelling, and grammar. We also added PMCID and DOI when they were missing from the original reference.

<!--Place all category tags here-->
[[Category:LIMSwiki journal articles (added in 2018)‎]]
[[Category:LIMSwiki journal articles (all)‎]]
[[Category:LIMSwiki journal articles on public health informatics]]