Difference between revisions of "Journal:Codesign of the Population Health Information Management System to measure reach and practice change of childhood obesity programs"
Shawndouglas (talk | contribs) m (→Introduction: Italic fix.) |
Shawndouglas (talk | contribs) (Finished adding rest of content.) |
||
(3 intermediate revisions by the same user not shown) | |||
Line 19: | Line 19: | ||
|download = [http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf] (PDF) | |download = [http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf] (PDF) | ||
}} | }} | ||
==Abstract== | ==Abstract== | ||
'''Introduction''': Childhood obesity prevalence is an issue of international public health concern, and governments have a significant role to play in its reduction. The Healthy Children Initiative (HCI) has been delivered in New South Wales (NSW), Australia, since 2011 to support implementation of childhood obesity prevention programs at scale. Consequently, a system to support local implementation and data collection, analysis, and reporting at local and state levels was necessary. The Population Health Information Management System (PHIMS) was developed to meet this need. | '''Introduction''': Childhood obesity prevalence is an issue of international public health concern, and governments have a significant role to play in its reduction. The Healthy Children Initiative (HCI) has been delivered in New South Wales (NSW), Australia, since 2011 to support implementation of childhood obesity prevention programs at scale. Consequently, a system to support local implementation and data collection, analysis, and reporting at local and state levels was necessary. The Population Health Information Management System (PHIMS) was developed to meet this need. | ||
Line 41: | Line 37: | ||
Two programs—''Munch & Move'' and ''Live Life Well @ School'' (''LLW@S'')—were identified from pilot programs to be delivered at scale across NSW as part of the HCI. ''Munch & Move'' had a potential reach of more than 3,500 center-based early childhood services and more than 190,000 children aged 0–5 years. ''LLW@S'' had a potential reach of more than 2,400 primary schools with more than 675,000 students. | Two programs—''Munch & Move'' and ''Live Life Well @ School'' (''LLW@S'')—were identified from pilot programs to be delivered at scale across NSW as part of the HCI. ''Munch & Move'' had a potential reach of more than 3,500 center-based early childhood services and more than 190,000 children aged 0–5 years. ''LLW@S'' had a potential reach of more than 2,400 primary schools with more than 675,000 students. | ||
Initial implementation of both ''Munch & Move'' and ''LLW@S'' involved training of educators and teachers to embed the promotion of healthy behaviors in their organizational policy and routine practice. To ensure the successful translation into routine practice, educators and teachers were supported by their local LHD through regular visits or phone calls, and they were monitored through a set of program adoption indicators referred to as "practices." These evidence based practices refer to organizational policies and practices related to nutrition, physical activity, and sedentary behavior (see Tables 1 and 2).<ref name="LockeridgeMunch15">{{cite book |title=''Munch & Move'': Evidence and Evaluation Summary |author=Lockeridge, A.; Innes-Hughes, C.; O'Hara, B.J. et al. |publisher=NSW Ministry of Health |year=2015 |pages=26 |isbn=9781760003029 |url=https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf |accessdate=08 February 2018}}</ref><ref name="BravoLive16">{{cite book |title=''Live Life Well @ School'': Evidence and Evaluation Summary 2008-2015 |author=Bravo, A.; Innes-Hughes, C.; O'Hara, B.J. et al. |publisher=NSW Ministry of Health |year=2016 |pages=31 |isbn=99781760004750 |url=https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf |accessdate=08 February 2018}}</ref> | |||
{| | |||
| STYLE="vertical-align:top;"| | |||
{| class="wikitable" border="1" cellpadding="5" cellspacing="0" width="100%" | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" colspan="2"|'''Table 1.''' ''Munch & Move'' practices | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="5"|'''Encouraging healthy eating''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Lunchboxes monitored daily | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Fruit and vegetables at least once per day | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Only healthy snacks on the menu | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Water or age-appropriate drinks every day | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Healthy eating learning experiences at least twice per week | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Daily physical activity''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Tummy time for babies every day | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Physical activity for at least 25% of opening hours (ages 1−5 years) | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Fundamental movement skills every day (ages 3−5 years) | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Appropriate use of small-screen recreation (ages 3–5 years) | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="3"|'''Policies in place''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Written nutrition policy | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Written physical activity policy | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Written policy restricting small-screen recreation | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="3"|'''Professional development and monitoring''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Health information provided to families | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Nutrition and physical activity training for staff | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Annual monitoring and reporting | |||
|- | |||
|} | |||
|} | |||
{| | |||
| STYLE="vertical-align:top;"| | |||
{| class="wikitable" border="1" cellpadding="5" cellspacing="0" width="100%" | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" colspan="2"|'''Table 2.''' ''Live Life Well @ School'' (''LLW@S'') practices | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="2"|'''Curriculum''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Healthy eating and physical activity learning experiences | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Personal development, health and physical education includes fundamental movement skills | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Encouraging healthy eating and physical activity''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Fruit, vegetables and water breaks | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Physical activity during breaks | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Supportive environment for healthy eating | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Communication with families | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;" rowspan="4"|'''Professional development and monitoring''' | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Professional development of staff | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|School team supports ''LLW@S'' | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|School plans incorporate ''LLW@S'' strategies | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|Annual monitoring and reporting | |||
|- | |||
|} | |||
|} | |||
Consistent with World Health Organization recommendations, a comprehensive HCI monitoring framework was developed to guide the review of program implementation in early childhood services and primary schools. This framework included HCI measures in the annual service agreements between the Ministry (the funder) and LHDs (the providers). Achievement against the measure was reviewed quarterly. | |||
Contemporary and effective delivery of population-level health interventions requires innovative technology and fresh approaches to monitoring and reporting. Conte ''et al.''<ref name="ConteDynamics17">{{cite journal |title=Dynamics behind the scale up of evidence-based obesity prevention: protocol for a multi-site case study of an electronic implementation monitoring system in health promotion practice |journal=Implementation Science |author=Conte, K.P.; Groen, S.; Loblay, V. et al. |volume=12 |issue=1 |pages=146 |year=2017 |doi=10.1186/s13012-017-0686-5 |pmid=29208000 |pmc=PMC5718021}}</ref> described the lack of evidence about whether an e-monitoring system improved the implementation of evidence-based preventive programs. However, because performance measures were included in the LHD service agreements, a system was needed to support the implementation of the HCI at the local level, and the collection, recording, analysis, and reporting of this data at both local and state levels. To achieve this, an information technology (IT) system called the Population Health Information Management System (PHIMS) was developed to perform these functions for both LHD and Ministry staff. | |||
==Design and development== | |||
===Governance=== | |||
In July 2011, a project board was formed with representatives from each of the project stakeholder groups across the Ministry and LHDs. The purpose of the board was to facilitate collaboration and guide the development of an overarching performance monitoring framework. A dedicated business analyst was engaged to consult with future users and to develop the business requirements document. | |||
===Development process=== | |||
Codesign was undertaken between the Ministry and LHDs, who contributed to the development of the business requirements and monitored the implementation of the new system. A third-party vendor was contracted to undertake the build, user acceptance testing, and deployment support. | |||
Development involved an iterative process. The system’s dual purposes (local and state-level application) were first clarified, with subsequent identification of related needs and operational priorities to be included in the business requirements document. This was completed in May 2012 and used by the solution architect and system developers to guide the design of the functional architecture. A commercial off-the-shelf solution was adapted to build a "fit-for-purpose" system that met the needs of stakeholders and could be integrated into an existing organizational system. | |||
User acceptance testing, training of LHD staff, and deployment followed, with the system going live in August 2014. Project initiation to deployment took just over three years; the stages of development are depicted in Figure 1. | |||
[[File:Fig1 Green PubHlthRsPract2018 28-3.jpg|900px]] | |||
{{clear}} | |||
{| | |||
| STYLE="vertical-align:top;"| | |||
{| border="0" cellpadding="5" cellspacing="0" width="900px" | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"| <blockquote>'''Figure 1.''' Timeline GANTT chart</blockquote> | |||
|- | |||
|} | |||
|} | |||
===Technical requirements and specifications=== | |||
The business analysis stage of the project identified two key requirements of the system: to support local delivery of HCI programs across NSW by providing contact management and scheduling capabilities for health promotion officers (HPOs); and to support the Ministry performance management framework.<ref name="FarrellApplying14">{{cite journal |title=Applying a performance monitoring framework to increase reach and adoption of children's healthy eating and physical activity programs |journal=Public Health Research & Practice |author=Farrell, L.; Lloyd, B.; Matthews, R. et al. |volume=25 |issue=1 |pages=e2511408 |year=2014 |doi=10.17061/phrp2511408 |pmid=25828447}}</ref> | |||
The system uses a Windows-based application that uses Microsoft Dynamics Customer Relationship Management (CRM), Select Survey (questionnaire component), SSRS (SQL Server Reporting Services) for reporting, and a state-wide login service. | |||
===User acceptance testing=== | |||
User input and feedback was obtained from state-level program managers and through demonstration visits with LHD health promotion services. This ensured user needs were met and questions about the new system were addressed. | |||
===Training and deployment=== | |||
Deployment of PHIMS was supported by representatives from each of the 15 LHDs (referred to as "champions") and 11 staff within the Ministry. The business analyst conducted a two-day training course with the LHD champions and Ministry staff. Then, prior to system deployment, webinar training was conducted for each LHD, consisting of 40 sessions (lasting one to two hours each) with approximately 100 attendees. A set of tip sheets was also developed. | |||
The system was deployed in six stages from August 2014, starting with a pilot in one LHD and subsequent sequential roll-out to the remaining 14 LHDs, completed in September 2014. | |||
Data cleaning and migration took more than 12 months, running in parallel with the build, user acceptance testing, and deployment stages. Identifying and addressing data migration issues was a key factor in the successful deployment of PHIMS. Various interim data systems were in place in LHDs and needed to be integrated during the data migration process. Most issues were noncritical and occurred after data migration or within the first three months after deployment. Most of the system issues (550/566, 97%) had been resolved within 12 months of deployment. | |||
===User interface and reporting=== | |||
The user views a dashboard screen that contains a bulletin board for system announcements, website links, and real-time program adoption graphs for the ''Munch & Move'' and ''LLW@S'' programs. The system is made up of a hierarchy of forms (windows) that present information and enable the user to perform various actions. | |||
PHIMS has the following key features that are used by HPOs to support local implementation of HCI programs: | |||
1. '''Contact management''': supports HPO workflows for managing interactions with sites (i.e., early childhood services and primary schools) and allows the user to record details in the one location. This has improved record keeping and retrieval and is a well-used function of the system with more than 54,000 entries. | |||
2. '''Capacity to record each site’s training''': demonstrates program reach (i.e., sites formally trained in ''Munch & Move'' or ''LLW@S'') | |||
3. '''Scheduled follow-up alerts and recording of program adoption''': alerts an HPO to when a site visit is due at one-, six- and 12-month intervals. During the visit, the HPO collects data on the program practices and enters it into the scheduled follow-up summary form (which links to the questionnaire [Select Survey] component). This data is then used for the performance monitoring reports. Other details from the visits are captured in the contact notes. | |||
4. '''Operational reporting''': allows HPOs to see which sites need additional support. Examples of reports are summaries of training entries, scheduled follow-ups, practice achievement, and program adoption over time. | |||
PHIMS has the capability to support reporting at state level by monitoring program reach (e.g., number of sites trained), practice achievement, and program adoption. | |||
The reports are generated in real time and allow the user to search and display data by specific criteria, for example, NSW, LHD, or local government area, or sites in disadvantaged areas. | |||
==Use of PHIMS== | |||
===System analytics=== | |||
The system currently has 150 users across the 15 LHDs and the Ministry. They represent the workforce in each LHD and all state-level program and performance monitoring staff, and collectively are responsible for the monitoring and reporting of more than 6000 sites. | |||
Educators and teachers have attended more than 24,000 training events (i.e., workshops, conferences, webinars). | |||
There are 70 reports available for day-to-day operational use by LHDs and to monitor performance by the Ministry. | |||
===Monitoring data=== | |||
PHIMS has provided a mechanism for reporting changes in program implementation in targeted children’s settings over time. Box 1 describes the reach and adoption of the ''Munch & Move'' and ''LLW@S'' programs. | |||
{| | |||
| STYLE="vertical-align:top;"| | |||
{| class="wikitable" border="1" cellpadding="5" cellspacing="0" width="70%" | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|'''Box 1.''' Example of how PHIMS data can be used for program monitoring and reporting | |||
|- | |||
| style="background-color:white; padding-left:10px; padding-right:10px;"|From 2008 to June 2015, 89% (3288/3691) of early childhood services across NSW participated in ''Munch & Move'' training. Since state-wide monitoring started in 2012, there has been steady growth in the number of early childhood services that have adopted ''Munch & Move''. Adoption of the program is reported with reference to the number of services achieving 70% (or more) of the practices that are relevant for that particular service. There has been a statistically significant increase in the proportion of early childhood services that have adopted the program. In 2012, the total for NSW was 36% and, by 2015, this increased to 78% (p < 0.001).<ref name="LockeridgeMunch15" /> | |||
From 2008 to June 2015, 84% (2039/2440) of primary schools across NSW participated in ''LLW@S'' training. The proportion of trained primary schools that have achieved the practices has significantly increased from 32% in 2012 to 77% in 2015 (p < 0.001).<ref name="BravoLive16" /> | |||
|- | |||
|} | |||
|} | |||
PHIMS has delivered an innovative IT solution<ref name="IAwards2015NewSouth">{{cite web |url=https://www.iawards.com.au/hidden-pages/2015winners/winners/nsw |title=2015 New South Wales iAwards Winners & Merit Recipients |work=iAwards |publisher=Australian Information Industry Association |date=2015 |accessdate=08 February 2018}}</ref> in a health promotion setting. Engaging in a best-practice "agile"<ref name="AgileMani">{{cite web |url=http://agilemanifesto.org/ |title=Manifesto for Agile Software Development |author=Beck, K.; Beedle, M.; van Bennekum, A. et al. |publisher=Ward Cunningham |date=2001 |accessdate=08 February 2018}}</ref> and collaborative development process was a significant contributor to the effectiveness and high uptake of the system. | |||
===Challenges=== | |||
There were several complexities experienced in developing and implementing PHIMS. For example, LHDs requested confidentiality around operational data. Developing [[Corporate Governance of ICT|data governance]] and reporting protocols in response to the various needs of stakeholders was a key feature. | |||
The decision to modify an off-the-shelf solution offered a value-for-money, sustainable, and flexible final product. The final centralized cost was close to AU$1 million. | |||
Negotiating the local and state health IT environments to support important functionality in differing operating environments and to achieve single sign-on was a major undertaking. | |||
===Benefits=== | |||
PHIMS appears to have multiple benefits. These include the ability to rapidly retrieve data for both operational and monitoring purposes. This has revolutionized the implementation of the HCI programs and is an important factor in the high degree of user acceptance and uptake. This high degree of acceptability contributes to the sustainability of the system. | |||
Importantly, PHIMS has provided an opportunity for health promotion initiatives and staff to have a "seat at the table" with agents of authority (such as LHD chief executives and performance management executives) by providing real-time data on progress against performance measures. PHIMS also provides valuable performance monitoring and feedback to those who directly implement the program. | |||
==Conclusion== | |||
PHIMS was successfully codesigned to be a flexible, scalable, and sustainable IT solution that supports HCI program implementation and provides data for state-level monitoring and reporting against agreed LHD performance measures. PHIMS could potentially be expanded to include other health promotion programs such as food provision in health facilities and tobacco retailer compliance. | |||
==Acknowledgements== | ==Acknowledgements== | ||
Line 63: | Line 236: | ||
<!--Place all category tags here--> | <!--Place all category tags here--> | ||
[[Category:LIMSwiki journal articles (added in | [[Category:LIMSwiki journal articles (added in 2019)]] | ||
[[Category:LIMSwiki journal articles (all)]] | [[Category:LIMSwiki journal articles (all)]] | ||
[[Category:LIMSwiki journal articles on health informatics]] | |||
[[Category:LIMSwiki journal articles on public health informatics]] | [[Category:LIMSwiki journal articles on public health informatics]] | ||
[[Category:LIMSwiki journal articles on software]] |
Latest revision as of 21:59, 7 January 2019
Full article title | Codesign of the Population Health Information Management System to measure reach and practice change of childhood obesity programs |
---|---|
Journal | Public Health Research & Practice |
Author(s) |
Green, Amanda M.; Innes-Hughes, Christine; Rissel, Chris; Mitchell, Jo; Milat, Andrew J.; Williams, Mandy; Persson, Lina; Thackway, Sarah; Lewis, Nicola; Wiggers, John |
Author affiliation(s) |
NSW Ministry of Health, University of Sydney, South Western Sydney Local Health District, Hunter New England Local Health District, University of Newcastle |
Primary contact | Email: Amanda dot Green at health dot nsw dot gov dot au |
Year published | 2018 |
Volume and issue | 28(3) |
Page(s) | e2831822 |
DOI | 10.17061/phrp2831822 |
ISSN | 2204-2091 |
Distribution license | Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International |
Website | http://www.phrp.com.au/issues/september-2018-volume-28-issue-3/ |
Download | http://www.phrp.com.au/wp-content/uploads/2018/09/PHRP2831822.pdf (PDF) |
Abstract
Introduction: Childhood obesity prevalence is an issue of international public health concern, and governments have a significant role to play in its reduction. The Healthy Children Initiative (HCI) has been delivered in New South Wales (NSW), Australia, since 2011 to support implementation of childhood obesity prevention programs at scale. Consequently, a system to support local implementation and data collection, analysis, and reporting at local and state levels was necessary. The Population Health Information Management System (PHIMS) was developed to meet this need.
Design and development: A collaborative and iterative process was applied to the design and development of the system. The process comprised identifying technical requirements, building system infrastructure, delivering training, deploying the system, and implementing quality measures.
Use of PHIMS: Implementation of PHIMS resulted in rapid data retrieval and reporting against agreed performance measures for the HCI. The system has 150 users who account for the monitoring and reporting of more than 6000 HCI intervention sites (early childhood services and primary schools).
Lessons learned: Developing and implementing PHIMS presented a number of complexities including: applying an information technology (IT) development methodology to a traditional health promotion setting; data access and confidentiality issues; and managing system development and deployment to intended timelines and budget. PHIMS was successfully codesigned as a flexible, scalable, and sustainable IT solution that supports state-wide HCI program implementation, monitoring, and reporting.
Introduction
Childhood overweight and obesity is of international public health concern, and governments have a significant role to play in addressing the issue.[1] In New South Wales (NSW), Australia, the prevalence of childhood overweight and obesity remains high, at 21 percent.[2]
From 2011 to 2014, the Australian Government implemented the National Partnership Agreement on Preventive Health, which provided a historic increase in funding to prevent chronic disease. In NSW, this coordinated prevention effort for children was delivered through the Healthy Children Initiative (HCI) by the NSW Ministry of Health (the Ministry). The HCI involves the implementation of primary and secondary obesity prevention programs across the state in settings attended by children, for example, early childhood services and primary schools.[3]
A well-established health promotion workforce existed in NSW that had designed and implemented programs in these settings and had the potential to achieve state-wide population-level reach and outcomes. However, a significant scaling up of delivery and monitoring of these programs was required to effect population-level change. To facilitate this, enhanced funding was provided to all 15 NSW Government Local Health District (LHD) health promotion services to support local implementation of these programs.[4]
Two programs—Munch & Move and Live Life Well @ School (LLW@S)—were identified from pilot programs to be delivered at scale across NSW as part of the HCI. Munch & Move had a potential reach of more than 3,500 center-based early childhood services and more than 190,000 children aged 0–5 years. LLW@S had a potential reach of more than 2,400 primary schools with more than 675,000 students.
Initial implementation of both Munch & Move and LLW@S involved training of educators and teachers to embed the promotion of healthy behaviors in their organizational policy and routine practice. To ensure the successful translation into routine practice, educators and teachers were supported by their local LHD through regular visits or phone calls, and they were monitored through a set of program adoption indicators referred to as "practices." These evidence based practices refer to organizational policies and practices related to nutrition, physical activity, and sedentary behavior (see Tables 1 and 2).[5][6]
|
|
Consistent with World Health Organization recommendations, a comprehensive HCI monitoring framework was developed to guide the review of program implementation in early childhood services and primary schools. This framework included HCI measures in the annual service agreements between the Ministry (the funder) and LHDs (the providers). Achievement against the measure was reviewed quarterly.
Contemporary and effective delivery of population-level health interventions requires innovative technology and fresh approaches to monitoring and reporting. Conte et al.[7] described the lack of evidence about whether an e-monitoring system improved the implementation of evidence-based preventive programs. However, because performance measures were included in the LHD service agreements, a system was needed to support the implementation of the HCI at the local level, and the collection, recording, analysis, and reporting of this data at both local and state levels. To achieve this, an information technology (IT) system called the Population Health Information Management System (PHIMS) was developed to perform these functions for both LHD and Ministry staff.
Design and development
Governance
In July 2011, a project board was formed with representatives from each of the project stakeholder groups across the Ministry and LHDs. The purpose of the board was to facilitate collaboration and guide the development of an overarching performance monitoring framework. A dedicated business analyst was engaged to consult with future users and to develop the business requirements document.
Development process
Codesign was undertaken between the Ministry and LHDs, who contributed to the development of the business requirements and monitored the implementation of the new system. A third-party vendor was contracted to undertake the build, user acceptance testing, and deployment support.
Development involved an iterative process. The system’s dual purposes (local and state-level application) were first clarified, with subsequent identification of related needs and operational priorities to be included in the business requirements document. This was completed in May 2012 and used by the solution architect and system developers to guide the design of the functional architecture. A commercial off-the-shelf solution was adapted to build a "fit-for-purpose" system that met the needs of stakeholders and could be integrated into an existing organizational system.
User acceptance testing, training of LHD staff, and deployment followed, with the system going live in August 2014. Project initiation to deployment took just over three years; the stages of development are depicted in Figure 1.
|
Technical requirements and specifications
The business analysis stage of the project identified two key requirements of the system: to support local delivery of HCI programs across NSW by providing contact management and scheduling capabilities for health promotion officers (HPOs); and to support the Ministry performance management framework.[8]
The system uses a Windows-based application that uses Microsoft Dynamics Customer Relationship Management (CRM), Select Survey (questionnaire component), SSRS (SQL Server Reporting Services) for reporting, and a state-wide login service.
User acceptance testing
User input and feedback was obtained from state-level program managers and through demonstration visits with LHD health promotion services. This ensured user needs were met and questions about the new system were addressed.
Training and deployment
Deployment of PHIMS was supported by representatives from each of the 15 LHDs (referred to as "champions") and 11 staff within the Ministry. The business analyst conducted a two-day training course with the LHD champions and Ministry staff. Then, prior to system deployment, webinar training was conducted for each LHD, consisting of 40 sessions (lasting one to two hours each) with approximately 100 attendees. A set of tip sheets was also developed.
The system was deployed in six stages from August 2014, starting with a pilot in one LHD and subsequent sequential roll-out to the remaining 14 LHDs, completed in September 2014.
Data cleaning and migration took more than 12 months, running in parallel with the build, user acceptance testing, and deployment stages. Identifying and addressing data migration issues was a key factor in the successful deployment of PHIMS. Various interim data systems were in place in LHDs and needed to be integrated during the data migration process. Most issues were noncritical and occurred after data migration or within the first three months after deployment. Most of the system issues (550/566, 97%) had been resolved within 12 months of deployment.
User interface and reporting
The user views a dashboard screen that contains a bulletin board for system announcements, website links, and real-time program adoption graphs for the Munch & Move and LLW@S programs. The system is made up of a hierarchy of forms (windows) that present information and enable the user to perform various actions.
PHIMS has the following key features that are used by HPOs to support local implementation of HCI programs:
1. Contact management: supports HPO workflows for managing interactions with sites (i.e., early childhood services and primary schools) and allows the user to record details in the one location. This has improved record keeping and retrieval and is a well-used function of the system with more than 54,000 entries.
2. Capacity to record each site’s training: demonstrates program reach (i.e., sites formally trained in Munch & Move or LLW@S)
3. Scheduled follow-up alerts and recording of program adoption: alerts an HPO to when a site visit is due at one-, six- and 12-month intervals. During the visit, the HPO collects data on the program practices and enters it into the scheduled follow-up summary form (which links to the questionnaire [Select Survey] component). This data is then used for the performance monitoring reports. Other details from the visits are captured in the contact notes.
4. Operational reporting: allows HPOs to see which sites need additional support. Examples of reports are summaries of training entries, scheduled follow-ups, practice achievement, and program adoption over time.
PHIMS has the capability to support reporting at state level by monitoring program reach (e.g., number of sites trained), practice achievement, and program adoption.
The reports are generated in real time and allow the user to search and display data by specific criteria, for example, NSW, LHD, or local government area, or sites in disadvantaged areas.
Use of PHIMS
System analytics
The system currently has 150 users across the 15 LHDs and the Ministry. They represent the workforce in each LHD and all state-level program and performance monitoring staff, and collectively are responsible for the monitoring and reporting of more than 6000 sites.
Educators and teachers have attended more than 24,000 training events (i.e., workshops, conferences, webinars).
There are 70 reports available for day-to-day operational use by LHDs and to monitor performance by the Ministry.
Monitoring data
PHIMS has provided a mechanism for reporting changes in program implementation in targeted children’s settings over time. Box 1 describes the reach and adoption of the Munch & Move and LLW@S programs.
|
PHIMS has delivered an innovative IT solution[9] in a health promotion setting. Engaging in a best-practice "agile"[10] and collaborative development process was a significant contributor to the effectiveness and high uptake of the system.
Challenges
There were several complexities experienced in developing and implementing PHIMS. For example, LHDs requested confidentiality around operational data. Developing data governance and reporting protocols in response to the various needs of stakeholders was a key feature.
The decision to modify an off-the-shelf solution offered a value-for-money, sustainable, and flexible final product. The final centralized cost was close to AU$1 million.
Negotiating the local and state health IT environments to support important functionality in differing operating environments and to achieve single sign-on was a major undertaking.
Benefits
PHIMS appears to have multiple benefits. These include the ability to rapidly retrieve data for both operational and monitoring purposes. This has revolutionized the implementation of the HCI programs and is an important factor in the high degree of user acceptance and uptake. This high degree of acceptability contributes to the sustainability of the system.
Importantly, PHIMS has provided an opportunity for health promotion initiatives and staff to have a "seat at the table" with agents of authority (such as LHD chief executives and performance management executives) by providing real-time data on progress against performance measures. PHIMS also provides valuable performance monitoring and feedback to those who directly implement the program.
Conclusion
PHIMS was successfully codesigned to be a flexible, scalable, and sustainable IT solution that supports HCI program implementation and provides data for state-level monitoring and reporting against agreed LHD performance measures. PHIMS could potentially be expanded to include other health promotion programs such as food provision in health facilities and tobacco retailer compliance.
Acknowledgements
We acknowledge the contributions of Liz King, Neil Orr, Louise Farrell, Bev Lloyd, Andy Bravo, Masela Draper, Deni Fukunishi, Andy Lui, Rita Lagaluga, Evan Freeman, Elena Ouspenskaia, Claudine Lyons, Kym Buffett, Rhonda Matthews, Project Advisory Board Members, Steering Committee Members, Transition Group and Reference Group Members and the Directors and staff of Local Health District Health Promotion Services across NSW.
This paper was developed as part of a program of research on monitoring health promotion practice within The Australian Prevention Partnership Centre. It was funded through the National Health and Medical Research Council Partnership Centre Grants Scheme (ID GNT 9100001) with the Australian Government Department of Health, the NSW Ministry of Health, ACT Health and the HCF Research Foundation.
Author contributions
AG and CI-H drafted the manuscript. CR, JM, AM, MW, LP, ST, NL and JW reviewed and contributed to editing the manuscript. All authors read, revised and approved the final manuscript. All authors contributed to the development and/or implementation of PHIMS.
Competing interests
None declared.
Peer review and provenance
Externally peer reviewed, commissioned.
References
- ↑ Commission on Ending Childhood Obesity (2016). Report on the Commission on Ending Childhood Obesity. World Health Organization. pp. 50. ISBN 9789241510066. http://apps.who.int/iris/bitstream/handle/10665/204176/9789241510066_eng.pdf;jsessionid=4EA7FECA778E7E3B8C7BA4420E1B2412?sequence=1. Retrieved 07 February 2018.
- ↑ "Overweight and obesity in children aged 5–16 years, NSW 2007 to 2017". HealthStats NSW. NSW Government. 8 May 2018. http://www.healthstats.nsw.gov.au/Indicator/beh_bmikid_cat. Retrieved 10 July 2018.
- ↑ Innes-Hughes, C.; Bravo, A. Buffett, K. et al. (2017). NSW Healthy Children Initiative: The first five years July 2011 – June 2016. NSW Ministry of Health. pp. 43. ISBN 9781760007263. https://www.health.nsw.gov.au/heal/Publications/HCI-report.pdf. Retrieved 08 February 2018.
- ↑ "Implementation Plan for The Health Children Initiative" (PDF). Commonwealth of Australia. December 2012. http://www.federalfinancialrelations.gov.au/content/npa/health/_archive/healthy_workers/healthy_children/NSW_IP_2013.pdf. Retrieved 08 February 2018.
- ↑ 5.0 5.1 Lockeridge, A.; Innes-Hughes, C.; O'Hara, B.J. et al. (2015). Munch & Move: Evidence and Evaluation Summary. NSW Ministry of Health. pp. 26. ISBN 9781760003029. https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf. Retrieved 08 February 2018.
- ↑ 6.0 6.1 Bravo, A.; Innes-Hughes, C.; O'Hara, B.J. et al. (2016). Live Life Well @ School: Evidence and Evaluation Summary 2008-2015. NSW Ministry of Health. pp. 31. ISBN 99781760004750. https://www.health.nsw.gov.au/heal/Publications/Munch-Move-Evaluation-Summary.pdf. Retrieved 08 February 2018.
- ↑ Conte, K.P.; Groen, S.; Loblay, V. et al. (2017). "Dynamics behind the scale up of evidence-based obesity prevention: protocol for a multi-site case study of an electronic implementation monitoring system in health promotion practice". Implementation Science 12 (1): 146. doi:10.1186/s13012-017-0686-5. PMC PMC5718021. PMID 29208000. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5718021.
- ↑ Farrell, L.; Lloyd, B.; Matthews, R. et al. (2014). "Applying a performance monitoring framework to increase reach and adoption of children's healthy eating and physical activity programs". Public Health Research & Practice 25 (1): e2511408. doi:10.17061/phrp2511408. PMID 25828447.
- ↑ "2015 New South Wales iAwards Winners & Merit Recipients". iAwards. Australian Information Industry Association. 2015. https://www.iawards.com.au/hidden-pages/2015winners/winners/nsw. Retrieved 08 February 2018.
- ↑ Beck, K.; Beedle, M.; van Bennekum, A. et al. (2001). "Manifesto for Agile Software Development". Ward Cunningham. http://agilemanifesto.org/. Retrieved 08 February 2018.
Notes
This presentation is faithful to the original, with only a few minor changes to presentation, spelling, and grammar. We also added PMCID and DOI when they were missing from the original reference.