Data leadership

The Social Investment Agency enables the safe and respectful use and sharing of people’s data and information across the social system. We engage with the social sector, supporting data capability improvement. We provide data solutions and integration architecture and we create innovative data services that improve social service provision. Ultimately, we want to empower social service providers and government agencies to understand, decide on and do more of what really works, for better lives.

Government agencies can use these templates and guides to support social service organisations that want to share service data with Stats NZ’s Integrated Data Infrastructure (IDI).

Sharing data helps organisations and government agencies understand what is working, who it is working for, and where investment can make the biggest difference to long-term outcomes. It enables better decisions about how to improve services so that people, whānau and communities can achieve their full potential.

This guidance supports agencies to work with organisations through the process of sharing data and receiving insights, while ensuring strong safeguards are in place to protect privacy and confidentiality.

Introduction to the Integrated Data Infrastructure (IDI)

This slide deck introduces the IDI and explains how sharing data can help build a clearer picture of outcomes and impact over time. The presentation explains:

• what the IDI is and how it works
• how linked data provides deeper insight into outcomes
• how these insights can inform service improvement and investment decisions.

IDI Provider Presentation [PDF, 1 MB]

IDI Provider Presentation [PPTX, 3.4 MB]

Sharing data with Stats NZ

Data Protection and Use Policy

The Data Protection and Use Policy(external link) (DPUP) describes what ‘doing the right thing’ looks like when collecting or using people’s data and information. We recommend referring to the DPUP Guidelines and Principles(external link) to inform your approach to collecting and using people’s information

Example Privacy Statement

This is an example of an IDI-specific privacy statement that can be amended and added to a social sector organisation’s existing privacy statement to ensure participants are informed that their data is collected and the purpose of collection.

Example Privacy Statement [DOCX, 122 KB]

Example Privacy Statement [PDF, 176 KB]

Supporting organisations to share data with Stats NZ

This visual guide outlines the steps government agencies can follow to support organisations to safely share data with Stats NZ, from early conversations through to receiving insights back from the IDI.

Data Sharing Process [PPTX, 730 KB]

Data Sharing Process [PDF, 289 KB]

Data Sharing Primer

This guide covers the process for sharing data with Stats NZ for use in the IDI. It explains:

• the key steps in the data sharing process
• important roles and responsibilities
• the way data is prepared and transferred securely.

Data Sharing Primer [PDF, 411 KB]

Data Sharing Primer [DOCX, 293 KB]

Standard data formatting and metadata

Social Investment Data Sharing Standard

Outlines the standard format for the data that may need to be provided to Stats NZ. A standard format helps ensure:

• consistency across datasets
• efficient processing and integration
• better quality insights.

Data Sharing Standard [XLSX, 26 KB]

Data Specification template

Captures the metadata Stats NZ needs to complete the Data Sharing Agreement. Accurate metadata helps ensure:

• data is clearly defined and understood
• information can be accurately interpreted and used.

Data Specification Template [XLSX, 465 KB]

Agreements and authorisation

Stats NZ Data Sharing Agreement (DSA) template

This is the agreement Stats NZ uses with all data suppliers, including government agencies and non-government organisations. A DSA provides:

• clear expectations for all parties
• assurance that data will be handled appropriately.

DSA Template [PDF, 197 KB]

DSA Template [DOCX, 93 KB]

IDI confidentiality authorisation template

This template allows results for an individual social service organisation to be identified and shared back with that organisation and its government funder. This authorisation:

• enables organisations to see insights about the impact of their services
• does not allow access by any other organisation

Without this authorisation, IDI confidentiality rules prevent organisation-level results from being reported.

Confidentiality Authorisation Example [DOCX, 52 KB]

Guided by safe use and sharing policy and protocols, data systems enable respectful use and secure access to data and information for data sharing, analysis and decision-making. Data systems support the improvement of social sector data capability, by providing tools and guidance about the safe, secure and respectful use of people’s data and information.

Data systems can support data linking and exchange between multiple service provider systems in near real time. They can allow users to enter and link dynamic or changing data. They can support service providers’ safe access to the data and information they need to make better service decisions and improve wellbeing outcomes.

The Data Protection and Use Policy (DPUP)(external link)

DPUP is about respectful, trusted and transparent use of people's data and information.

Doing the right thing with people’s information

DPUP provides good practice advice for agencies about ‘doing the right thing’ when collecting and using people’s personal data and information. It recognises the value of working with people as equal partners and helping a wider range of organisations to access, understand and apply insights for the benefit of their communities.

Developing DPUP

DPUP was initially developed by the social sector for the social sector to provide a shared set of rules for the respectful, trusted and transparent use of personal information.

In order to understand what agencies needed to do to establish and maintain respectful use of people's information, as well as to foster trust and confidence between individuals and agencies, we engaged extensively with the social sector in 2018.

We drew upon an extensive body of existing work, including reports from the Privacy Commissioner. Over 1,000 people, social service providers and government agencies provided input to developing DPUP.

DPUP’s engagement and design processes were developed to ensure the final Policy incorporated the voices of many people and agencies involved in the social sector.

Read about the engagement process and the insights provided by the sector: What you told us. Read the full report [PDF 802 KB] (external link) Read the report quick guide [PDF 416 KB](external link).

Cabinet endorsed DPUP in November 2019. In early 2020 a foundation group of five government agencies and NGOs started to use DPUP. This group supported the development of practical tools and experience to help others progressively adopt DPUP.

DPUP applies to all agencies as it provides clear guidance about what’s reasonable, and what’s not, when collecting or using people’s personal information.

In July 2021, DPUP was transferred to the Government Chief Privacy Officer as endorsed good practice advice associated with the government’s overall approach to privacy maturity, as implemented within the Privacy Maturity Assessment Framework.

Data Sharing Standard

We developed the Social Sector Data Sharing Standard to standardise data transfer between government agencies and non-government organisations (NGOs).

A draft of the Data Sharing Standard was piloted during 2021 by The Loft, a co-location of NGOs based in Christchurch, in conjunction with implementing the Integrated Services Hub. Integrating the Data Sharing Standard allowed The Loft to automate referrals to a service provider and determine both acceptance or rejection of referrals and case outcomes.