December 2020
The Social Wellbeing Agency has developed the Dataset Assembly Tool to standardise and automate dataset assembly. Data preparation for analytic and research projects increases in complexity as the number of data sources increases. Without a consistent method, it can become time-consuming, expensive, and error prone. The tool helps staff deliver higher quality work faster and is now available for other researchers to use.
These documents introduce the tool and cover everything a researcher needs to begin using it. The primer gives an overview of the tool, describes some effective patterns and workflow when using it, and concludes with a worked example. The training presentation covers how to setup the tool, how to prepare and assemble data with the tool, and extensive notes on what to do if something goes wrong.
April 2020
Good household information in linked administrative data is highly desirable because of the significant links between individuals’ experiences and the experiences of other people in their household. We attempted to improve the quality of address information in the IDI by applying a series of detailed cleaning rules to remove patterns of incorrect or untrusted information.
November 2019
Representative timelines bring together different aspects of people’s experiences into one consistent view — enabling us to see life events, and interactions between events, over time. They can help determine what questions might help us arrive at a better understanding of people’s life experiences, and their interactions with social services.
This document provides guidance on the construction of representative timelines. Examples drawn from the first application of this work — a study of South Auckland families’ experiences around the birth of a child — illustrate the technique in practice.
August 2019
To support analysis of mental health and addiction in New Zealand, we’ve developed a tool that consolidates five key data sources in the Integrated Data Infrastructure (IDI) into a single table of events. The consolidated table applies consistent metrics so researchers can more readily analyse data about mental health and addiction conditions. This technical guide discusses data sources, the consolidated table and what sorts of research questions the new table can help answer. The guide complements the code required to generate the consolidated table, available at SWA’s GitHub page(external link).
December 2017
This introduction outlines the methodologies we use to turn data into insight in plain english. It explains what data analysts will need to perform social investment analysis, and where to find it.
December 2017
Getting started with the IDI is a steep learning curve; we've written this beginner's guide for anyone undertaking their first social investment analysis using this resource. It draws from our experience and covers the things we wish we'd known at the start.
December 2017
The Social Investment Analytical Layer code creates events-structured tables in a consistent format, making it easier and faster to use the Integrated Data Infrastructure (IDI). This brief user guide contains the introductory information you will need to get started.
December 2017
The Social Investment Data Foundation code produces analysis-ready datasets within the Integrated Data Infrastructure (IDI), reducing the time to generate datasets and speeding up analysis. This brief user guide contains the introductory information you will need to get started.
December 2017
It’s not just about what we do, it’s about how we do it. This guide outlines workflow practices our analysts have adopted to generate maximum insight in the most efficient way.
June 2017
Outlines a process for gathering the relevant evidence to support social investment. It explains how to summarise the best evidence and write it up in a way that will help inform decision-makers.
