Is the change in results significant?

Is the change in results significant?

Is there a significant change- using critical difference

Most schools will see some change in the proportion of children who are developmentally vulnerable, at risk or on track reported in 2015 compared to previous years. In some cases this will be small and in others it will be more substantial.

The critical difference calculation takes into account the number of children included in the AEDC data collections and variation between teachers in the way they assess children.

The tables below provide information on whether the change in the proportion of children who are developmentally on track, at risk and vulnerable is significant.

Your school may have a different number of children with valid scores, on each of the AEDC domains and summary indicators from one collection to another. If this is so, to calculate the critical difference from the tables below, use the lowest number of children from the two collections you are comparing.

For example, if you would like to know the critical difference of developmental vulnerability in the social competence domain in the school of Someplace:

  • the school of Someplace had 56 children with a valid score in the social competence domain in 2012 and 81 children in 2015;
  • find the row in the developmentally vulnerable on the social competence domain for a school with 56 children (not 81 children);
  • look at the critical difference in that row (the 40-59 children row);

Table ​​1 shows that Someplace would need to see a change of at least 6.2 percentage points to represent a significant change from 2012 and 2015 in the percentage developmentally vulnerable in the social competence domain. 

For more information on the calculation of the critical difference, see the AEDC technical report Calculation of the Critical Difference.

Table 1. Developmentally ​Vulnerable critical difference points for all five AEDC domains and the Summary Indicators

Critical difference - VULNERABLE

SUMMARY INDICATORS

Number of children

Physical Health and Wellbeing

Social Competence

Emotional Maturity

Language and Cognitive skills

Communication and General Knowledge

Vulnerable on 1 or more domains

Vulnerable on 2 or more domains

6-9

23.2

15.5

19.1

17.2

20.8

27.6

19.6

10-14

18.1

12.1

14.7

13.4

16.1

21.4

15.2

15-19

14.8

9.9

11.9

10.9

13.2

17.4

12.5

20-24

12.8

8.6

10.3

9.5

11.4

15.1

10.8

25-29

11.5

7.7

9.2

8.5

10.2

13.5

9.7

30-39

10.5

7.1

8.3

7.7

9.3

12.3

8.8

40-59

9.1

6.2

7.2

6.7

8.1

10.7

7.7

60-79

7.5

5.1

5.8

5.5

6.6

8.7

6.3

80-99

6.5

4.4

5.0

4.7

5.7

7.5

5.4

100-199

5.8

3.9

4.5

4.3

5.1

6.7

4.9

200-299

4.1

2.8

3.1

3.0

3.6

4.7

3.5

300-699

3.4

2.3

2.5

2.5

2.9

3.9

2.8

700-1499

2.2

1.5

1.6

1.6

1.9

2.5

1.9

1500+

1.5

1.1

1.1

1.1

1.3

1.7

1.3

  
Table 2. Developmentally At Risk critical difference points for all five AEDC domains

Critical difference - AT RISK

Number of children

Physical Health and Wellbeing

Social Competence

Emotional Maturity

Language and Cognitive skills

Communication and General Knowledge

6-9

28.6

25.9

28.3

27.8

29.9

10-14

22.2

20.1

21.9

21.5

23.2

15-19

18.2

16.5

17.9

17.6

19.0

20-24

15.8

14.3

15.5

15.2

16.4

25-29

14.1

12.8

13.8

13.6

14.7

30-39

12.9

11.7

12.6

12.5

13.4

40-59

11.2

10.2

10.9

10.8

11.6

60-79

9.2

8.3

8.9

8.8

9.5

80-99

7.9

7.2

7.7

7.6

8.2

100-199

7.1

6.5

6.9

6.8

7.4

200-299

5.0

4.6

4.9

4.8

5.2

300-699

4.1

3.8

4.0

4.0

4.3

700-1499

2.7

2.5

2.6

2.6

2.8

1500+

1.9

1.7

1.8

1.8

1.9

 
Table 3. Developmentally On Track critical difference points for all five AEDC domains

Critical difference - ON TRACK

Number of children

Physical Health and Wellbeing

Social Competence

Emotional Maturity

Language and Cognitive skills

Communication and General Knowledge

6-9

27.2

20.2

21.1

21.7

24.6

10-14

21.1

15.7

16.4

16.9

19.1

15-19

17.3

12.9

13.5

13.9

15.6

20-24

15.0

11.2

11.7

12.0

13.5

25-29

13.4

10.1

10.5

10.8

12.1

30-39

12.3

9.2

9.6

9.9

11.1

40-59

10.6

8.0

8.4

8.6

9.6

60-79

8.7

6.6

6.9

7.0

7.8

80-99

7.6

5.7

6.0

6.1

6.8

100-199

6.8

5.1

5.4

5.5

6.1

200-299

4.8

3.7

3.8

3.9

4.3

300-699

3.9

3.0

3.1

3.2

3.5

700-1499

2.6

2.0

2.1

2.1

2.3

1500+

1.8

1.4

1.4

1.5

1.6