Psychometric properties and performance of the Patient Reported Outcomes Measurement Information System® (PROMIS®) depression short forms in ethnically diverse groups.

Jeanne A. Teresi, Ed.D., Ph.D.1,2,3,4

Katja Ocepek-Welikson, M.Phil.3

Marjorie Kleinman, MS 2

Mildred Ramirez, Ph.D.3,4

Giyeon Kim, Ph.D.5

 

1.      Columbia University Stroud Center

2.      New York State Psychiatric Institute

3.      Research Division, Hebrew Home at Riverdale; RiverSpring Health

4.      Department of Geriatrics and Palliative Medicine, Weill Cornell Medical Center

5.      Center for Mental Health and Aging, Department of Psychology, University of Alabama, Tuscaloosa

1.2.3.4 Columbia University Stroud Center at New York State Psychiatric Institute

1051 Riverside Drive
Box 42
Room 2714
New York, New York, 10032-3702

Phone: 718-581-1139

Fax: 718-543-2477

 

5 Center for Mental Health and Aging

Department of Psychology

The University of Alabama

BOX 870315

Tuscaloosa, AL 35487

Office: 215 Osband Hall

Tel: (205) 348-7517

Fax: (205) 348-7520

Email: Giyeon.Kim@ua.edu

 

Correspondence concerning this article should be addressed to: Jeanne Teresi, Ed.D, Ph.D., Columbia University Stroud Center at New York State Psychiatric Institute, 1051 Riverside Drive, Box 42, Room 2714, New York, New York, 10032-3702;  Teresimeas@aol.com; jat61@columbia.edu

 

Acknowledgements:  Partial funding for these analyses was provided by the National Institute of Arthritis & Musculoskeletal & Skin Diseases, U01AR057971(PI: Potosky, Moinpour) and by the National Institute on Aging, 1P30AG028741-01A2 (PI, Siu)  The authors thank Stephanie Silver for editorial assistance in the preparation of this manuscript.

 


Appendix Table 1. PROMIS short form depression item set

 Model fit statistics: Comparative fit index (CFI) from the confirmatory

 factor and bi-factor models and the graded response model fit

 from IRTPRO for the total sample and the demographic subgroups

Sample

CFA CFI

(MPLUS)

IRT Model RMSEA (IRTPRO)

Total Sample (CFA)

0.992

0.05

Random First Half Sample (CFA)

0.992

N/A

Random Second Half Sample (Bi-factor CFA)

0.997

N/A

Female

0.991

0.05

Male

0.994

0.05

Age 21 to 49 years

0.993

0.04

Age 50 to 64 years

0.992

0.06

Age 65 to 84 years

0.991

0.04

Non-Hispanic Whites

0.993

0.04

Non-Hispanic Blacks

0.992

0.06

Hispanics

0.991

0.05

Non-Hispanic Asians/Pacific Islanders

0.994

0.06

Less Than High School

0.990

0.06

High School Graduate

0.993

0.05

Some College

0.994

0.04

College Graduate

0.988

0.05

Graduate Degree

0.988

0.04

Hispanics Interviewed in English

0.991

0.04

Hispanics Interviewed in Spanish

0.992

0.07


Appendix Table 2. PROMIS short form depression item set: Discrimination ‘a’ parameter estimates

  IRTPRO individual subgroup runs

Item

Item description

Total Sample

Race/Ethnicity

Education

Age Groups

Gender

Hispanics Only Interview Language

NH White

NH

Black

Hisp.

NHAPI

No HS

HS

Some

Coll.

Coll.

Grad.

21-49

50-64

65-84

Female

Male

Engl.

Span.

1

I felt worthless

3.77

4.21

3.13

3.79

3.81

3.67

3.34

3.93

3.61

3.43

3.77

3.79

3.75

3.62

4.04

4.21

3.61

2

I felt that I had nothing to look forward to

4.63

4.88

4.83

4.52

4.28

4.44

4.68

4.96

3.93

3.85

4.73

4.69

4.75

4.38

5.06

5.08

3.76

3

I felt helpless

4.23

4.31

4.23

3.90

4.52

3.66

4.37

4.63

3.68

3.75

4.01

4.34

4.17

3.99

4.58

4.06

3.75

4

I felt sad

4.14

4.02

4.27

4.06

4.27

4.01

4.12

4.19

3.90

3.82

4.08

4.05

4.19

3.91

4.68

3.92

4.16

5

I felt like a failure

4.69

4.29

5.20

4.81

5.35

5.24

4.64

4.49

4.10

4.07

5.03

4.56

4.40

4.46

5.15

4.43

5.64

6

I felt depressed

4.67

4.64

4.65

4.60

4.97

4.62

4.82

4.63

4.09

4.11

4.62

4.59

4.57

4.36

5.23

4.42

4.71

7

I felt unhappy

4.65

4.50

4.95

4.58

5.06

4.74

4.95

4.65

4.02

4.35

4.67

4.57

4.49

4.48

4.86

4.44

4.67

8

I felt hopeless

6.46

6.77

7.35

5.45

7.05

5.46

6.43

7.45

5.95

6.06

6.21

6.29

6.46

6.41

6.47

6.01

4.87

9

I felt discouraged about the future

4.09

3.83

4.72

4.00

4.60

4.23

4.05

3.93

4.28

3.63

3.93

4.26

3.92

4.02

4.27

4.09

3.82

10

I felt disappointed in myself

3.60

3.27

4.19

3.59

4.16

4.02

3.65

3.43

3.28

3.25

3.72

3.57

3.37

3.49

3.77

3.38

4.37


Appendix Table 3. PROMIS depression short form item set: Final IRT item parameters and DIF statistics for the race/ethnicity groups; non-Hispanic Whites are the reference group

 

Item name

Group

a

b1

b2

b3

b4

a DIF*

b DIF*

I felt worthless

Non-Hispanic White

4.23 (0.30)

0.46 (0.04)

0.94 (0.06)

1.62 (0.11)

2.46 (0.16)

 

Non-Hispanic Black

2.84 (0.29)

0.45 (0.05)

0.90 (0.08)

1.77 (0.16)

2.68 (0.24)

11.0 (0.001)

34.5 ( < 0.001)

Hispanic

3.51 (0.37)

0.56 (0.05)

0.99 (0.08)

1.79 (0.16)

2.55 (0.23)

2.3 (0.130)

14.4 (0.006)

Non-Hispanic Asian/Pacific Islander

3.88 (0.39)

0.34 (0.04)

0.80 (0.06)

1.63 (0.13)

2.28 (0.20)

0.5 (0.488)

15.4 (0.004)

I felt that I had nothing to look forward to

Non-Hispanic White

4.90 (0.35)

0.44 (0.04)

0.91 (0.06)

1.56 (0.10)

2.30 (0.15)

 

Non-Hispanic Black

4.37 (0.45)

0.55 (0.05)

0.98 (0.08)

1.72 (0.15)

2.36 (0.21)

0.9 (0.353)

8.7 (0.070)

Hispanic

4.17 (0.44)

0.54 (0.05)

1.00 (0.08)

1.80 (0.16)

2.64 (0.23)

1.6 (0.202)

3.8 (0.0440)

Non-Hispanic Asian/Pacific Islander

4.37 (0.44)

0.33 (0.04)

0.84 (0.07)

1.65 (0.14)

2.15 (0.18)

0.9 (0.356)

18.0 (0.001)

I felt helpless

Non-Hispanic White

4.33 (0.31)

0.42 (0.04)

0.88 (0.06)

1.53 (0.10)

2.24 (0.15)

 

Non-Hispanic Black

3.83 (0.39)

0.40 (0.04)

0.84 (0.07)

1.63 (0.14)

2.45 (0.22)

1.0 (0.321)

5.4 (0.253)

Hispanic

3.60 (0.39)

0.45 (0.04)

0.94 (0.08)

1.71 (0.15)

2.47 (0.22)

2.1 (0.148)

1.4 (0.842)

Non-Hispanic Asian/Pacific Islander

4.60 (0.47)

0.26 (0.04)

0.76 (0.06)

1.60 (0.13)

2.15 (0.18)

0.2 (0.629)

21.7 ( < 0.001)

I felt sad

Non-Hispanic White

3.99 (0.31)

-0.17 (0.03)

0.46 (0.04)

1.36 (0.10)

2.17 (0.16)

NS, Anchor item

Non-Hispanic Black

Hispanic

Non-Hispanic Asian/Pacific Islander

I felt like a failure

Non-Hispanic White

4.30 (0.32)

0.61 (0.04)

1.11 (0.07)

1.74 (0.11)

2.36 (0.15)

 

Non-Hispanic Black

4.70 (0.49)

0.57 (0.05)

1.01 (0.08)

1.77 (0.15)

2.57 (0.22)

0.5 (0.489)

12.8 (0.012)

Hispanic

4.45 (0.48)

0.57 (0.05)

1.03 (0.09)

1.72 (0.15)

2.36 (0.21)

0.1 (0.7994)

2.8 (0.601)

Non-Hispanic Asian/Pacific Islander

5.48 (0.57)

0.28 (0.04)

0.83 (0.06)

1.56 (0.12)

2.02 (0.17)

3.3 (0.0692)

43.9 ( < 0.001)


 
I felt depressed

 

Non-Hispanic White

 

 

 

4.51 (0.36)

 

 

 

0.10 (0.03)

 

 

 

0.64 (0.05)

 

 

 

1.43 (0.11)

 

 

 

2.15 (0.16)

 

 

 

NS, Anchor item

Non-Hispanic Black

Hispanic

Non-Hispanic Asian/Pacific Islander

I felt unhappy

Non-Hispanic White

4.49 (0.31)

-0.13 (0.03)

0.54 (0.04)

1.41 (0.09)

2.34 (0.16)

 

Non-Hispanic Black

4.53 (0.46)

-0.07 (0.04)

0.51 (0.05)

1.43 (0.12)

2.29 (0.20)

< 0.1 (0.945)

5.7 (0.228)

Hispanic

4.26 (0.46)

0.06 (0.04)

0.67 (0.06)

1.54 (0.13)

2.27 (0.20)

0.2 (0.685)

23.8 ( < 0.001)

Non-Hispanic Asian/Pacific Islander

5.11 (0.51)

-0.10 (0.05)

0.51 (0.04)

1.49 (0.12)

2.04 (0.17)

1.1 (0.299)

16.1 (0.003)

I felt hopeless

Non-Hispanic White

6.79 (0.55)

0.50 (0.04)

0.95 (0.06)

1.58 (0.10)

2.29 (0.15)

 

Non-Hispanic Black

6.63 (0.74)

0.54 (0.05)

0.96 (0.08)

1.59 (0.13)

2.34 (0.20)

< 0.1 (0.863)

2.0 (0735)

Hispanic

5.04 (0.56)

0.45 (0.04)

0.96 (0.08)

1.63 (0.14)

2.23 (0.20)

5.0 (0.026)

16.2 (0.003)

Non-Hispanic Asian/Pacific Islander

7.25 (0.78)

0.41 (0.04)

0.91 (0.07)

1.58 (0.12)

2.10 (0.18)

0.2 (0.630)

9.8 (0.044)

I felt discouraged about the future

Non-Hispanic White

3.84 (0.27)

0.08 (0.03)

0.65 (0.05)

1.37 (0.09)

2.14 (0.14)

 

Non-Hispanic Black

4.26 (0.46)

0.25 (0.04)

0.75 (0.06)

1.53 (0.13)

2.27 (0.21)

0.6 (0.436)

17.3 (0.002)

Hispanic

3.69 (0.41)

0.21 (0.04)

0.76 (0.06)

1.60 (0.14)

2.22 (0.20)

0.1 (0.766)

14.9 (0.005)

Non-Hispanic Asian/Pacific Islander

4.70 (0.48)

0.14 (0.04)

0.75 (0.06)

1.55 (0.12)

2.12 (0.18)

2.4 (0.119)

19.8 (0.001)

I felt disappointed in myself

Non-Hispanic White

3.28 (0.23)

0.23 (0.03)

0.81 (0.06)

1.55 (0.10)

2.41 (0.16)

 

Non-Hispanic Black

3.79 (0.41)

0.36 (0.04)

0.82 (0.07)

1.59 (0.14)

2.39 (0.22)

1.2 (0.275)

13.2 (0.010)

Hispanic

3.31 (0.37)

0.45 (0.04)

0.93 (0.08)

1.71 (0.15)

2.34 (0.21)

< 0.1 (0.940)

27.4 ( < 0.001)

Non-Hispanic Asian/Pacific Islander

4.26 (0.44)

0.21 (0.04)

0.86 (0.07)

1.56 (0.13)

2.14 (0.18)

4.0 (0.047)

19.3 (0.001)

* Statistical test for differences in parameters is Wald test using 1 d.f. for the test of differences in the a parameters

for the comparison groups and 2 d.f. for the test of differences in the b parameters.

* Bolded entries indicate items that evidence DIF after correction for multiple comparisons; “NS, Anchor item” refers to a non-significant DIF finding for the item during the initial iterative anchor item selection process.  The “non-significant” designation refers to the second stage DIF detection procedure using the anchor items and testing the remaining items.  The “non-significant” designation indicates that the item was not found to have DIF in the second stage of DIF detection. 


 

Appendix Table 4. PROMIS depression short form item set: IRT item parameters and DIF statistics for the education groups; respondents with graduate degrees are the reference group

Item name

Group

a

b1

b2

b3

b4

a DIF*

b DIF*

I felt worthless

Less than HS

2.94 (0.15)

0.65 (0.04)

1.08 (0.04)

2.08 (0.06)

2.96 (0.09)

2.7 (0.099)

15.5 (0.004)

High School

2.68 (0.14)

0.63 (0.04)

1.26 (0.04)

2.17 (0.07)

3.22 (0.12)

6.3 (0.012)

3.8 (0.430)

Some College

3.23 (0.14)

0.75 (0.03)

1.26 (0.04)

2.15 (0.05)

3.18 (0.10)

0.6 (0.456)

3.2 (0.522)

College Degree

3.49 (0.23)

0.70 (0.04)

1.31 (0.05)

2.23 (0.09)

3.16 (0.20)

< 0.1 (0.915)

0.7 (0.951)

Graduate Degree

3.45 (0.27)

0.70 (0.05)

1.30 (0.06

2.15 (0.11)

3.01 (0.24)

 

I felt that I had nothing to look forward to

Less than HS

3.82 (0.10)

0.70 (0.02)

1.25 (0.02)

2.11 (0.03)

2.94 (0.05)

NS, Anchor item

High School

Some College

College Degree

Graduate Degree

I felt helpless

Less than HS

2.92 (0.15)

0.59 (0.04)

1.11(0.04)

2.03 (0.05)

2.85 (0.08)

6.6 (0.010)

11.9 (0.018)

High School

3.52 (0.18)

0.58 (0.04)

1.18 (0.04)

2.07 (0.06)

2.92 (0.09)

0.5 (0.466)

2.5 (0.638)

Some College

3.81 (0.16)

0.69 (0.03)

1.20 (0.03)

2.06 (0.05)

2.96 (0.08)

< 0.1 (0.930)

5.7 (0.223)

College Degree

3.54 (0.22)

0.62 (0.04)

1.19 (0.05)

1.95 (0.08)

2.85 (0.15)

0.4 (0.533)

6.3 (0.177)

Graduate Degree

3.78 (0.30)

0.59 (0.04)

1.19 (0.06)

2.19 (0.11)

3.15 (0.27)

 

I felt sad

Less than HS

3.43 (0.09)

-0.02 (0.03)

0.70 (0.02)

1.75 (0.02)

2.71 (0.04)

NS, Anchor item

High School

Some College

College Degree

Graduate Degree

I felt like a failure

Less than HS

4.17 (0.22)

0.78 (0.03)

1.24 (0.04)

2.15 (0.05)

2.75 (0.07)

< 0.1 (0.897)

9.9 (0.042)

High School

3.74 (0.20)

0.77 (0.04)

1.37 (0.04)

2.08 (0.06)

3.05 (0.10)

1.0 (0.330)

1.5 (0.821)

Some College

3.70 (0.16)

0.86 (0.03)

1.45 (0.04)

2.29 (0.05)

3.03 (0.09)

1.3 (0.254)

9.8 (0.045)

College Degree

3.96 (0.26)

0.72

(0.04)

1.35 (0.05)

2.12 (0.08)

2.88 (0.15)

0.1 (0.709)

1.4 (0.837)

Graduate Degree

4.12 (0.33)

0.72 (0.04)

1.31 (0.06

1.97 (0.09)

2.75 (0.19)

 


 
I felt depressed

Less than HS

 

3.84 (0.10)

 

0.29 (0.03)

 

0.92 (0.02)

 

1.83 (0.03)

 

2.68 (0.04)

 

NS, Anchor item

High School

Some College

College Degree

Graduate Degree


 

 
I felt unhappy

Less than HS

3.75 (0.19)

0.20 (0.04)

0.81 (0.04)

1.94 (0.05)

2.71 (0.07)

2.6 (0.108)

22.8 ( < 0.001)

High School

3.97 (0.21)

0.06 (0.04)

0.78 (0.04)

1.94 (0.05)

2.86 (0.08

0.9 (0.339)

12.2 (0.016)

Some College

3.84 (0.16)

0.09 (0.04)

0.84 (0.03)

1.85 (0.04)

2.93 (0.08)

2.0 (0.157)

5.9 (0.211)

College Degree

3.84 (0.23)

0.02 (0.04)

0.77 (0.04)

1.79 (0.07)

2.81 (0.14)

1.7 (0.197)

3.5 (0.486)

Graduate Degree

4.33 (0.31)

0.01 (0.04)

0.82 (0.04)

1.67 (0.07)

2.73 (0.19)

 

I felt hopeless

Less than HS

4.32 (0.22)

0.65 (0.04)

1.16 (0.03)

1.99 (0.05)

2.73 (0.07)

8.0 (0.005)

11.0 (0.027)

High School

5.17 (0.30)

0.70 (0.03)

1.29 (0.04)

2.01 (0.05)

2.89 (0.08)

2.0 (0.158)

2.5 (0.637)

Some College

6.15 (0.29)

0.75 (0.03)

1.30 (0.03)

2.08 (0.04)

2.85 (0.07)

< 0.1 (0.938)

0.4 (0.981)

College Degree

5.76 (0.43)

0.73 (0.04)

1.32 (0.05)

1.95 (0.07)

2.70 (0.12)

0.2 (0.638)

2.3 (0.688)

Graduate Degree

6.10 (0.59)

0.76 (0.04)

1.29 (0.05)

2.04 (0.09)

2.76 (0.19)

 

I felt discouraged about the future

Less than HS

3.34 (0.17)

0.44 (0.04)

1.00 (0.04)

2.00 (0.05)

2.72 (0.07)

1.2 (0.284)

17.1 (0.002)

High School

3.25 (0.17)

0.35 (0.04)

0.99 (0.04)

1.88 (0.05)

2.78 (0.09)

1.9 (0.174)

5.4 (0.249)

Some College

3.24 (0.13)

0.32 (0.04)

0.99 (0.03)

1.90 (0.05)

2.73 (0.07)

2.2 (0.137)

3.7 (0.453)

College Degree

4.13 (0.27)

0.35 (0.04)

0.97 (0.04)

1.77 (0.07)

2.57 (0.12)

1.4 (0.233)

4.2 (0.387)

Graduate Degree

3.68 (0.27)

0.26 (0.04)

0.97 (0.05)

1.76 (0.08)

2.48 (0.15)

 

I felt disappointed in myself

Less than HS

3.17 (0.16)

0.63 (0.04)

1.16 (0.04)

2.07 (0.05)

2.78 (0.08)

0.2 (0.664)

21.3 ( < 0.001)

High School

2.93 (0.15)

0.50 (0.04)

1.14 (0.04)

2.00 (0.06)

2.95 (0.10)

1.6 (0.205)

6.7 (0.155)

Some College

2.82 (0.12)

0.57 (0.04)

1.19 (0.04)

2.10 (0.05)

3.04 (0.09)

3.1 (0.081)

13.4 (0.010)

College Degree

3.17 (0.20)

0.43 (0.04)

1.11 (0.05)

1.96 (0.08)

2.93 (0.16)

0.2 (0.695)

4.3 (0.365)

Graduate Degree

3.30 (0.24)

0.39 (0.04)

1.07 (0.06)

1.78 (0.09)

2.55 (0.16)

 

* Statistical test for differences in parameters is Wald test using 1 d.f. for the test of differences in the a parameters

for the comparison groups and 2 d.f. for the test of differences in the b parameters.

* Bolded entries indicate items that evidence DIF after correction for multiple comparisons; “NS, Anchor item” refers to a non-significant DIF finding for the item during the initial iterative anchor item selection process.  The “non-significant” designation refers to the second stage DIF detection procedure using the anchor items and testing the remaining items.  The “non-significant” designation indicates that the item was not found to have DIF in the second stage of DIF detection. 

 


Appendix Table 5. PROMIS depression short form item set: IRT item parameters and DIF statistics for  age groups; the youngest age group (21-49) is the reference group

Item name

Group

a

b1

b2

b3

b4

a DIF*

b DIF*

I felt worthless

Age 21 - 49

3.80 (0.19)

0.21 (0.03)

0.68 (0.03)

1.32 (0.05)

2.13 (0.09)

 

Age 50 - 64

3.86 (0.17)

0.16 (0.02)

0.59 (0.03)

1.33 (0.05)

2.05 (0.08)

< 0.1 (0.856)

7.4 (0.118)

Age 65 - 84

3.94 (0.18)

0.09 (0.02)

0.50 (0.03)

1.30 (0.05)

2.01 (0.09)

0.3 (0.578)

27.1 ( < 0.001)

I felt that I had nothing to look forward to

Age 21 - 49

4.77 (0.25)

0.24 (0.03)

0.73 (0.03)

1.36 (0.05)

2.12 (0.08)

 

Age 50 - 64

4.76 (0.21)

0.16 (0.02)

0.60 (0.03)

1.30 (0.05)

1.94 (0.07)

< 0.1 (0.948)

19.0 (0.001)

Age 65 - 84

4.98 (0.23)

0.07 (0.02)

0.49 (0.03)

1.20 (0.05)

1.78 (0.07)

0.5 (0.495)

58.4 ( < 0.001)

I felt helpless

Age 21 - 49

4.26 (0.15)

0.08 (0.02)

0.53 (0.02)

1.24 (0.04)

1.92 (0.06)

NS, Anchor item

Age 50 - 64

Age 65 - 84

I felt sad

Age 21 - 49

4.12 (0.20)

-0.53 (0.03)

0.04 (0.03)

0.90 (0.04)

1.76 (0.07)

 

Age 50 - 64

4.12 (0.18)

-0.46 (0.03)

0.12 (0.02)

1.00 (0.04)

1.76 (0.07)

< 0.1 (0.937)

10.2 (0.038)

Age 65 - 84

4.38 (0.19)

-0.40 (0.03)

0.21 (0.02)

1.05 (0.04)

1.78 (0.07)

1.1 (0.288)

41.9 ( < 0.001)

I felt like a failure

Age 21 - 49

4.73 (0.17)

0.21 (0.02)

0.68 (0.02)

1.33 (0.04)

1.92 (0.06)

NS, Anchor item

Age 50 - 64

Age 65 - 84

I felt depressed

Age 21 - 49

4.72 (0.16)

-0.20 (0.02)

0.32 (0.02)

1.06 (0.03

1.74 (0.05)

NS, Anchor item

Age 50 - 64

Age 65 - 84

I felt unhappy

Age 21 - 49

4.69 (0.16)

-0.37 (0.02)

0.23 (0.02)

1.10 (0.04)

1.84 (0.06)

DIF not significant

Age 50 - 64

Age 65 - 84

I felt hopeless

Age 21 - 49

6.49 (0.23)

0.16 (0.02)

0.61 (0.02)

1.22 (0.04)

1.83 (0.06)

NS, Anchor item

Age 50 - 64

Age 65 - 84

I felt discouraged about the future

Age 21 - 49

4.14 (0.14)

-0.15 (0.02)

0.38 (0.02)

1.12 (0.04)

1.77 (0.06)

NS, Anchor item

Age 50 - 64

Age 65 - 84

I felt disappointed in myself

Age 21 - 49

3.63 (0.12)

-0.01 (0.02)

0.51 (0.02)

1.23 (0.04)

1.93 (0.06)

NS, Anchor item

Age 50 - 64

Age 65 - 84

* Statistical test for differences in parameters is Wald test using 1 d.f. for the test of differences in the a parameters

for the comparison groups and 2 d.f. for the test of differences in the b parameters.

* Bolded entries indicate items that evidence DIF after correction for multiple comparisons; “NS, Anchor item” refers to a non-significant DIF finding for the item during the initial iterative anchor item selection process.  The “non-significant” designation refers to the second stage DIF detection procedure using the anchor items and testing the remaining items.  The “non-significant” designation indicates that the item was not found to have DIF in the second stage of DIF detection. 


Appendix Table 6. PROMIS depression short form item set: IRT item parameters and DIF statistics for the gender groups; females are the reference group

Item name

Group

a

b1

b2

b3

b4

a DIF*

b DIF*

I felt worthless

Females

3.63 (0.10)

0.26 (0.03)

0.72 (0.03)

1.50 (0.04)

2.28 (0.06)

NS, Anchor item

Males

I felt that I had nothing to look forward to

Females

4.45 (0.13)

0.26 (0.03)

0.73 (0.03)

1.47 (0.04)

2.16 (0.05)

NS, Anchor item

Males

I felt helpless

Females

4.06 (0.11)

0.20 (0.03)

0.67 (0.03)

1.41 (0.04)

2.13 (0.05)

DIF not significant

Males

I felt sad

Females

3.91 (0.12)

-0.44 (0.03)

0.19 (0.03)

1.10 (0.03)

1.94 (0.05)

3.0 (0.0821)

16.0 (0.003)

Males

4.26 (0.17)

-0.25 (0.03)

0.37 (0.03)

1.25 (0.04)

1.99 (0.06)

I felt like a failure

Females

4.51 (0.13)

0.33 (0.03)

0.82 (0.03)

1.51 (0.04)

2.12 (0.05)

DIF not significant

Males

I felt depressed

Females

4.48 (0.12)

-0.10 (0.03)

0.45 (0.03)

1.22 (0.03)

1.94 (0.05)

DIF not significant

Males

I felt unhappy

Females

4.46 (0.12)

-0.28 (0.03)

0.35 (0.03)

1.26 (0.03)

2.05 (0.05)

DIF not significant

Males

I felt hopeless

Females

6.20 (0.20)

0.28 (0.03)

0.75 (0.03)

1.39 (0.03)

2.03 (0.05)

NS, Anchor item

Males

I felt discouraged about the future

Females

6.20 (0.20)

0.28 (0.03)

0.75 (0.03)

1.39 (0.03)

2.03 (0.05)

DIF not significant

Males

I felt disappointed in myself

Females

3.45 (0.09)

0.10 (0.03)

0.65 (0.03)

1.40 (0.04)

2.13 (0.05)

DIF not significant

Males

* Statistical test for differences in parameters is Wald test using 1 d.f. for the test of differences in the a parameters

for the comparison groups and 2 d.f. for the test of differences in the b parameters.

* Bolded entries indicate items that evidence DIF after correction for multiple comparisons; “NS, Anchor item” refers to a non-significant DIF finding for the item during the initial iterative anchor item selection process.  The “non-significant” designation refers to the second stage DIF detection procedure using the anchor items and testing the remaining items.  The “non-significant” designation indicates that the item was not found to have DIF in the second stage of DIF detection. 

 


Appendix Figure 1. PROMIS short form depression item set:

Scree plot from the exploratory factor analysis of the total sample (n = 5459)


Appendix Figure 2. PROMIS depression short form item set: Item information functions (total sample)

 

 

 

 

 

Measurement equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Anxiety short form scale in ethnically diverse groups

 

Jeanne A. Teresi, Ed.D., Ph.D. 1,2,3,4

Katja Ocepek-Welikson, M.Phil. 3

Marjorie Kleinman, MS 2

Mildred Ramirez, Ph.D. 3,4

Giyeon Kim, Ph.D. 5

 

1.      Columbia University Stroud Center

2.      New York State Psychiatric Institute

3.      Research Division, Hebrew Home at Riverdale; RiverSpring Health

4.      Department of Geriatrics and Palliative Medicine, Weill Cornell Medical Center

5.      Center for Mental Health and Aging; Department of Psychology; The University of Alabama

 

1,2,3,4  Correspondence address: 

Columbia University Stroud Center at

Research Division, Hebrew Home at Riverdale

5901 Palisade Avenue

Riverdale, New York 10471

718-581-1139

Fax: 718-543-2477

Email:  Corresponding author:  Teresimeas@aol.com; jat61@columbia.edu

 

5Center for Mental Health and Aging

Department of Psychology

The University of Alabama

BOX 870315

Tuscaloosa, AL 35487

Office: 215 Osband Hall

Tel: (205) 348-7517

Fax: (205) 348-7520

Email: Giyeon.Kim@ua.edu

 

 

Acknowledgements:  Partial funding for these analyses was provided by the National Institute of Arthritis & Musculoskeletal & Skin Diseases, U01AR057971 (PI: Potosky, Moinpour) and by the National Institute on Aging, 1P30AG028741-01A2 (PI: Siu).  The authors thank Stephanie Silver for editorial review of this paper.


Appendix Table 1. PROMIS short form anxiety item set: Model fit statistics: Comparative fit index (CFI) from the confirmatory and bi-factor CFA models and graded response model fit from IRTPRO for the total sample and demographic subgroups

Sample

CFA CFI

(MPlus)

IRT Model RMSEA (IRTPRO)

Total Sample (CFA)

0.990

0.05

Random First Half  Sample (CFA)

0.990

N/A

Random Second Half Sample (Bi-factor CFA)

0.997

N/A

Female

0.991

0.05

Male

0.990

0.06

Age 21 to 49 years

0.990

0.05

Age 50 to 64 years

0.992

0.06

Age 65 to 84 years

0.989

0.05

Non-Hispanic Whites

0.991

0.04

Non-Hispanic Blacks

0.991

0.07

Hispanics

0.989

0.07

Non-Hispanic Asians/Pacific Islanders

0.992

0.05

Less Than High School

0.988

0.07

High School Graduate

0.991

0.06

Some College

0.992

0.05

College Graduate

0.993

0.04

Graduate Degree

0.991

0.04

Hispanics Interviewed in English

0.990

0.07

Hispanics Interviewed in Spanish

0.990

0.07

 

 

 


Appendix Table 2. PROMIS short form anxiety item set: Discrimination ‘a’ parameter estimates

IRTPRO individual subgroup runs

Item

Item description

Total Sample

Race/Ethnicity

Education

Age Groups

Gender

Hispanics Only Interview Language

NH Whites

NH

Blacks

Hisp.

NHAPI

No HS

HS

Some

Coll.

College

Grad.

21-49

50-64

65-84

Female

Male

Engl.

Span.

1

I felt fearful

3.17

2.99

3.24

3.10

3.45

3.18

3.29

3.17

3.02

2.95

2.80

3.10

3.41

2.96

3.52

3.17

2.91

2

I felt anxious

3.91

4.16

3.80

3.75

4.43

3.53

3.81

4.35

4.57

3.82

3.95

3.85

3.74

3.92

3.80

3.96

3.85

3

I felt worried

3.95

3.99

4.23

3.67

4.00

3.56

3.89

4.03

4.37

3.98

3.91

3.87

3.87

3.78

4.14

4.01

3.08

4

I found it hard to focus on anything other than my anxiety

4.69

4.84

4.61

4.69

4.56

4.44

4.61

4.82

4.27

4.35

4.54

4.88

4.48

4.43

5.23

4.85

4.67

5

I felt nervous

4.89

4.64

5.06

4.82

5.15

4.36

5.15

5.13

5.12

3.90

4.56

5.01

4.87

4.76

4.99

5.10

4.26

6

I felt uneasy

5.48

5.44

5.51

5.12

5.94

5.04

6.06

5.93

5.03

4.12