Appendix: Constructing the Character Index

Elizabeth M. Bounds; Robert J. Ridder; Karen K. Melton; and Sarah A. Schnitker

The Character Index is a tool that gives people a concise path toward self-reflection without excessive questions or calculations. Although not a validated measurement tool, it uses various items borrowed from psychometrically validated scales. The items were chosen based on the rigorous selection process detailed below.

Analytic Approach

To select single items from validated virtue measures, several criteria were considered. First, out of two timepoints available to our research team at the time of the Character Index development, we analyzed psychometric properties of our second timepoint data. We opted for our second timepoint because, in theory, after more time and participation in center programming, students should improve in the measured constructs (i.e., from an item response theory perspective, greater “ability/theta”). We want to select single items that capture the greatest ability in these virtue measures, so we selected the timepoint where students should, in theory, be at their highest level thus far.

Second, no reverse-scored items were selected. This decision was made for several reasons: (a) consistency of assessment response range for participants, (b) ease of scoring for practitioners, and (c) reverse-scored items can sometimes present measurement artifacts (i.e., load better on a negative worded measurement factor in a confirmatory factor analysis). Third, because our data can be viewed as ordinal or continuous (Rhemtulla et al., 2012), we conducted both confirmatory factor analyses (CFAs) and item response theory (IRT) models for polytomous items: graded response models (Ostini et al., 2014). We selected items with the highest factor loadings and discrimination parameter estimates. Thresholds and information were also considered from graded response models. Finally, face validity/content validity of items was considered.

Table B.1 provides the items ultimately selected for use in the Character Index.

 

Table B.1. Single Items Used in the Character Index

Virtue Item Response Range
Humility
   Intellectual (Leary et al., 2017) In the face of conflicting evidence, I am open to changing my opinions. 1 (Not at all true or characteristic of me)  2  (Slightly true or characteristic of me)  3 (Moderately true or characteristic of me)  4 (Very true or characteristic of me)  5 (Extremely true or characteristic of me)
   Expressed – Teachability (Owens et al., 2013) I am willing to learn from others. 1 (strongly disagree) to 5 (strongly agree)
Generosity
   Interpersonal Generosity (Smith & Hill, 2009) I’m the kind of person who is willing to go the “extra mile” to help take care of my friends, relatives, and acquaintances. 1 (strongly disagree) to 5 (strongly agree)
Gratitude
   Trait Gratitude (McCullough et al., 2004) I have so much in life to be thankful for. 1 (strongly disagree) to 7 (strongly agree)
   Gratitude to God (Watkins) When I think of what others have done for me in my life it makes me appreciate God even more. 1 (strongly disagree) to 5 (strongly agree)
   Indebtedness to God (Nelson et al., 2023) Everything I have comes from God. 1 (strongly disagree) to 5 (strongly agree)
Patience 1 (Not like me at all)  2 (Unlike me) 3 (Neutral)  4 (Like me)  5 (Very much like me)
   Interpersonal Patience (Schnitker, 2012) I am patient with other people.
   Life Hardships Patience (Schnitker, 2012) I am patient during life hardships.
   Daily Hassles Patience (Schnitker, 2012) Although they’re annoying, I don’t get too upset when stuck in a traffic jam.
Self-Control
   Global Self-Control (Tangney et al., 2004) I am good at resisting temptation. 1 (Not like me at all )  2 (Unlike me)  3 (Neutral)   4 (Like me)  5 (Very much like me)
Courage
   Trait Courage (Howard & Alipour, 2014) Even if something scares me, I will not back down. 1 (Never)  2 (Almost never)  3 (Occasionally)  4 (Sometimes)  5 (Often)  6 (Almost always)  7 (Always)
Meaning/Purpose in Life 1 (strongly disagree) to 7 (strongly agree)
   Meaning in Life (Costin & Vignoles, 2020) My life as a whole has meaning. 1 (strongly disagree) to 7 (strongly agree)
   Coherence (Costin & Vignoles, 2020) I can make sense of the things that happen in my life. 1 (strongly disagree) to 7 (strongly agree)
   Purpose (Costin & Vignoles, 2020) I have a good sense of what I am trying to accomplish in life. 1 (strongly disagree) to 7 (strongly agree)
   Mattering (Costin & Vignoles, 2020) Even considering how big the universe is, I can say that my life matters. 1 (strongly disagree) to 7 (strongly agree)
   Beyond-the-Self Orientation

(Bronk et al., 2018)

How often do you find yourself hoping that you will make a meaningful contribution to the broader world? 1 (Almost never)  2 (Once in a while)  3 (Sometimes)  4 (Frequently)  5 (Almost all the time)

Note. The item from Bronk et al.’s (2018) scale was adapted to form a statement rather than a question. The original wording of the item is as follows: “How often do you find yourself hoping that you will make a meaningful contribution to the broader world?”

 

Psychometrics

Table B.2 provides reliability statistics for all scales from which Character Index items were derived. Tables B.3-B.13 show descriptive statistics and psychometric properties of the individual items from each scale.

 

Table B2. Reliability for Center Student Population at Time 2

Virtue Alpha Omega
Humility
   Intellectual (Leary et al., 2017) .854 .852
   Expressed Teachability (Owens et al., 2013) .802 .803
Generosity
   Interpersonal Generosity (Smith & Hill, 2009) .891 .892
Gratitude
   Trait Gratitude (McCullough et al., 2004) .764 .755
   Gratitude to God (Watkins) .817 .825
   Transcendent Indebtedness to God (Nelson et al., 2023) .895 .894
Patience
   Global Patience (Schnitker, 2012) .813 .804
   Interpersonal Patience (Schnitker, 2012) .726 .738
   Life Hardships Patience (Schnitker, 2012) .748 .753
   Daily Hassles Patience (Schnitker, 2012) .739 .739
Self-Control
   Global Self-Control (Tangney et al., 2004) .826 .821
Courage
   Trait Courage (Howard & Alipour, 2014) .890 .891
Meaning/Purpose in Life
   Meaning in Life (Costin & Vignoles, 2020) .865 .863
   Coherence (Costin & Vignoles, 2020) .714 .707
   Purpose (Costin & Vignoles, 2020) .793 .792
   Mattering (Costin & Vignoles, 2020) .794 .802
   Beyond-the-Self Orientation (Bronk et al., 2018) .797 .804

 

Table B3. Factor Loadings and Discrimination Values for Intellectual Humility

Intellectual Humility (Leary et al., 2017) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
IH_T2
IH_1_T2 I question my own opinions, positions, and viewpoints because they could be wrong. .825 0.685 1.938 3.43 1.07
IH_2_T2 I reconsider my opinions when presented with new evidence. .815 0.772 2.668 3.69 .91
IH_3_T2 I recognize the value in opinions that are different from my own. .839 0.591 1.523 3.92 .86
IH_4_T2 I accept that my beliefs and attitudes may be wrong. .824 0.687 1.970 3.47 1.02
IH_5_T2 In the face of conflicting evidence, I am open to changing my opinions. .813 0.785 2.816 3.64 .91
IH_6_T2 I like finding out new information that differs from what I already think is true. .829 0.666 1.823 3.47 1.09

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B4. Factor Loadings and Discrimination Values for Expressed Humility – Teachability

Expressed Humility – Teachability (Owens et al., 2013) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
EH_TEACH_T2
teach_1_T2 I am willing to learn from others. .677 0.811 3.696 4.55 .67
teach_2_T2 I am open to the ideas of others. .720 0.740 2.593 4.37 .71
teach_3_T2 I am open to the advice of others. .750 0.700 2.119 4.33 .78

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B5. Factor Loadings and Discrimination Values for Interpersonal Generosity

Interpersonal Generosity (Smith & Hill, 2009) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
IG_T2            
IG_1_T2 When one of my loved ones needs my attention, I really try to slow down and give them the time and help they need. .870 0.714 2.167 4.91 .90
IG_2_T2 I am known by family and friends as someone who makes time to pay attention to others’ problems. .868 0.726 2.156 4.61 1.10
IG_3_T2 I’m the kind of person who is willing to go the “extra mile” to help take care of my friends, relatives, and acquaintances. .866 0.751 2.387 4.77 .99
IG_4_T2 When friends or family members experience something upsetting or discouraging I make a special point of being kind to them. .873 0.655 1.856 5.01 .91
IG_5_T2 When it comes to my personal relationships with others, I am a very generous person. .871 0.685 1.909 4.64 .99
IG_6_T2 It makes me very happy to give to other people in ways that meet their needs. .873 0.651 1.841 5.14 .87
IG_7_T2 It is just as important to me that other people around me are happy and thriving as it is that I am happy and thriving. .875 0.620 1.676 4.92 1.01
IG_8_T2 My decisions are often based on concern for the welfare of others. .870 0.680 1.865 4.56 1.06
IG_9_T2 I am usually willing to risk my own feelings being hurt in the process if I stand a chance of helping someone else in need. .880 0.570 1.356 4.46 1.14
IG_10_T2 I make it a point to let my friends and family know how much I love and appreciate them. .878 0.587 1.451 4.65 1.13

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B6. Factor Loadings and Discrimination Values for Gratitude

Gratitude (McCullough et al., 2004) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
GRAT_T2            
GQ_1_T2 I have so much in life to be thankful for. .760 0.850 4.177 6.32 1.00
GQ_2_T2 If I had to list everything that I felt grateful for, it would be a very long list. .753 0.842 3.474 6.11 1.19
GQ_3R _T2 When I look at the world, I don’t see much to be grateful for. (Reverse-scored) .780 0.537 1.918 5.98 1.35
GQ_4_T2 I am grateful to a wide variety of people. .769 0.765 2.552 6.10 1.09
GQ_5_T2 As I get older I find myself more able to appreciate the people, events, and situations that have been part of my life history. .778 0.711 2.105 6.11 1.12
GQ_6R _T2 Long amounts of time can go by before I feel grateful to something or someone. (Reverse-scored) .845 0.369 1.021 4.95 1.75

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B7. Factor Loadings and Discrimination Values for Gratitude to God

Gratitude to God (Watkins) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
GTG_T2            
GTG_1_T2 Simple pleasures like a beautiful view or a delicious meal often remind me of how good God has been to me. .836 .750 2.376 4.24 1.01
GTG_2_T2 When I think of how good others have been to me, it makes me feel very thankful to God. .825 .870 4.026 4.30 1.00
GTG_3R _T2 Because my life has been so bad, I have very little to thank God for. (Reverse-scored) .904 .323 0.920 4.41 1.01
GTG_4_T2 When I see the beauty of new life in the spring, I feel very thankful toward God. .836 .748 2.415 4.24 .99
GTG_5_T2 When I think of what others have done for me in my life it makes me appreciate God even more. .823 .886 4.353 4.29 .98
GTG_6_T2 I feel very grateful to God when I think of my family. .835 .775 2.610 4.36 .98

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B8. Factor Loadings and Discrimination Values for Transcendent Indebtedness to God

Transcendent Indebtedness to God (Nelson et al., 2023) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
ITG_T1            
ITG_1_T2 Even though I can never repay God, I try to repay Him by the kind of life that I live. .916 0.710 2.182 4.10 1.04
ITG_2_T2 Everything I have comes from God. .897 0.902 5.532 4.34 1.10
ITG_3_T2 I owe God for my life. .902 0.863 4.046 4.37 1.05
ITG_4_T2 When I think of what God has done for me I want to give back. .907 0.787 2.736 4.19 1.03
ITG_5_T2 I depend on God for all I have. .904 0.847 3.621 3.95 1.21
ITG_6_T2 Understanding my indebtedness helps me feel God’s love for me. .911 0.763 2.584 3.97 1.19

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B9. Factor Loadings and Discrimination Values for Patience

3-Factor Patience Scale (Schnitker, 2012) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
PAT_T2    
IPP_T2 Interpersonal Patience  
PAT_1_T2 My friends would say I’m a very patient friend .682 0.700 2.005 3.56 .98
PAT_4_T2 I am patient with other people. .657 0.802 3.348 3.72 .86
PAT_7R _T2 I have trouble being patient with my close friends and family. (Reversed-scored) .785 0.364 0.829 3.27 1.13
PAT_9_T2 When someone is having difficulty learning something new, I will be able to help them without getting frustrated or annoyed. .735 0.503 1.234 3.78 .92
PAT_11_T2 I find it easy to be patient with people. .653 0.781 2.737 3.42 .98
LHP_T2 Life Hardship Patience          
PAT_2_T2 I am able to wait-out tough times. .680 0.693 2.185 3.58 .88
PAT_5_T2 I find it pretty easy to be patient with a difficult life problem or illness. .715 0.676 1.771 3.17 1.04
PAT_8_T2 I am patient during life hardships. .616 0.779 2.919 3.41 .94
DHP_T2 Daily Hassles Patience          
PAT_3_T2 Although they’re annoying, I don’t get too upset when stuck in a traffic jam. .537 0.749 2.836 3.47 1.12
PAT_6 _T2 In general waiting in lines does not bother me. .656 0.673 1.648 3.42 1.08
PAT_10R _T2 I get very annoyed at red lights. (Reverse-scored) .661 0.601 1.645 3.67 1.11

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B10. Factor Loadings and Discrimination Values for Self-Control

Global Self-Control (Tangney et al., 2004) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
SC _T2 Global self-control  
SC_1_T2 I am good at resisting temptation. .823 0.671 1.516 3.14 .99
SC_2R _T2 I have a hard time breaking bad habits. (Reverse-scored) .822 0.621 1.587 2.63 1.07
SC_3R _T2 I do certain things that are bad for me, if they are fun. (Reverse-scored) .821 0.649 1.448 3.05 1.16
SC_4_T2 I refuse things that are bad for me. .833 0.509 0.921 3.48 .97
SC_5R _T2 Sometimes I can’t stop myself from doing something, even if I know it is wrong. (Reverse-scored) .821 0.639 1.493 3.14 1.18
SC_6R _T2 Pleasure and fun sometimes keep me from getting work done. (Reverse-scored) .822 0.584 1.463 2.54 1.11
SC_7R _T2 I am lazy. (Reverse-scored) .823 0.401 1.381 3.30 1.15
SC_8R _T2 I have trouble concentrating. (Reverse-scored) .827 0.270 1.179 2.73 1.18
SC_9_T2 I am able to work effectively toward long-term goals. .832 0.489 0.973 3.84 .90
SC_10R _T2 I often act without thinking through all the alternatives. (Reverse-scored) .831 0.526 0.992 3.59 1.11
SC_11R _T2 I say inappropriate things. (Reverse-scored) .834 0.413 0.892 3.46 1.23
SC_12R _T2 I wish I had more self-discipline. (Reverse-scored) .824 0.604 1.462 2.27 1.14
SC_13_T2 People would say that I have iron self-discipline. .824 0.556 1.333 3.06 1.12

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B11. Factor Loadings and Discrimination Values for Courage

Courage (Howard & Alipour, 2014) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
CM_T2            
CM_1_T2 I tend to face my fears. .843 0.814 2.903 4.44 1.24
CM_2_T2 Even if I feel terrified, I will stay in the situation until I have done what I need to do. .851 0.737 2.203 4.46 1.33
CM_3_T2 I will do things even though they seem to be dangerous. .879 0.598 1.431 3.68 1.48
CM_4_T2 If I am worried or anxious about something, I will do or face it anyway. .850 0.769 2.490 4.59 1.19
CM_5_T2 If there is an important reason to face something that scares me, I will face it. .861 0.690 1.904 5.28 1.19
CM_6_T2 Even if something scares me, I will not back down. .840 0.830 3.136 4.38 1.26

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B12. Factor Loadings and Discrimination Values for Meaning in Life

The Multidimensional Meaning in Life Scale (Costin & Vignoles, 2020)Time 2
Variable Name Item α if item deleted Factor Loading a M SD
MIL_T2 Meaning in Life Judgments          
MMIL_1_T2 My life as a whole has meaning. .824 0.776 3.087 5.92 1.21
MMIL_2_T2 My entire existence is full of meaning. .851 0.726 2.347 5.49 1.39
MMIL_3R _T2 My life is meaningless. (Reverse-scored) .815 0.834 3.867 6.12 1.28
MMIL_4R _T2 My existence is empty of meaning. (Reverse-scored) .816 0.827 3.829 6.07 1.33
COH _T2 Coherence          
MMIL_5_T2 I can make sense of the things that happen in my life. .675 0.587 1.973 5.06 1.24
MMIL_6_T2 Looking at my life as a whole, things seem clear to me. .688 0.575 1.473 4.47 1.49
MMIL_7R _T2 I can’t make sense of events in my life. (Reverse-scored) .635 0.672 2.073 5.02 1.51
MMIL_8R _T2 My life feels like a sequence of unconnected events. (Reverse-scored) .678 0.687 1.495 5.33 1.46
PURP _T2 Purpose          
MMIL_9_T2 I have a good sense of what I am trying to accomplish in life. .732 0.747 2.645 5.15 1.36
MMIL_10_T2 I have certain life goals that compel me to keep going. .762 0.686 2.135 5.78 1.15
MMIL_11R _T2 I don’t know what I am trying to accomplish in life. (Reverse-scored) .749 0.745 2.310 4.87 1.67
MMIL_12R _T2 I don’t have compelling life goals that keep me going. (Reverse-scored) .767 0.690 2.074 5.70 1.42
MAT _T2 Mattering          
MMIL_13_T2 Whether my life ever existed matters even in the grand scheme of the universe. .835 0.503 1.474 4.76 1.73
MMIL_14_T2 Even considering how big the universe is, I can say that my life matters. .752 0.763 2.562 5.64 1.37
MMIL_15R _T2 My existence is not significant in the grand scheme of things. (Reverse-scored) .727 0.800 3.167 5.23 1.74
MMIL_16R _T2 Given the vastness of the universe, my life does not matter. (Reverse-scored) .725 0.838 4.014 5.59 1.61

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

Table B13. Factor Loadings and Discrimination Values for Beyond-the Self Orientation

Beyond-the-Self Orientation (Bronk et al., 2018) – Time 2
Variable Name Item α if item deleted Factor Loading a M SD
CP_T2            
CP1_T2 How often do you hope to leave the world better than you found it? .783 0.767 2.517 3.89 .99
CP2_T2 How often do you find yourself hoping that you will make a meaningful contribution to the broader world? .765 0.821 3.204 3.97 .99
CP3_T2 How important is it for you to make the world a better place in some way? .774 0.782 2.841 4.13 .89
CP4_T2 How often do you hope that the work that you do positively influences others? .832 0.618 1.669 4.28 .81

Note. a = item discrimination in a graded response IRT model. Item bolded is the item that best captures the construct of interest.

 

references

Ostini, R., Finkelman, M., & Nering, M. (2014). Selecting Among Polytomous IRT Models. In S. P. Reise & D. A. Revicki (Eds.), Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment. Taylor & Francis Group.

Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17(3), 354–373. https://doi.org/10.1037/a0029315

License

Icon for the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Appendix: Constructing the Character Index Copyright © 2024 by Elizabeth M. Bounds; Robert J. Ridder; Karen K. Melton; and Sarah A. Schnitker is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, except where otherwise noted.

Share This Book

Feedback/Errata

Comments are closed.