Personal Reflection

The step-by-step guides for Personal Reflection use informal assessment methods that will be useful to centers that do not want to collect data on their students but rather are interested in using the assessment tools for students’ growth. Centers may choose to use this approach in a specific program or with all students associated with their center. Two step-by-step guides are provided. One guide focuses on personal reflection via a one-on-one conversation, like over a cup of coffee. The other focuses on personal reflection using worksheets specific to a virtue (e.g., patience, humility, etc.) that might be used in one session of a program or class.  The guides provide the steps needed for facilitating the virtue assessment tools as an intervention for students to gain personal reflection and goal-setting related to virtues. If this approach is used over time with the same students, it can also provide these students a means for tracking their growth over time.

We included this approach in the toolkit because, as part of our research study, students identified how meaningful the questions were to their own growth. Students were asked to complete a one-hour questionnaire four times over the course of two years. Initially, our research team expected many complaints from students, but we were surprised by the overwhelmingly positive responses we received. Students from the centers stated that they enjoyed taking the surveys and viewed them as an opportunity for deep self-reflection, individual feedback, and goal setting.

“I’ve enjoyed doing these surveys and am excited to see what you find!”

“Thank you for allowing me to reflect on my life with this survey!”

“I appreciated taking this survey, and I really enjoyed reflecting on my goals.”

“I really enjoy taking this survey because it helps me see how I’ve changed over the past year since coming to college.”

“I love taking this quiz! It makes me feel good about myself afterward and helps me process my thoughts and goals!”

Scholars have noted that taking a questionnaire can be a catalyst for change in a person’s life. The deep reflection that occurs for a person when answering a questionnaire can provide an opportunity for cognitive dissonance. This can occur when individuals experience tension between inconsistency in the person that they want to be and the person that they are.

For example, in a survey, I might be asked the question, How much do I agree with the statement: ‘I am patient with other people.’ In response, I may want to say “strongly agree;” however, when I am being truthful with myself, I choose the option “disagree” based on my current behaviors. What we have witnessed in this example is a psychological phenomenon referred to as cognitive dissonance^[4]. Humans desire internal consistency, thereby causing discomfort when the desired response conflicts with current behavior. In most situations, this discomfort motivates action to alleviate the internal tension. Humans may employ a range of strategies to mitigate this discomfort, including changing their beliefs or attitudes, recalibrating the importance of values, engaging in new behaviors, or feeling less responsible for current behavior.^[5]

From our research study, we found that center students shared their sincere appreciation for questions that provide cognitive dissonance, and these questions may have been a catalyst for reflecting on their virtues and growth over time:

“Thank you for the time you took to craft this survey. It is a time to reflect on my life goals and to recommit each time this survey is taken.”

“Thanks for the survey! The questions were very thought-provoking and encouraged me to perform a deep self-reflection.”

“I began doing these surveys for the gift cards, but the experience has been very valuable and therapeutic to think about and genuinely answer questions I may have gone years without asking myself. I really appreciate you guys. (This participant refused payment).”

“My answers have for sure changed over time.”

“Thanks for the opportunity to be encouraged to sit and reorient myself despite the busy college life!”

“This survey asked questions that really made me think and allowed me to think about my life more personally and in a deeper way.”

In addition to the positive impact that questionnaires can have on students’ beliefs, attitudes, and behaviors; it is also important to note that taking questionnaires may also bring up difficult feelings and experiences.  

“It’s helpful to reflect on these things; the survey has made me realize that I do feel very lonely despite having a good family and close friends. I don’t understand why.”

“I’m struggling a lot with legalism in faith right now. I deeply appreciate the readings {center} gives me, but often, the more readings I have to think about, the easier it is for me to make new rules I have to follow to be a good Christian. Also, the {center} staff do help me with a lot of problems – I don’t think they’ve necessarily shown me how to ask for help, but I just do it myself because I already know how.”

“My dad has passed away, I wish there was an option for that when talking about father figures.”

Therefore, regardless of which approach you take to virtue assessment, we highly recommend connecting students to mental health and religious support. With this in mind, many of our guides will include a section on connecting students to additional support.

Program Evaluation

The step-by-step guide for Program Evaluation will be useful to centers that have intentionally designed a program to facilitate students’ virtue formation. Therefore, if you are interested in collecting information that helps to address the question—Is {PROGRAM} effective at increasing {VIRTUE}?—then this approach is right for you.

Program evaluations are a systematic method for collecting, analyzing, and interpreting data to demonstrate the effectiveness and efficiency of a program. If you are new to evaluations, that definition can be a bit overwhelming. So, let’s break this down.

First, let’s talk about the concept of a program. A program is an activity or set of activities that are grouped together for the purpose of achieving a specific outcome. For example, a program may group together three activities: (1) eating a meal together, (2) book reading, and (3) reading discussion–and call this group of activities the Monday Night Dinner Club. The goal of Monday Night Dinner Club may be to (a) increase a sense of belonging and (b) increase knowledge on a particular topic. In your organization, you probably have several programs.

Second, let’s talk about the concept of an evaluation. An evaluation is a systematic method for making a decision. This simply means that we follow a process, and there are specific steps that we can follow to gather the information to make a decision. Specifically, these steps include collecting, analyzing, and interpreting data (data is just another word we use for information).

Why do we want this information? Well, we can use this information for several purposes: First, we may want the information to demonstrate the effectiveness and efficiency of a program—that is, to be able to tell stakeholders our program has the impact that we think we are having on our students. For example, if we claim that students in the Fellowship program are more patient, how do we know if they are more patient unless we measure their change in patience as a result of their participation in the Fellowship program?

Another reason we may seek information about our program is to make informed decisions about future programming. Organizations can allocate their budgets more wisely when they clearly understand which programs are effective. This means that information about the program can help us decide which programs to fund further, recruit more participants, and modify or discontinue because they are ineffective.

Organization Monitoring

The step-by-step guide for organization monitoringwill be useful to centers that are interested in identifying the center’s virtue milieu (social environment). Recall that in program evaluation, it is assumed that a program was specifically designed to facilitate virtue development. However, centers may not develop a program with an explicit goal that students grow in virtue (e.g., intellectual humility, generosity, etc.). For example, one center leader said:

Our goal is to cast a vision of the Christian narrative for our students. Our role is not really on the side of virtue formation. So, a checklist of virtues and how to build a program around a virtue seems overwhelming. I feel less overwhelmed when virtues are just a natural language of what we do in living in a Christian community.

Another leader identified instilling Christian thinking as a first-order outcome of the programs and the virtues as a second-order outcome of participating in the center programs over time. In other words, virtues are the fruit produced from living a Christian life. Center programs may tend to focus on helping students live the Christian life (not on developing virtues). Yet, virtues may be a by-product of being actively involved in the center environment. This thinking was also embedded in our research study that hypothesized that meta-moral communities like centers provide an environment that, over time, facilitates students’ growth in virtues.

Therefore, for many of our centers, a program evaluation would likely be an inappropriate method for assessing the virtue scene of centers. Therefore, we have included organization monitoring as an approach in this toolkit to provide centers with a systematic method for collecting, analyzing, and interpreting data to identify the character profile of your organization. The information gained from this organization monitoring may be used to inform decisions about future programming and organization policies that influence the culture. Information gained from organization monitoring can also be shared with stakeholders to identify the merit or worth of students’ participation.

Conclusion

This chapter provides three virtue assessment approaches—personal reflection, program evaluation, and organization monitoring. Determining which approach is best will always depend on the purpose of the assessment—i.e., why does your organization want to conduct a virtue assessment? In this toolkit, we attempt to simplify the balance between the science and the art of assessments by providing practical guides that use informal and formal approaches to assessment. Therefore, in Part 2 of this toolkit, you will find the tools and guides for conducting informal assessments for personal reflection. In Part 3 of this toolkit, you will find the tools and guides for conducting formal assessments for program evaluation and organization monitoring.