Professional Documents
Culture Documents
Training
Assessment Report
SPRING 2018
ENGINE
which drives student
LEARNING
--John Cowan
Contents
INTRODUCTION
04
DATA ANALYSIS
12
20 BENCHMARKING
RECOMMENDATIONS
22
LIMITATIONS
25
APPENDIX
26
INTRODUCTION
Upcraft, & Schuh defined assessment as “any professionals, as well as administrators, have no
effort to gather, analyze and interpret evidence evidence of such success. Collecting data to show
which describes institutional, departmental, that particular goals are in fact being reached
divisional, or agency effectiveness” (1996, p.18). helps the facilitators of the program defend the
In order to assess a program effectively, the use and possible increase of resources, funding
program should have clearly stated goals and specifically, to operate the program being
learning outcomes (Schuh, Biddix, Dean, & assessed.
Kinzie, 2016). Assessment strategies should be Dr. John Cowan, Professor Emeritus of Student
carefully and intentionally planned in order to Learning at UK Open University, wrote in 2005
gauge whether or not the goals are being that "assessment is the engine which drives
accomplished. Likewise, assessment strategies student learning." Dr. Phil Race, Senior Academic
should be cyclical, as assessment is not the "end Staff Development Officer at the University of
in and of itself, but rather a means to an end. The Leeds, added, "And feedback is the oil which can
end is the improvement of student learning at lubricate this engine" (Race, 2009). In order for
the individual, program, and institutional levels" assessment to make a difference, one must use
(Beirhede, 2007, para. 1.). the feedback, or assessment results, to improve
One of the most important aspects of one's program, course, learning outcomes, or
assessment is the expectation that each program whatever one may be assessing. Closing the
has intentional goals it should be reaching assessment loop with action, prompting a new
(Schuh, et al, 2016). Programs without such goals assessment cycle is imperative.
may achieve great successes, but student affairs
MESSAGE
FROM THE TEAM
We were asked to work with the Office of forward, and a brief synopsis of the limitations
Leadership and Student Involvement (OLSI) to of our assessment report. In an effort to remain
identify a program in need of assessment, create unbiased, our group members have no close ties
and apply an assessment plan, and use the data to C.O.R.E. Training or have any stake or claim to
collected to determine if learning goals were the future success of the program. The
being met. Finally, we were asked to suggest information given in this report is written to
recommendations on how to improve the provide our clients, OLSI and SGA, with tangible
program for greater student engagement and data and recommendations for finding ways to
learning. In conference with Mike Corelli, former improve the program. It is our intention to assist
Assistant Director of OLSI, our team decided to the department and the overarching organization
assess the leadership development program succeed in connecting students of Recognized
called Clubs and Organizations Reaching Student Organizations (RSOs) with the resources
Excellence (C.O.R.E.) Training, housed and and opportunities they need in order to manage
mandated by the Student Government and lead a successful RSO. We hope this report
Association at Western Carolina University. will serve as the "oil" to assist in improving C.O.
In this report, readers will find information on R.E. Training and its mission to foster student
C.O.R.E. Training, its learning outcomes, a brief success within their clubs and organizations.
history, details on our chosen methodology and
assessment designs, an analysis of our findings, Sincerely,
benchmarking data from four peer institutions, Raquel, Carrie, Jennylee, and Kevin
our group's recommendations for moving
170+
The purpose of Clubs and Organizations Reaching
RSOs at Western
Excellence (C.O.R.E.) Training is to provide students Carolina University
with information, resources, and support they need
in order to maintain and advance their Recognized
1
representative per club or
Student Organizations (RSO). Topics within C.O.R. organization is required to attend each
E. Training include recruiting and retention monthly C.O.R.E. Training session
strategies, fundraising and financial protocols,
communication and collaboration, among others.
This year's list of sessions is included in Appendix
A.
7 C.O.R.E. Training monthly sessions for
2017-18 academic year
Background Info
Recognition of student clubs and organizations training. If an organization is not represented at more
is granted through the Office of Leadership and than two trainings, the organization loses its
Student Involvement (OLSI), and through the Student recognition status and all associated privileges.
Government Association (SGA). In order to become a Each C.O.R.E. training focuses on subject matter
RSO at WCU, the organization must have at least ten intended to ensure the successful and smooth
interested members, a faculty or staff advisor, and a operation of a RSO on the WCU campus. Each session
constitution published through OrgSync, OLSI's is conducted in person in the Blue Ridge Conference
online software system to manage student clubs and Center, though the structure of the session may vary
organizations. Recognition grants significant benefits depending upon the subject matter. A member of the
to the organizations. The most noteworthy of these SGA executive board, the C.O.R.E. Director, with
benefits include the ability to reserve meeting and guidance from the OLSI's graduate assistant, is
programming space in the University Center at no responsible for selecting workshop topics, designing
financial cost, and the ability to apply for each workshop, and implementing each program. The
supplemental funding through SGA for programs, most recent C.O.R.E. training topics have included
activities, and materials. recognition, membership, and constitutions;
Once an organization is granted recognition by communication and collaboration through
OLSI and SGA, the organization has certain networking; finance, requesting funds, and
responsibilities which must be met in order to fundraising; creative marketing and promotion;
maintain recognition. Currently, one such effective communication within organizations; and
requirement mandated by SGA includes attendance professionalism and transferable skills. To make the
at C.O.R.E. Training, a monthly leadership most of C.O.R.E. Training, participating students are
development program for leaders of RSOs. Each encouraged to follow up with members of their club
organization must send one representative to each or organization on the material presented to ensure
of the monthly trainings. Attendance is taken at each all students have access to the material.
1 2 3
Learn vital information Connect RSOs with various Develop leadership skills
for creating and resources, networks, and which will enable them
maintaining a individuals that may (students) to become
successful RSO. further the successfulness leaders in their RSO, on
of the RSO. campus, and in their
future post-graduation
life.
--As found in OLSI QEP Program Overview
purposes of the assessment study (Banta & established learning outcomes. Effort was made
Palomba, 2015; Wentlend, 2012). Our goal is to to make questions clear and concise and to
measure the established student learning minimize student bias as much as possible. The
outcomes for C.O.R.E. Training to assess whether survey also invited participants to select which
the program is meeting its goals in providing sessions they felt were most enjoyable. Finally,
students with the resources necessary to the survey gathered demographic information
maintain or advance their RSOs and developing including how many C.O.R.E. Training sessions
leadership skills within their RSOs and their survey participants have attended, how many
professional lives. RSOs memberships participants have, and how
Our target group consists of C.O.R.E. Training organized they feel their RSOs are. The survey
participants for the 2017-2018 academic year. took less than five minutes to complete
continues on next page
and was anonymous. Data is stored in a consideration of a narrowly defined topic," (Banta
password-protected WCU-sponsored Qualtrics & Palomba, 2015, p. 132) or in our case, C.O.R.E.
account. Training as a whole. A major benefit of conducting
The survey was active between March 1 and focus groups is to capture perspectives that are
March 15. It was emailed via Sophia Calhoun, not often heard (Latess, 2008; Wentlend, 2012).
OLSI Graduation Assistant, using OrgSync, a Likewise, student affairs professionals can use
software system which keeps track of student focus groups effectively by encouraging
clubs and organizations. Sophia emailed C.O.R. participant interaction with each other (Kitzinger,
E. Training participants three times: March 1, 1995). In doing so, practitioners gain better sense
March 5, and March 12 to share the purpose of of not only what students think about a certain
the assessment project, to ask for participation topic but also how they think and why they think
and to also advertise for the focus group that way (Kitzinger, 1995).
opportunity (discussed later). Twenty-four The session was conducted immediately
students participated in the survey. following the March 15 C.O.R.E. Training session.
We offered pizza, purchased through OLSI, as an
Focus Group Design incentive to participate. We advertised the focus
In an effort to collect more detailed and rich group opportunity via email (included in the
data regarding student perceptions of C.O.R.E. emails to advertise the open survey) as well as
Training, we also used a qualitative approach and during the March 15 session, facilitated by
conducted a one-time, 30-minute focus group Courtney Gauthier, who made an announcement
session. Focus groups are "carefully planned about group and its purpose before and after
discussions designed to generate in-depth her presentation. Seven students participated
continues on next pagein
Four percent of students surveyed stated C.O.R.E. Training was either very important
Thirteen percent of students surveyed stated C.O.R.E. Training was very important or
important in maintaining the success of their RSO, as well as in developing leaders
13% within their RSOs.
Thirty-eight percent of students surveyed agreed that C.O.R.E. Training was important
or very important in connecting them with resources needed to be successful (e.g.:
38% information, campus departments, financial support, etc.).
This data shows some students find C.O.R.E. Training important in connecting them with the resources
they feel they need in order to manage their RSOs; however, the majority of students do not see the
importance or were neutral of the program in creating and maintaining their RSO or in developing their
leadership skills.
Eight percent of students surveyed stated C.O.R.E. Training was either very effective
8% or effective in creating their RSOs.
continues on next page
12
12 C.O.R.E. Training Report 2017-18
Twenty-one percent of students surveyed stated C.O.R.E. Training was either very
effective or effective in helping them to achieve success in their RSOs.
21%
Thirty-eight percent of students agreed C.O.R.E. Training was either very effective
or effective in connecting them with resources they need to be successful
38% (information, campus resources, financial support, etc).
Thirteen percent of students surveyed agreed that C.O.R.E. Training was very effective
or effective in developing their leadership skills and in developing leaders within
13% their organization.
This data suggests there's a bit of a breakdown in perception between importance of the program and
effectiveness in each of the program's learning outcomes. The focus group analysis later in this document
goes into more detail of student opinions and what would make C.O.R.E. more effective.
Sixteen percent of students surveyed stated they frequently applied skills learned
in C.O.R.E. Training in creating and maintaining their RSO.
16%
Thirteen percent of students stated they have used leadership skills learned during
the C.O.R.E. Training program within their RSO.
13%
This data is congruent with previous answers which indicate the majority of students surveyed do not
see the importance or the effectiveness of C.O.R.E. Training. As a result, the majority of students also do
not apply the skills the program aims to promote. The most successful of the learning outcomes lies in
connecting students with information and on-campus resources intended to help students succeed in
their RSO-related endeavors. This is also echoed in the next question, which is explained on the next page.
"The one CORE Training that I went to before this one which was on getting funds for your org,
which I haven't had to do or anything, but that was interesting and important information."
"Someone from SGA talked about how to do a supplemental funding request, because people
don’t know how to do that....as far as clubs go, they need to know how to get money so they
can go to these conferences; they probably need know how to deal with conflict because
you’re dealing with people with different personalities in the club and org."
"One of the biggest things I’d like to see in C.O.R.E. and C.O.R.E. Training is how to teach people
how to recruit people on Western’s campus in a way that fits their view on how they want to
run their org and how to find people that match their same idea and beliefs."
Additionally, students discussed ideas they feel would be helpful. Several students mentioned a
needing a central place to find pertinent information such as how to book rooms on campus,
which was a recurring example students used throughout the conversation.
"If there was more information like with a database or something, or to have a page (forum)
where everyone can kind of communicate with each other and open more bridges for
everyone, that would be a really beneficial thing to have something all set up. There’s really
no information out there and it’s so difficult to find [information]."
It is important to note that the Office of Leadership and Student Involvement does have an online
database housed within OrgSync; it was evident, however, that these particular students were not
aware of the resource.
"I think they kind of resolved this, but I know like last semester, they would email the day of,
and I don’t know if it’s just my email or if like the other person who was also part of it wasn’t just
in it, so we only got notified like the day before and we’re like what's going on? Like, why can’t
you notify us beforehand?"
"We need more than just a Monday Morning Message that says ‘this week is CORE Training’ I
have a life other than this."
"The reason I missed the first ones was because they emailed about it the day of, and I was like,
I didn’t know about this beforehand. I had gotten no information on it it ... I think they’ve gotten
a little better about it, but it’s been a struggle trying to come to these things."
"I think something like this is the perfect opportunity for other clubs to network and partner
with each other while learning skills...I feel like that can be the spawn of you know, possibly
some networking in the future."
"I just think like it (C.O.R.E. Training) just hasn’t been used properly ... it should be something
that people want to go to. Like, 'Hey I’m going to C.O.R.E. tonight, so we can promote this
event; I’ve got an event coming up in two months, let’s see if anyone’s interested in that.’
"There’s a lot of people here but we just sit and do nothing. So I agree, like I find them boring
because sitting down is boring."
"I feel like a lot of people view it as something that you have to go to, just send anyone, like
make sure like there’s attendance on there....I don’t know I don’t really find it as helpful as it
could be."
"I would just say if you’re going to ask so many people to take an hour out of their day, that
like, it should be worth it."
CLOSING ANALYSIS
During our semi-structured session, we being heavily involved in, C.O.R.E. sessions.
also asked questions in addition to the four This idea of peer-led workshops could be
prepared questions. We asked participating mutually beneficial in allowing members from
students if any of them had taken what they clubs and organizations to increase their
learned or heard at C.O.R.E. Training back to professional development by creating the
their respective RSOs. We feel it important to sessions, as well as the benefit of hearing from
note that no one mentioned they spoke of C. their peers, who also struggle with the same
O.R.E. Training or the items discussed in any challenges.
of the meetings with their RSO members. Additionally, during at least one instance,
Essentially, most students see C.O.R.E. students mentioned that although C.O.R.E.
Training as simply something that they have Training is a SGA-mandated program, they
to do in order to maintain their RSO status, rarely see much of a presence from SGA or
which misses the mark on the program's main GSA (Graduate Student Association). Several
learning outcomes. This also helps explain questioned why C.O.R.E. Training was
why in the online survey the vast majority of mandatory for their club but not mandatory
students stated they did not apply the skills for SGA representation.
learned at C.O.R.E. Training sessions to their In short, our team feels that with some
RSOs. tweaking, C.O.R.E. can be extremely beneficial
We also feel it important to note that at to the students' professional and personal
several points, students mentioned they development. Our suggestions are discussed
would be interested in leading, or at least later in this report.
Yes workshops for basic organizations; Risk “The Point” for full-
SUNY - Oswego information; Management time staff and
optional in-person session required for student office space
Students Enrolled: workshops Sport Clubs and and mailboxes;
8,000 throughout the Greek organizations; Student
semester Treasurer Training Involvement
# of orgs: 224 for SGA-funded Advisor, Coord.,
organizations Director of Student
required. Optional Involvement;
opportunities Administrative
include annual Associate
conference; \
leadership courses,
speakers series,
individualized
trainings
#6: IMPROVED
#7: CLUB UPDATES/
KNOWLEDGE-BASED
COLLABORATION
WEBSITE
The Office of Leadership and Student Involvement currently has a dedicated website for clubs and
organizations; however, it could be updated with a better design so that the information is easier
to see. When students search for 'clubs and organizations,' it takes them directly to the correct
page, which is great -- but the eye is naturally drawn to the search function in the middle of the
page. Students may not know that there is also a manual for RSOs and other online resources at
their disposal. We recommend a page outside of OrgSync -- rso.wcu.edu or core.wcu.edu, for
example -- that would enable better design features. The OLSI could also work with Web Services
to integrate better practices and marketing strategies for the students who need this information.
#6: INCREASED
#8: CLUB UPDATES/ COLLABORATION
SGA PRESENCE/ RESTRUCTURE OF C.O.R.E.
Organization members would benefit from increased participation from the Student Government
Association regarding effective communication (both written and oral), making personal
connections, and providing opportunities for students to engage in public speaking. If SGA is in
charge of C.O.R.E., then there should be much more participation from SGA (and possible the
Graduate Student Association). Alternatively, SGA could consider restructuring C.O.R.E. so that it
falls directly under OLSI with SGA partnership. This would allow full-time staff to make more
timely changes and improvements without having to wait on SGA to approve the amendments. We
recommend having the OLSI Graduate Assistant become the Director of C.O.R.E., with supervision
from OLSI, and create an Assistant Director of C.O.R.E. position within SGA for continued SGA
involvement, but not necessarily management.
24 C.O.R.E. Training Report 2017-18
LIMITATIONS
Despite our best efforts in marketing our a representative from the Center for Career and
online Qualtrics survey, participation in our was Professional Development focused on resume
quite low. Although the total number of C.O.R.E. development and how to translate skills learned
Training participants is difficult to calculate given within campus involvement in a future job
that anyone from a RSO may represent their interview. Several students commented that
organization and one student may represent while resumes are important and the information
multiple RSOs with which they are affiliated, we given was meaningful, they did not see the
believe the response rate of the survey is less connection with C.O.R.E. Training's main purpose
than 10 percent. of assisting students in running their
Additionally, we did not include the March 15 organizations well. As a result, the students
and April 15 C.O.R.E. Training sessions in our tended to use the March 15 session often as their
online survey because we launched the survey examples to describe why the felt C.O.R.E.
before those sessions took place. It is possible Training was not always applicable to running
the results may have been different If we had their clubs or organizations.
had the opportunity to wait so that we could Since the focus group took place directly after
include those sessions. a C.O.R.E. Training session as student workers with
The focus group session consisted of seven the Department of Campus Activities were
participants, two of which also belonged to Greek breaking down tables and chairs, it was difficult
organizations, which may have given them a to hear some participants in the audio recording.
certain bias towards the Greek system and how This may have also affected participants' ability
it operates. The other five students in the focus to hear each other and may have caused a
group belonged to smaller organizations, which disruption to their train of thought.
could also affect their perceptions in what C.O. Additional assessment strategies should be
R.E. Training should look like and the types of considered to gain a holistic understanding of C.
resources and guidance it gives. O.R.E. Training, as well as its goals and learning
Additionally, the focus group took place outcomes. Such strategies should be launched in
directly after the March 15 presentation on a cyclical fashion to continue to meet student
transferable skills and professionalism in which needs.
DATE: ____________________________
THREE TAKEAWAYS:
USEFUL RESOURCES: (Note: This section could be pre-filled by the session presenter)