Professional Documents
Culture Documents
Jeremy Bell
Holly Hicks
Caroline Kiczuk
Maria Popel
Keith Webster
1 of 12
Evaluation Plan
The need for the Academic Tutoring Program arose when students required
academic assistance when professors were not available. Students reacted positively to
the idea of having a free tutoring program at the Academic Center for Excellence (ACE),
and it has become an increasingly popular service at The University of Tampa. By going
to a reliable tutor, students are able to make the necessary adjustments in their classes
to earn better grades and pass their courses with confidence. The tutoring team
consists of both undergraduate and graduate students; they set their own time block to
conduct tutoring sessions in their area of expertise with struggling students. Tutoring is
available to any undergraduate or graduate student at The University of Tampa, and is
available on a walk-in basis. The unique involvement of student-to-student tutoring will
be a factor for this evaluation. We want to know how involved each tutor is in assisting
students, and whether their brilliant minds are able to coach their peers to success with
quizzes, tests, and term papers.
The goal of this evaluation was to assess the effectiveness of the tutoring
program, and to make recommendations as to how it could run more effectively. We
wanted to know if the program is a viable asset to an undergraduate students
education, and whether the tutors are reliable sources for assistance. We hoped to
answer these questions, and any others that arose, by conducting interviews and
sending out surveys to both tutors and tutees. We aimed to collect qualitative data from
our written surveys, and quantitative data from our electronic survey. We hope this
2 of 12
evaluation will result in us being able to offer suggestions that will make the program
more beneficial to students in the future.
Materials Evaluated
The Academic Tutoring Program at The University of Tampa is run by the
Academic Center for Excellence (ACE). It utilizes both individual and small group
instruction settings to assist students in a variety of subjects. The program aims to help
students improve their knowledge base, and skill sets in the desired subject area. The
subjects that are currently offered are: Biology, Chemistry, Math, Phycology,
Accounting, Economics, ITM, Anatomy, Public Speaking, French, Italian, German,
Chinese, Japanese and Spanish.
Participants
The participants in the evaluation consist of tutors and students. The tutors are
successful, experienced students who passed a special training course and did well in
the subject areas they are tutoring for. Their experience in tutoring varies from three
semesters to up to four years. The range of students turning up for the tutoring varies
weekly, and consists mostly of freshmen, sophomores, and juniors. Most of them are
asking for tutoring right before their tests or exams. Tutoring is available on a walk in
basis; no appointment necessary. Six tutors and twelve students participated in this
evaluation.
Twenty five copies of a paper survey (Appendix B) were left at the different
tutoring sites around campus for students currently being tutored to fill out. Tutors at the
different sites were asked to have their tutees fill one out after their tutoring session.
Data analysis consisted of examining the student survey questions, the online
survey responses, and the tutor interview questions. The researchers looked at each
question separately and looked for trends in the responses. The results from the
SurveyMonkey survey were imputed into an excel worksheet and graphs were made to
pictorially illustrate the results.
again arrived to zero responses. We decided that we needed to go to some of the other
areas where tutoring takes place. We left surveys with the language tutors in the
Riverside Center, and got their email addresses so that we would be able to track the
surveys down. We also left surveys with the Anatomy tutors for their students to fill out.
This all resulted in us collecting one student survey (Appendix B) and six Tutor surveys
(Appendix C). Members of the evaluation team meet weekly, and observed tutoring
sessions in progress.
Results
The results of the electronic survey are summarized in Table 1. Only eleven
tutees responded to the survey, so the data may not reflect the true feelings of all tutees
who receive tutoring from the center. Generally, students felt satisfied with the
instruction they received from the tutors and that they were helped with the assignment
they were seeking help with. Most students felt that the tutors were accessible, and
think they would return for more tutoring. Students only saw a moderate change in their
overall grades after receiving instruction from the tutors. Students are somewhat likely
5 of 12
to recommend the tutoring program to their friends. The highest percentage of students
surveyed go to the center once a week for tutoring. Most students would not pay for this
tutoring service if it were not free. The tutees in the survey were not very satisfied with
the group setting for receiving tutoring.
Most tutees surveyed did not particularly like the group setting for tutoring and
felt that one-on-one instruction would be more beneficial to their specific needs. We
received mostly positive feedback for question ten (Appendix D). The most notable
response was, Tutor did not seem to know answers and helped me with an online quiz
that I ended up getting a 60% on. This is only one persons experience, however it
does speak to the qualifications of the tutors. Another tutee suggested that it would
benefit the program to have tutors available not just for introduction level classes but for
higher level classes as well.
The tutors see a large influx in tutees coming in for help right before midterms
and finals. Tutors stressed in their interviews that coming in right before a huge
assignment or exam does not leave them much time to help the student to the degree
they would like to. They also feel that they could be more effective tutors if students
came prepared with specific questions to ask them. It was recommended that tutors
6 of 12
double check answers and facts that they provide to students, so as to not confuse or
mislead tutees. As was found with the tutees, the tutors are not huge fans of the group
tutoring stetting. They feel that they could be more focused and helpful if they were only
focused on one student/assignment at a time.
Discussion
Our group was disappointed in the low response rate to both our paper surveys
and our electronic survey. We attribute the low response rate of our student survey
(Appendix B) to two main factors. Firstly, most students are stressed out when they are
seeking tutoring and dont want to take the extra time to fill out a survey, so they simply
did not. Secondly, we feel that the way we administered the surveys was not the most
effective. Tutors were asking their tutees to fill out the surveys and leave the completed
ones with them. One can see how a student would be reluctant to state their feelings
about the tutoring they had just received (especially if negative), and hand it back to the
person they were talking about. If we had come up with a more discrete way to
administer and acquire the surveys, we think we could have achieved a higher response
rate. We did not receive much qualitative feedback from tutees as, we only obtained
one response to our student survey (Appendix B).
We do not think that this evaluation had enough participants to be of much help to
Janice Law. While we did pick up on a few trends, the small sample size makes the
results fairly unreliable. We maintained our integrity as program evaluators; we
remained unbiased as we conducted interviews and formulated our questions, and we
did not make up data to compensate for our low response rate.
8 of 12
1.
Average Response
Likert Scale 1-5
3.9
1.
How much did the tutoring help with the
assignment you were being tutored for?
2.
4.5. How accessible did you find the tutors?
3.64
4
3.
6.
4.
7.
5.
6.
10. How likely are you to recommend this service to a
friend?
7.
11. If this service were not free, how likely would you
be willing to pay for it?
8.
12. How helpful did you find the group setting for
tutoring?
9.
13. Is there anything that could have improved your
10.
= Positive Response
= Neutral Response
= Negative Response
9 of 12
3.45
36% receive tutoring
1/week
3.64
3.45
1.36
2.73
See Appendix D
Table 2. Recommendations
Setting
1. More one-on-one tutoring availability
If a student is consistently coming to tutoring prepared with questions
and not just showing up the day before assignments are due or exams
are scheduled, they should be able to set up time with a tutor for oneon-one instruction.
The group instruction setting can continue for walk ins.
2. More resources available at tutoring locations
Computers
Whiteboards
Tutoring
1. Offer help with higher level courses
2. Make sure tutors are actually qualified to be instructing in the area they are.
If a tutor is not sure about an answer they should not pretend to be.
If a tutor is consistently misleading tutees, the tutor should face
consequences
3. Better advertising of the services offered
Inform professors what tutoring is available so they can inform their
students.
Have Gateways instructors give out the tutoring schedule to all
freshmen and transfer students and the beginning of the semester.
10 of 12
Appendix A
Survey Monkey Survey Questions
14.
15. How
satisfied
were you
1.
with the
instruction
you
received?
1
Not
Satisfied
How much
did the
tutoring help
2.
1
with the
Not
assignment
Helpful
you were
being
tutored for?
16.
17. How
1
accessible
Not
did you find Accessible
3.
the tutors?
18. Have you
seen a
positive
4.
change in
your grades
since
receiving
the
tutoring?
19. How often
do you
receive
5.
tutoring
from the
center?
20.
21. How likely
are you to
return to the
6.
tutoring
1
No
Change
3
Moderately
Satisfied
5
Extremely
Satisfied
3
Moderately
Helpful
5
Extremely
Helpful
3
Moderately
Accessible
5
Extremely
Accessible
3
Moderate
Change
5
Positive
Change
1/Week
2/Week
3+/Week
1/Month
2/Month
1
Not Likely
3
Moderately
5
Extremely
11 of 12
Less
than
1/Month
center?
Likely
1
Not Likely
23. If this
service
were not
8.
1
2
free, how
Not Likely
likely would
you be
willing to
pay for it?
24. How helpful
did you find
the group
9.
1
2
setting for
Not
tutoring?
Helpful
25. Is there
anything
10. that could
Comment Box
have
improved
your
tutoring
experience?
ALL
comments
are
appreciated!
Likely
3
Moderately
Likely
5
Extremely
Likely
3
Moderately
Likely
5
Extremely
Likely
3
Moderately
Helpful
5
Extremely
Helpful
12 of 12
Appendix B
Student Survey Questions
Yes
Yes
No
No
13 of 12
Appendix C
Tutor Interview Questions
14 of 12
Appendix D
Question #10 Responses - Is there anything that could have improved your tutoring
experience?
Respondent #
Response
Better tutors!
Tutor did not seem to know answers and helped me with an online
quiz that I ended up getting a 60% on.
10
11
15 of 12