Notes
Slide Show
Outline
1
Grantee Panel Presentation
SPRANS Community Based Abstinence Education Grantee Meeting
  • Washington, DC
    November 18-19, 2002
  • Teen-Aid. Inc.
    LeAnna L. Benn
  • National Director
2
FOCUS OF PRESENTATION
  • Rural
  • Evaluation
  • Use of technology in data collection in rural areas where population and distance are barriers
3
Solve Evaluation Problems
  • Has evaluation got you down?
  • Costly printing
  • Shipping and handling  of questionnaires
  • Boring for students
  • Tedious data entry
  • Human errors
  • Storing the old paperwork


  • Continue looking then                         call Teen-Aid
4
Erasing the Barriers
  • Data collection
    • Cost
    • Activities
    • Student data
  • Distance


5
Connecting communities and the avoidance of redundancy for reporting
  • On-line data collection for remote workers
  • Activity reports
  • Ordering material
  • E-mail
  • Net meeting
6
Connecting activity reports and student data without effort for all Performance Measures
7
Forms that meet Performance Measures
8
 
9
I've Got Connections Time Sheet
10
 
11
 
12
Evaluation on-line
  • Pre-Post Testing that:
  • Measures A-H knowledge
  • Measures attitude agreement
  • Measures risk behaviors
  • Saves dollars
  • Achieves accuracy
  • Eliminates data entry time and expense
  • Measures teacher training effectiveness
  • Measures teacher effectiveness in the classroom
  • Feedback for teachers on student behavior and attitude changes
  • Fun for the students to do on-line data entry
  • Future follow up possibility for longitudinal study
13
Pre-Post Testing
  • Website using FrontPage and Access
    • www.teen-aid.org/schools/survey/pre-post...
  • Accurate to download to evaluator
  • Password protected for each teacher/presenter
14
Pre and Post sample
15
 
16
Sexual Behavior
17
Measures A-H knowledge
18
Sample of Questions
19
Measures attitude agreement
20
Measures risk behaviors
21
Why measure risk behaviors?
  • Measure what you say you impact
  • Silence the opposition
  • Ammo against peer pressure
  • Target related behaviors


22
Saves dollars
  • $$$$ Printing pre-post test instruments
  • Boring for students
  • Shipping logistics
  • Shipping costs
  • Data entry tedious costs in corrections required
  • Storage of entered data



23
Achieves accuracy
  • Tediousness causes entry errors
  • Students enter so its their answers
  • No missed data on incomplete surveys with required fields
  • Sensitive with required fields to behavior data that some may not want to answer
  • Have parental permission for survey on initial parent
24
Eliminates data entry time and expense
  • Depending on complexity of survey
  • 3-7 minutes for pre and post test  - saved
  • Shipping issues – saved
  • Time to match pre/post tests – saved
  • Divert regular staff from program tasks – saved
  • Hiring temps to meet deadline with volume of data - saved
25
Measures teacher training effectiveness
  • Student data correlated to the teacher –Teacher is key predictor of program outcome
  • Monitors material content delivered
26
Measures teacher training effectiveness
  • Pre/ Post covers information
  • Pre/Post covers self confidence
  • Sample of Questions
27
Measures teacher effectiveness
 in the classroom
  • Student data correlated to the teacher –Teacher is key predictor of program outcome
  • Monitors material content delivered
  • Measures student movement by teacher of knowledge and attitude for short term results


28
Feedback for teachers on student behavior and attitude changes
  • Allows program to debrief  with staff
  • Provides vehicle for accountability
  • Creates avenue for course correction
    • Discover what is working best
    • Discover why some measures are not moving as expected based on what the presenter is specifically doing
29
Fun for the students
to do on-line data entry
  • Paper survey boring
  • Details needed make survey too long
  • Class time limited so need something fast
  • Students love Internet surveys
  • Survey done in a lab can be read to ESL students to help them stay within time allotted for computer lab
30
Future follow up possibility for longitudinal study
  • Mother’s name letters on-line
  • Separate document for follow-up with relative
  • Teacher’s name / roster
  • Follow-up at school with old rosters
  • Long-term mail or phone follow-up using relative information and match with Mother’s name