Appendix A_Topics andSources final

APPENDIX A

Topics and Data Sources

	Sources
Topic/Key subtopics	Program model documents	Grantee documents and records	Notes from site selection and monitoring	Site visit discussions			Observations	OAH program officers’ notes/ reports	Required fidelity and performance data	Youth surveys
READINESS
Grantee/partners		x	x	x				x
Infrastructure
Role in program implementation
Experience with similar programs
Experience with youth populations
Resources
Leadership/vision for program
Community penetration/how perceived in community
Knowledge of referral sources
Accuracy of specification of community needs
Match of model to community needs
Understanding of potential challenges
Ability to identify and involve key stakeholders
Agency policies that support or undermine the program
Program staff		x	x	x				x
Recruitment
Selection
Training before implementation
Other preparation
Extent of staff support for/belief in program goals and activities
Roles and responsibilities
Program model background and specificity	x	x	x	x
When developed
Prior evidence of effectiveness
Logic model
Theoretical basis
Goals
Staff requirements
Core components
Curriculum content
Level of scripting
Availability of training
Specified frequency and duration
Population(s) for whom appropriate
Manualization
Site-specific plan for replication		x	x	x				x
Replication design and goals
Approved adaptations
Target population(s)
Planned settings
Staffing plan
Planned frequency and duration
Plan for recruitment and retention
Stakeholder awareness and support
Understanding of risks and benefits of program
Existence of program champions
IMPLEMENTATION
Administrative and supervisory supports		x	x		x			x
Decision-making processes
Problem-solving strategies
Steps taken to gain and maintain school district/school support
Steps taken to gain and maintain community agency support
Coordination with other related programs
Rules and standards
Support for staff performance		x	x		x			x
In-service training for staff
Consultation and coaching
Monitoring, evaluation and feedback
Program implementation		x			x	x		x	x
Number and characteristics of youth served
Recruitment and retention of participants
Outreach strategies
Program staffing
Settings for program
Key components/activities
Frequency and duration of program sessions
Fidelity to program model
Adaptations to fit context
Quality of services
Challenges/barriers to implementation
Solutions to challenges/barriers
Participant Responsiveness						x			x
Attendance
Engagement and interaction
Barriers to participation
Satisfaction
COMMUNITY CONTEXT
		x	x		x					x
Community and youth demographics
Community needs
Community values and norms
External events that affected program
Availability of sexual health and other services for youth
Availability of other programs for youth
Use of other sexual health services by youth in program and control groups
COUNTERFACTUAL CONDITION
			x		x
Services/activities provided to youth in control group

Abt Associates Inc. Appendix A: Topics and Data Sources