REQUEST FOR PROPOSAL
AFTERSCHOOL PROGRAMS EVALUATION
MARCH 2, 2023
PITTSBURGH PUBLIC SCHOOL DISTRICT
341 South Bellefield Ave, Pittsburgh, PA 15213
CONTENTS
1. Section 1: RFP invitation
2
2. Section 2: Scope of the work
3
3. Section 3: Detailed proposal requirements
6
3.1 Cover page
6
3.2 Detailed evaluation plan
7
3.3 Detailed budget and narrative
7
3.4 Contract period
7
3.5 Detailed time limit
7
3.6 Milestones
8
3.7 Deliverables
9
3.8 Organization’s background summary
9
3.9 References
10
3.10 Work history with PPS (Pittsburgh Public Schools)
10
3.11 Legal actions
10
3.12 Licenses
10
3.13 Safeguarding and confidentiality
10
3.14 Submission requirements
11
3.15 Confirmation of receipts
12
3.16 Proposal evaluation criteria
13
3.17 Clearance needed
14
3.18 Intellectual property rights
14
3.19 contact for further questions
14
4. Section 4: Proposal form – signature page
15
03-02-23_DREA_1
REQUEST FOR PROPOSAL: AFTERSCHOOL PROGRAMS EVALUATION
OPPORTUNITY
Invitation Date:
Due Date:
For (address):
March 02, 2023
March 23, 2023
Pittsburgh Public School District
Office of Data, Research, Evaluation and Assessment
341 South Bellefield Ave,
Pittsburgh, PA 15213
SECTION 1
REQUEST FOR PROPOSAL INVITATION
Pittsburgh Public School District invites qualified external evaluators to submit a
proposal to evaluate its Afterschool programs for 55 schools located throughout the
district.
Copies of the Request for Proposal (RFP) are available on the Pittsburgh Public
Schools website: https://www.pghschools.org/.
It is the responsibility of all bidders and other interested parties to examine the entire
RFP and seek clarification in writing, if they do not understand any information and/or
instructions. The Pittsburgh Public School District reserves the right to answer or not
answer any question(s) received.
The contract agreement for this evaluation will be based on per agreed services
within the stated timeframe. The elements of the desired educational activities to be
evaluated, scope of the work, detailed proposal requirements, milestones and terms
are discussed in the RFP.
To be considered as the evaluator of this project, your proposal submission must be
received on or before Opening of Business (8:00am EST) on Thursday, March
23, 2023, via email to drea@pghschools.org.
Please note that proposals submitted by mail ONLY will NOT be considered.
Pittsburgh Public School District reserves the right to extend this deadline by
providing a written addendum to the RFP.
The School District also reserves the right to modification and/or cancellation of the
RFP contingent upon the amount of budget allocated to the external evaluation of the
Afterschool programs.
Pittsburgh Public School District also reserves the right to contact any external
evaluation contractors to clarify its proposal.
03-02-23_DREA_2
SECTION 2
SCOPE OF THE WORK
The American Rescue Plan Act of 2021, which is signed into law to provide an
additional funds to States Education Departments and Local Education Agencies,
allocate funds for Elementary and Secondary Schools from 24th of March 2021 to 30th
of September 2024.
The Afterschool programs, in Pittsburgh Public Schools and funded by ARP - ESSER
III, were to address disrupted learning using evidence-based academic, social, and
emotional learning strategies for vulnerable populations of students, who were
disproportionately impacted by covid-19.
Pittsburgh Public School District is inviting qualified independent external evaluators
or researchers to submit a proposal to evaluate the impacts of its Afterschool
programs.
Students attended the Afterschool programs at 55 schools throughout Pittsburgh
Public School District. They include: Twenty-two K-5 schools, eighteen K-8 and 6-8
schools, nine 6-12 and 9-12 schools, and six special schools. The Afterschool
programming was designed at the school level within parameters that are based on
indicators of quality in Afterschool programming, specifically grounded in the work
of Pennsylvania Statewide Afterschool Youth Development Network and Allegheny
Partners for Out of School Time. Afterschool outlines the necessary elements of a
quality program in four core areas: (1) Structure and Management (2) Positive
Connections (3) Safety and Health, and (4) Activities. Complete details regarding
these core areas can be found at: https://www.psaydn.org/home/quality-
andsustainability-work/
It is the Pittsburgh Public School District’s goal to ensure that all Afterschool
programming will embody these core elements. Programming will also be focused
on academic and/or social, emotional learning goals specific to each school and
responsive to the need demonstrated by their student population.
The overall intended outcome of the project evaluation will be to provide evidence of
program effectiveness, which is essential in informing improvement, i.e., to examine
the degree to which the program is successful in producing the desired results. This
evaluation is also important to recommend the ways the Afterschool programs can be
improved, i.e., based on the findings, to suggest recommendations or possible
actions.
03-02-23_DREA_3
The principal questions to be evaluated are investigating the impacts of the
Afterschool programs on addressing learning loss through the implementation of
evidence - based interventions and how the interventions respond to students’ social,
emotional, and academic needs that address the disproportionate impact of covid-19
on underrepresented student subgroups.
The Context, Input, Process and Product (CIPP) evaluation criteria, which assess the
core values of the Afterschool programs will be used. There should be two tiers in the
programs’ evaluation process. In the first tier, the primary questions will be: (i) What
needs to be done? (Context evaluation); (ii) How should it be done? (Input evaluation);
and (iii) Is it being done? (Process evaluation). The second tier of the evaluation deals
with the impact evaluation based on the ARP ESSER III grant expectations (did it
succeed?)
The impact evaluation will be focused on four key areas: Students’ outcomes, chronic
absenteeism, stakeholders’ engagement, and students’ social, emotional wellbeing
(disaggregated on major racial/ethnic group, gender, economic status, SEL, EL,
students experiencing homelessness, etc.). The key impact evaluation questions to be
investigated will be:
1. What is the impact of implementing Afterschool programs on students’
academic growth?
Expectation:
1.1 Students who attended 80% of the available program days will
demonstrate greater than the projected improvement in their
standardized scores on Math and ELA.
1.2 80% of students who participate in at least 80% of available program
days will demonstrate greater increases in their national percentile
rank in ELA and Math compared to a matched sample of students
(match based on demographic and prior performance).
1.3 Students who participated in the program improved literacy/reading
skills better than a matched sample of students based on their DIBELS
scores.
2. What is the impact of implementing Afterschool programs in reducing chronic
absenteeism?
Expectation:
2.1 At least 30% of the participants will attend a minimum of 80% of the
available program days.
2.2 Average daily attendance will be greater than 50% of the targeted
students.
03-02-23_DREA_4