Evaluation Planning, Strategies and Guidelines
Resource Filtering Instructions: Click on any circular icon at the top of this page to display only resources with that attribute. Click on the orange "All" icon to restore the full list of resources.
Options Counseling Evaluation Template 
Source: AoAFinal Options Counseling Evaluation Template
(Word) (PDF) Associated Date: May 2011 Summary Findings from Selected Aging and Disability Resource Center (ADRC) Evaluations
Source: Technical Assistance Exchange
This chart contains summary findings from evaluations of Aging and Disability Resource Centers done by entities external to the ADRCs and/or for purposes beyond routine semi-annual reporting. Studies are arranged by topics covering a range of activities including: access to services, outreach and marketing, consumer satisfaction and cost effectiveness.
(Word)
(PDF)
Associated Date: March 17, 2010
TAE Issue Brief - Options for Assessing the Impact of ADRCs on Long Term Care Costs
Source: ADRC-TAE, The Lewin Group
Measuring the effect of ADRCs presents a major challenge because ADRCs comprise just one component of complicated and constantly evolving state long-term care systems. Nonetheless, there are multiple strategies for collecting evidence about the way ADRCs impact the broader LTC system. While ADRCs might result in cost savings for Medicaid programs, many would argue that reducing unnecessary utilization and supporting community integration are important goals regardless of fiscal considerations. This paper focuses on assessing the fiscal impact of ADRCs.
(Word)
(PDF)
Added January 21, 2008
AoA ADRC Fully Functioning Criteria March 2012
Source: AoA, Technical Assistance Exchange
These criteria were developed to assist states measure and assess their progress toward developing fully functional ADRCs. This document, updated in March 2012, describes program components, criteria, and recommended metrics for defining and evaluating ADRCs.
(Word)
(PDF)
Associated Date: March 2012
Measuring Options Counseling - Goals, Objectives and Indicators
Source: ADRC-TAE
This is the final version of the "Measuring Options Counseling" Goals and Objectives grid that was originally developed by a group of ADRC grantees on a series of Evaluation Peer Workgroup Calls. The outcomes, indicators and strategies for evaluation would apply to ADRC and Nursing Home Diversion options counseling activities.
(Word)
(PDF)
Associated Date: July 01, 2007
Selected Measures of Streamlining Access
Source: The Lewin Group, ADRC-TAE
This document outlines basic indicators of streamlining access by looking at different aspects of the process.
(Word)
(PDF)
Associated Date: May 25, 2006
Community Living Brief: Evaluation as a Means to Sustainability in Real Choice Systems Change
Source: Stephen Soldz, Independent Living Research Utilization (ILRU) Community Living Partnership
Why is evaluation useful? How do you conduct a practical evaluation without straining resources? How can a program integrate evaluation activities into a project so that they become an asset rather than a burden? The answers to these questions and additional resources can be found in Volume 4 of the Community Living Brief.
(External Link)
Updated February 5, 2008
ADRC State Project Evaluation Guidelines for Assessing ADRC Project Progress and Accomplishments
Source: The Lewin Group, ADRC-TAE
When ADRC grantees begin to systematically track the progress and accomplishments of their programs, this document provides assistance to evaluators by detailing an evaluation framework, suggested research questions, recommended minimum dataset elements, and data sources to address research questions useful. At a minimum, AoA and CMS request that all ADRC grantees include these research questions as part of their ADRC evaluation. This document also provides some additional potential indicators related to program goals for grantees that wish to expand the program evaluation beyond this minimum expectation to meet state/local needs and includes suggested a consumer satisfaction survey.
(PDF)
(Word)
Updated December 11, 2007
2013-01-24 Enhanced Options Counseling Update
Source: TAE
This is a recording of the January 24, 2013 Quarterly Grantees Call. It provided an overview of the ADRC Enhanced OC Grant, Technical Assistance Structure for Part B Grantees, Update on Key Areas for Part A Lessons, Medicaid Resources for Part B Grantees, Options Counseling Training Plans, and
ADRC National Evaluation Overview.
(Internal Link)
Associated Date: January 24, 2013
Part B Grantees Slides for 1-24-13
Source: TAE
These are the slides from the January 24, 2013 Quarterly Grantees Call. It provided an overview of the ADRC Enhanced OC Grant, Technical Assistance Structure for Part B Grantees, Update on Key Areas for Part A Lessons, Medicaid Resources for Part B Grantees, Options Counseling Training Plans, and
ADRC National Evaluation Overview.
(Powerpoint)
(PDF)
Associated Date: January 24, 2013
Descriptive Statistics-Year 3 Planning Assessment
Source: Missouri
This document is a summary of staff responses to Missouri's Show Me Options annual planning assessment survey for the years 2009, 2010 and 2011. This assessment is one way Missouri monitors progress on their planning goals.
(PDF)
Associated Date: April 2012
AoA OC National Logic Model
Source: AoA
AoA created this logic model to conceptualize common Options Counseling project activities, short-term outcomes, intermediate outcomes, and long-term outcomes at the system and individual levels. It can be a useful tool for states to think about their own project activities and goals especially when planning evaluations.
(Word)
(PDF)
Associated Date: May 2011
Summary Analysis of ADRC State-Level Narrative Reporting: Quality Assurance and Continuous Improvement
Source: TAE
This document provides a summary of the responses provided by the ADRC grantees to questions asked in the Fall 2010 and Spring 2011 Semi-Annual Reporting Tool (SART) in the categories of Quality Assurance and Continuous Improvement. CQI is a critical component of fully-functional ADRCs in which many states have made significant progress including the use of evaluators. However, this is an area in which grantees have also reported significant challenges, often related to tracking client outcomes over time, data sharing with partners, staff capacity, and defining appropriate indicators of ADRC quality.
(Word)
(PDF)
Associated Date: October 2011
Quality Assurance & Improvement for Participant-Directed Services
Source: NRCPDS: Suzanne Crisp
2011 National Meeting Training: Quality Assurance and Improvement for Participant-Directed Services
(Powerpoint)
(PDF)
Associated Date: February 16, 2011
Quality Assurance and Continuous Improvement Criteria Fully Functioning Aging and Disability Resource Centers
Source: TAE
This handout was distributed at the Charting Progress Toward Achieving Fully Functional ADRC Status Discussion session during the 2011 National Grantee Meeting
(Word)
(PDF)
Associated Date: February 2011
ADRC Supervisor Call Listening Feedback Form
Source: Brown County, Wisconsin ADRC
This document is used by the Brown County, Wisconsin ADRC site to provide feedback to staff after call listening by a supervisor. Call listening is a quality improvement strategy used by the Brown County ADRC to ensure staff are appropriately responding to initial calls to the ADRC and remaining open to the need for options counseling. The form also assesses staff competency in incorporating motivational interviewing skills into interactions with consumers and helps identify training needs.
(Word)
(PDF)
Updated October 14, 2011
Recording of March 2010 TAE Training on Evaluation
Source: Technical Assistance Exchange
This is a recorded version of the TAE Training webinar on program evaluation, which was offered in March 2010.
(Internal Link) • File type: .wmv
Associated Date: March 17, 2010
Iowa Aging and Disability Resource Center Pilot Sites - Evaluation Report
Source: Iowa, Research Institute for Studies in Education
This evaluation of the Johnson County and Linn County Aging and Disability Resource Center (ADRC) pilot sites funded by the Iowa Department on Aging (IDA), assesses the process and outcomes of establishing a standardized entry point process to long-term care supports and services, with emphasis on the role of the Options Counselor (OC) at both sites.
(PDF)
Added March 8, 2010
Logic Model in Action
Source: Georgia
This is the Power Point presentation by Maria Lee given at the 2010 National Meeting during the session entitled ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes.
(PDF)
(Powerpoint)
(Powerpoint)
Updated March 2, 2010
ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes
Source: Georgia State University
This is the Power Point presentation by Glenn M. Landers given at the 2010 National Meeting during the session entitled ADRCs Do What? Using Logic Models to Document and Improve ADRC Outcomes.
(PDF)
(PDF)
(Powerpoint)
Updated March 2, 2010
The Hilltop Institute: Comprehensive Assessments in Home and Community-Based Services
Source: The Hilltop Institute
This report identifies trends and emerging best practices in comprehensive assessments for HCBS. Assessment instruments from 13 states are included in the analysis.
(PDF)
Added July 29, 2009
Wisconsin Customer Satisfaction Evaluation Executive Summary
Source: Wisconsin
The Wisconsin Department of Health Services (DHS) conducted an evaluation of customer satisfaction among clients of the state’s ADRC to provide baseline customer satisfaction measures and the tools for ongoing tracking of customer satisfaction.
(Word)
(PDF)
Updated October 18, 2011
Evaluation Guidance and National Data Elements from March 2009 NHD Call on Evaluation
Source: The Lewin Group
This draft document outlines a limited core set of indicators that we recommend for inclusion in the data collection process. It also includes a broader set of supplemental indicators with some specific questions and tools commonly used in the field that grantees could include in evaluation efforts. It was referenced during the March 11, 2009 NHD Call.
(Word)
(PDF)
Associated Date: March 11, 2009
Presentation from March 2009 Monthly NHD Call on Evaluation
Source: The Lewin Group
Carrie Blakeway and Cindy Gruman presented these slides on the March 11, 2009 NHD call on Evaluation.
(Powerpoint)
(PDF)
Associated Date: March 11, 2009
West Virginia NHD Performance Assessment
Source: West Virginia
West Virginia provides this form which measures performance across different aspects of the FAIR program, including eligibility, program goals, health and welfare, financial accountability, and administrative authority.
(Word)
(PDF)
Updated February 10, 2009
North Carolina ADRC Consumer Satisfaction Report
Source: North Carolina
This document from North Carolina summarizes findings from all consumer satisfaction surveys conducted in the Forsyth ADRC site during the funded period of the initiative.
(Word)
(PDF)
Updated February 10, 2009
The Logic Model for Program Planning and Evaluation
Source: Paul McCawley, University of Idaho Extension
The Logic Model process is a tool that has been used for more than 20 years by program managers and evaluators to describe the effectiveness of their programs. The model describes logical linkages among program resources, activities, outputs, audiences, and short-, intermediate-, and long-term outcomes related to a specific problem or situation. Once a program has been described in terms of the logic model, critical measures of performance can be identified.
(PDF)
Associated Date: July 24, 2008
Presentation from July 2008 Monthly Call on LTC Costs
Source: ADRC-TAE, The Lewin Group
This presentation is from the July 3, 2008 Monthly Technical Assistance call on Assessing the Impact of ADRCs on Long-Term Care Costs.
(Powerpoint)
(PDF)
Associated Date: July 03, 2008
Basics of Conducting Focus Groups
Source: Carter McNamara, PhD
(Word)
(PDF)
Associated Date: March 27, 2008
Focus Group Fundamentals
Source: Iowa State University
Focus group methodology is one of several tools that educators can use to generate valid information important to the advancement of programs, communities, and organizations. This bulletin describes fundamental aspects of focus groups by distinguishing them from familiar research tools.
(Word)
(PDF)
Associated Date: March 27, 2008
Focus Groups General Handout
Source: ADRC-TAE
A focus group can be defined as a group of individuals selected and assembled by the planners to discuss and comment on the topic from personal experience. This document describes aspects of focus groups.
(Word)
(PDF)
Associated Date: March 27, 2008
Exhibits from 2004 Listserv on Evaluation Framework
Source: ADRC-TAE
There are five exhibits in this file that depict a framework for examining the Aging and Disability Resource Centers (ADRCs) within the environment they operate, as well as potential indicators to measure performance outcomes and impact.
(PDF)
Associated Date: February 02, 2004
Evaluating Advisory Boards Presentation - Evaluation Call Presentation - November 29, 2007
Source: The Lewin Group, ADRC-TAE
This presentation for the November 29, 2007 Evaluation Workgroup call gives an overview of the topic and provides questions for discussion.
(Powerpoint)
(PDF)
Associated Date: November 29, 2007
Fully Functioning ADRC - Monthly TA Call Notes - September 6, 2007
Source: ADRC-TAE
These are summarizing call notes for the September 6, 2007 Monthly TA Call. The topic of discussion was Fully Functioning ADRC criteria.
(Word)
(PDF)
Associated Date: September 06, 2007
Process Evaluation - Evaluation Call Notes - July 26, 2007
Source: ADRC-TAE
Evaluation Workgroup Call notes from July 26th, 2007.
(Word)
(PDF)
Associated Date: July 26, 2007
Call Notes: July 26th 2007 Evaluation Peer Workgroup (no available resources yet)
Source: ADRC-TAE
These notes are from the July 26th, 2007 Evaluation Peer Workgroup call on Process Evaluation.
Associated Date: July 26, 2007
Process Evaluation Presentation from 7.26.2007
Source: Joy Livingston & Donna Reback
This presentation from the July 26, 2007 Evaluation Peer Workgroup Call is about Process Evaluation.
(Powerpoint)
(PDF)
Associated Date: July 26, 2007
Evaluating ADRC Cost Effectiveness - Evaluation Call Notes - May 24, 2007
Source: ADRC-TAE
These call notes summarize the discussion that took place on the Evaluation Peer Workgroup call on May 24, 2007. The topic was Evaluating ADRC Cost Effectiveness
(Word)
(PDF)
Associated Date: May 24, 2007
Evaluating ADRC Cost Effectiveness - Evaluation Call Presentation - May 24, 2007
Source: ADRC-TAE
This is the presentation used on the Evaluation Peer Workgroup Call on May 24, 2007. The topic is Evaluating ADRC Cost Effectiveness
(Powerpoint)
(PDF)
Associated Date: May 24, 2007
Using ADRC Outcome Data - Evaluation Call Notes - March 22, 2007
Source: ADRC-TAE
These are summarizing call notes from the Evaluation Peer Workgroup meeting on March 22, 2007 where the topic of discussion was Using ADRC Outcome Data.
(Word)
(PDF)
Associated Date: March 22, 2007
Evaluation Call Notes 3-29-2007
Source: ADRC-TAE
These are summarizing call notes from the Evaluation Peer Workgroup meeting on March 29, 2007 where the topic of discussion was Using ADRC Outcome Data.
(Word)
(PDF)
Associated Date: March 29, 2007
Evaluation Plans - Evaluation Call Notes - January 25, 2007
Source: ADRC-TAE
These are the call notes from the Evaluation Peer Workgroup Call that took place on January 25, 2007. The topic of discussion was the 2005 Grantees forthcoming Evaluation Plans
(Word)
(PDF)
Associated Date: January 25, 2007
Checklist for Developing ADRC Evaluation Plan
Source: ADRC-TAE
This document provides a check list for ADRC grantees about the components they required to include in their state evaluation plan. This resource provided grantees guidance on what to include, and how to organize the elements, but this format could be tailored by each grantee. Elements to incorporate into the ADRC evaluation plan include: Overall Evaluation Approach, Project Objectives; Tasks; Indicators; Data Sources; Data Collection Methods; Timeline/Interval; Responsible Entity; and Instruments.
(Word)
(PDF)
Updated February 27, 2009
Measuring Outcomes in Virtual ADRCs - Evaluation Call Notes - November 30, 2006
Source: ADRC-TAE
These are the call notes from the meeting of the Evaluation Peer Workgroup on November 30, 2006. The topic of discussion was Measuring Outcomes in Virtual ADRCs
(Word)
(PDF)
Associated Date: November 30, 2006
ADRC-TAE Evaluation Plan Highlights from 2003 & 2004 Grantees
Source: ADRC-TAE
This document presents selected highlights from 2003 and 2004 ADRC grantee evaluation plans.
(Word)
(PDF)
Updated February 10, 2009
ADRC Performance Outcomes Presentation - Linkins
Source: ADRC-TAE
This presentation on ADRC Performance Outcomes was used by Karen Linkins during the "ADRC Performance Outcome Measurement" session at the AoA Choices for Indpendence Summit in December 2006.
(Powerpoint)
(PDF)
Associated Date: December 01, 2006
Measuring Options Counseling - Evaluation Call Notes - September 28, 2006
Source: ADRC-TAE
These are the notes from the September 28, 2006 Evaluation Peer Workgroup call.
(Word)
(PDF)
Associated Date: September 28, 2006
Measuring Impact of Options Counseling - Evaluation Call Notes - July 27, 2006
Source: ADRC-TAE
These are the call notes from the July 27th Evaluation Peer Workgroup call on Measuring Impact of Options Counseling.
(Word)
(PDF)
Associated Date: July 27, 2006
Wisconsin Cover Sheet for Evaluation Plan
Source: Wisconsin
This is Wisconsin's cover sheet for their Evaluation/ Service Delivery Plan
(Word)
Updated August 16, 2012
Wisconsin Evaluation Plan Worksheet
Source: Wisconsin
This is the final version of Wisconsin's Evaluation Plan Worksheet
(Excel)
Updated August 16, 2012
Initial Evaluation Peer Work Call - Evaluation Call Notes - May 26, 2005
Source: The Lewin Group, ADRC-TAE
This document summarizes the discussion from the initial Evaluation Work Group Call between grantees. The group shared about their pilot sites and offered suggestions about topics they'd like to discuss on future calls.
(Word)
(PDF)
Associated Date: May 26, 2005
Evaluation: Pilot Site Perspective - Pilot Site Call Notes - May 19, 2005
Source: The Lewin Group, ADRC-TAE
This document, available in PDF and Word formats below, contains the notes from the ADRC-TAE Pilot Sites Peer Work Group call held on May 19, 2005. The topic was evaluation from the pilot site perspective.
(Word)
(PDF)
Associated Date: May 19, 2005
Evaluation - Call Summary - November 4, 2004
Source: The Lewin Group, ADRC-TAE
Notes from the TAE monthly conference call on November 4, 2004. The topic of the call was evaluation.
(PDF)
(Word)
Associated Date: November 04, 2004
Resources from the ADRC-TAE November 2004 Evaluation Call
Source: The Lewin Group, ADRC-TAE
This page about the November 2004 Standing Grantee Call on Evaluation includes links to all call resources. This call on November 4, 2004, brought together state grantees, their evaluators, and the pilot sites to discuss evaluation plans. Topics included data collection, reports, information for semi-annual reports, and how these efforts can contribute to quality assurance and improvement for the pilot sites. AoA and CMS also fielded questions regarding the requested minimum data elements.
(Internal Link)
Associated Date: November 01, 2004
ADRC Fall 2004 National Meeting - State Project Evaluation Session
Source: The Lewin Group, ADRC-TAE
During the ADRC Fall National Meeting in October of 2004, AoA and The Lewin Group, ADRC-TAE shared the important role ADRC grantees would play in evaluating the ADRC program as well as recommended components ADRC grantees should include in the evaluation of the ADRC program. New Hampshire and New Jersey presented on their ADRC grant evaluation activities including how they tailored ADRC-TAE's recommended evaluation framework in their ADRC grant evaluation design.
(PDF)
Associated Date: October 01, 2004
Surveying Clients About Outcomes
Source: Martin D. Abravanel, The Urban Institute
Nonprofit organizations can utilize this guide to develop and use client surveys as outcome data.
(External Link)
Updated November 20, 2007
Relevant Customer Satisfaction Survey Instruments Matrix
Source: The Lewin Group, ADRC-TAE
Matrix of relevant customer satisfaction questions from existing instruments used by ADRC-like entities used in developing recommended customer satisfaction questions.
(PDF)
Updated November 20, 2007
TAE
About the Technical Assistance Exchange 
