TAE
|
|
About the Technical Assistance Exchange 
   
|
 |
Previous Evaluation Peer Work Group Calls
The Logic Model for Program Planning and Evaluation (PDF) Paul McCawley, University of Idaho Extension The Logic Model process is a tool that has been used for more than 20 years by program managers and evaluators to describe the effectiveness of their programs. The model describes logical linkages among program resources, activities, outputs, audiences, and short-, intermediate-, and long-term outcomes related to a specific problem or situation. Once a program has been described in terms of the logic model, critical measures of performance can be identified. Added July 15, 2008 Logic Modeling Presentation for July 24, 2008 Evaluation Call (PDF) or (Powerpoint) Georgia The Georgia Health Policy Center provided this presentation on using the Logic Model to evaluate ADRCs. It was used in the Evaluation Peer Workgroup. Added July 18, 2008 Vermont ADRC: Evaluation Experiences in Accessing Services and Consumer Satisfaction (PDF) or (PowerPoint) Vermont ADRC, Flint Springs Associates This presentation will be given by the evaluators of the Vermont ADRC on the May 22nd Evaluation Peer Workgroup Call. Added May 22, 2008 South Carolina Presentation for Evaluation Workgroup Call on March 27, 2008 (PDF) or (Word) South Carolina This presentation from South Carolina describes the use of focus groups in systems transformation efforts in the State. Added Mar-24-2008 South Carolina Preliminary Focus Group Results (Plain Text) South Carolina South Carolina has provided a draft of results gathered from focus groups on the topic of "Systems Transformation: Links to Community Living" Added Mar-24-2008 Focus Groups General Handout (PDF) or (Word) ADRC-TAE A focus group can be defined as a group of individuals selected and assembled by the planners to discuss and comment on the topic from personal experience. This document describes aspects of focus groups. Added Mar-24-2008 Iowa Pre-ADRC Consumer Focus Groups Report (PDF) or (Word) Iowa ADRC This report presents findings from two focus groups Iowa conducted to solicit feedback from consumers regarding their ADRC needs. These needs were specified as: (1) barriers to accessibility of information (2) determination of their needs, (3) resources people use to find information 4) their virtual experiences (5) preferences concerning potential names for the ADRC. Added Dec-8-2005 Focus Group Fundamentals (PDF) or (Word) Iowa State University Focus group methodology is one of several tools that educators can use to generate valid information important to the advancement of programs, communities, and organizations. This bulletin describes fundamental aspects of focus groups by distinguishing them from familiar research tools. Added Mar-24-2008 Basics of Conducting Focus Groups (PDF) or (Word) Carter McNamara, PhD Added Mar-24-2008 Arizona Summary of Focus Group Findings (PDF) or (Word) Arizona ADRC Arizona has provided this summary of the findings of the focus groups that were held to gather consumer input on the AZ Links website. Added Mar-24-2008 Arizona Focus Group Participant Booklet (PDF) or (Word) Arizona ADRC This booklet was used to guide participants through the focus group process, as a part of the testing of the AZ Links website. Added Mar-24-2008 Arizona Focus Group Participant Evaluation (PDF) or (Word) Arizona ADRC The evaluators of the Arizona ADRC used this form to collect feedback on focus groups that were conducted. Added Mar-24-2008 Hawaii Streamlining and Access Focus Groups Results (PDF) or (Word) Hawaii ADRC Five focus groups were held throughout the Island of Oahu. It was determined that each focus group should be relatively homogeneous in make-up in order to maximize the potential for shared experiences. An effort was made to have reasonable representation of varying genders, ages and ethnicities and this diversity is reflected in the responses. Added Mar-25-2008 Hawaii Focus Group Questions (PDF) or (Word) Hawaii ADRC The Hawaii Aging and Disability Resource Center's Access and Linkage subcommittee used these focus group questions for Healthy and Active Seniors, At-Risk Seniors, Caregivers and Persons with Disabilities. Added Mar-25-2008 NH Presentation for 1-24-08 Evaluation Call (PDF) or (Powerpoint) New Hampshire ServiceLink ADRC New Hampshire's presentation from this workgroup call on evaluating service providers shares details about the results of the evaluation of the ServiceLink Resource Center and its partners. Added Jan-23-2008 Virginia Presentation from Evaluation Call on January 24, 2008 (PDF) or (Powerpoint) Virginia No Wrong Door ADRC The topic of this call was "Evaluating Service Providers." Virginia's presentation included information about how they assessed their partner community agencies that provide services. Added Jan-24-2008 MD Howard County Marketing Study Executive Summary (PDF) or (Word) Howard County Office on Aging and ADRC, Maryland The Howard County Office on Aging in Maryland, an ADRC pilot site, completed a marketing study designed to help them meet the needs of the county's aging population. The study, conducted by Kay Loughery at Johns Hopkins University, included a survey of fee-for-service providers in the community. The findings outlined in this Executive Summary will be used to assist Howard County develop ways to build and strengthen relationships with private providers. Iowa Consumer and Provider Survey Report (PDF) or (Word) Iowa ADRC To support the development of the Iowa ADRC, a survey about perceptions of aging and disability resources was given to attendees at the Governor’s Conference on Aging. Staff developed and administered a survey instrument to assess participant satisfaction. This summary provides information from both consumer and provider surveys. Collected New Hampshire Surveys Provider Survey (PDF) or (Word) Hard To Reach Provider Survey (PDF) or (Word) State Agency Survey (PDF) or (Word) Customer Satisfaction Survey (PDF) Cover Letter for Provider Survey (PDF) or (Word) New Hampshire ServiceLink ADRC New Hampshire ServiceLink Resource Centers employ a variety of surveys to gather information about their programs. Added Jan-22-2008 Evaluating Advisory Boards Presentation (PDF) or (PowerPoint) The Lewin Group, ADRC-TAE This presentation for the November 29, 2007 Evaluation Workgroup call gives an overview of the topic and provides questions for discussion. Added Nov-26-2007 Maryland Access Point Evaluation Process Presentation (PDF) or (PowerPoint) Maryland Access Point ADRC This presentation by Stephanie Hull for the November 29, 2007 Evaluation Workgroup call describes the evaluation efforts that MAP uses to track its progress and successes. Added Nov-27-2007 TAE Issue Brief: Facilitating a Productive Advisory Committee (PDF) or (Word) The Lewin Group, ADRC-TAE Discusses how to establish an effective advisory committee, key considerations when forming and facilitating a committee, tips to promote ongoing involvement of a committee, and resources for more information. Maryland Access Point Advisory Board Survey (PDF) or (Word) Maryland ADRC This document contains the one-page advisory board satisfaction survey instrument used by the Maryland Access Point, the ADRC program in Maryland, as well as the protocol for administering the survey. AZ Links Advisory Board Survey (PDF) or (Word) Arizona ADRC This instrument was used to survey the members of the Arizona Links Advisory Board after six months of progress on the ADRC. Respondents rank a series of statements and then answer a brief series of open-ended questions. Added Nov-26-2007 AZ Links Steering Committee Evaluation Description (PDF) or (Word) Arizona ADRC This document describes why and how the AZ Links Steering Committee was evaluated. It also details the design and structure of the evaluation instrument itself and provides a summary of the findings. Added Nov-26-2007 Tennessee Advisory Committee Participant Evaluation (PDF) or (Word) Tennessee ADRC The Tennessee ADRC administers this short survey to their Advisory Committee to gauge the effectiveness of their meetings. Added Nov-26-2007 Process Evaluation Presentation (PDF) or (Powerpoint) Joy Livingston and Donna Reback, Flint Springs Associates This presentation for the July 26, 2007 Evaluation Peer Workgroup Call is about Process Evaluation. Ohio ADRN Evaluation Plan (PDF) or (Word) Ohio Aging and Disability Resource Network This is Ohio's Evaluation plan for their Aging and Disability Resource Network. Presentation: Evaluation Peer Workgroup for May 24, 2007 (PDF) or (Power Point) ADRC-TAE This presentation on Evaluating ADRC Cost Effectiveness was used on the May 24th Evaluation Workgroup Call. Guidance for ADRC Evaluation Plans (PDF) or (Word) The Lewin Group, ADRC-TAE This document provides guidance for ADRC grantees about the required components of the evaluation plan. This resource will provide guidance on what to include, and how to organize the elements, but this format may be tailored by each grantee. Elements to incorporate into the ADRC evaluation plan include: Overall Evaluation Approach, Project Objectives; Tasks; Indicators; Data Sources; Data Collection Methods; Timeline/Interval; Responsible Entity; and Instruments. Added Jan-23-2007 State Project Evaluation Guidelines for Assessing ADRC Project Progress and Accomplishments (PDF) or (Word) The Lewin Group, ADRC-TAE When ADRC grantees begin to systematically track the progress and accomplishments of their programs, this document provides assistance to evaluators by detailing an evaluation framework, suggested research questions, recommended minimum dataset elements, and data sources to address research questions useful. At a minimum, AoA and CMS request that all ADRC grantees include these research questions as part of their ADRC evaluation. This document also provides some additional potential indicators related to program goals for grantees that wish to expand the program evaluation beyond this minimum expectation to meet state/local needs and includes suggested a consumer satisfaction survey. ADRC Minimum Data Set Priority Levels (PDF) or (Word) The Lewin Group, ADRC-TAE This document and table was prepared by Lewin in response to several requests from grantees for more guidance regarding the data they need to collect and report to AoA/CMS through the Semi-annual Reporting Tool (SART). The table below presents the ADRC Minimum Data Set (MDS) Elements as they were outlined in the 2004 Evaluation Guidelines for Assessing ADRC Project Progress and Accomplishments side-by-side with the SART question or questions designed to capture these data. Each data element is assigned a priority ranking of Highest, Medium or Low. These priority rankings are designed to assist grantees in focusing their data collection efforts on the elements of the Minimum Data Set that are of the highest priority for AoA/CMS, and to assist grantees in prioritizing enhancements they might make to their information technology systems. Updated Dec-20-2006 ADRC-TAE Evaluation Plan Highlights from 2003 & 2004 Grantees (PDF) or (Word) The Lewin Group, ADRC-TAE This document presents selected highlights from 2003 and 2004 ADRC grantee evaluation plans. Updated Dec-20-2006 Measuring Options Counseling: Goals and Objectives Grid - Final Version (PDF) or (Word) ADRC-TAE, Evaluation Peer Workgroup This is the final version of the "Measuring Options Counseling" Goals and Objectives grid that was discussed on a series of Evaluation Peer Workgroup Calls in the fall of 2006. Added Jan-24-2007 DRAFT Evaluation Plan Highlights from 2003 & 2004 ADRC Grantees (PDF) or (Word) The Lewin Group, ADRC-TAE This DRAFT document presents selected highlights from 2003 and 2004 ADRC grantee evaluation plans. Added Jan-26-2006 NM ADRC Client Satisfaction Survey – Baseline Results (PDF) or (Word) New Mexico ADRC This document presents the baseline results from a client satisfaction survey developed by New Mexico ADRC project leadership during August 2005. The survey data was collected from September 7 to October 7, 2005. Added Jan-25-2006 NJ ADRC Consumer Satisfaction Survey Pre-Test Findings (PDF) or (Word) New Jersey ADRC This document details the results of the September 2005 pre-test of the New Jersey ADRC Customer Satisfaction Survey (CSS). The goal of the pre-test was to assess the ease of use of the survey with the priority population. Updated Feb-01-2006 NJ ADRC Customer Satisfaction Survey (PDF) or (Word) New Jersey ADRC The New Jersey ADRC Customer Satisfaction Survey (CSS) was developed by a state work group with input from county and consumer stakeholders, was pre-tested during September 2005. The survey was given in both the Atlantic County and Warren County pilot areas. Added Jan-25-2006
State Project Evaluation Guidelines for Assessing ADRC Project Progress and Accomplishments (PDF) or (Word) The Lewin Group, ADRC-TAE When ADRC grantees begin to systematically track the progress and accomplishments of their programs, this document provides assistance to evaluators by detailing an evaluation framework, suggested research questions, recommended minimum dataset elements, and data sources to address research questions useful. At a minimum, AoA and CMS request that all ADRC grantees include these research questions as part of their ADRC evaluation. This document also provides some additional potential indicators related to program goals for grantees that wish to expand the program evaluation beyond this minimum expectation to meet state/local needs and includes suggested a consumer satisfaction survey. Added Jul-25-2005 ADRC Minimum Data Set Priority Levels (PDF) or (Word) The Lewin Group, ADRC-TAE This document and table was prepared by Lewin in response to several requests from grantees for more guidance regarding the data they need to collect and report to AoA/CMS through the Semi-annual Reporting Tool (SART). The table below presents the ADRC Minimum Data Set (MDS) Elements as they were outlined in the 2004 Evaluation Guidelines for Assessing ADRC Project Progress and Accomplishments side-by-side with the SART question or questions designed to capture these data. Each data element is assigned a priority ranking of Highest, Medium or Low. These priority rankings are designed to assist grantees in focusing their data collection efforts on the elements of the Minimum Data Set that are of the highest priority for AoA/CMS, and to assist grantees in prioritizing enhancements they might make to their information technology systems. Added Jul-26-2005 ADRC Evaluation Plan Best Practices (PDF) or (Word) The Lewin Group, ADRC-TAE This document highlights examples of best practices in 2003 ADRC evaluation plans. Added Jul-26-2005 ADRC Guidance for Evaluation Plans (PDF) or (Word) The Lewin Group, ADRC-TAE This document shares some critical elements associated with the description of the data elements that states should include in their Evaluation Plans. Added Nov-04-2004 Massachusetts Evaluation Plan (PDF) or (Word) Massachusetts This document details Massachusetts's plan for evaluating their ADRC, including objectives, tasks, data sources, indicators and indicator types. Updated Nov-04-2004 Maryland Evaluation Plan (PDF) Maryland This document details Maryland's plan for evaluating their ADRC, including research questions, impact, baseline data, and data to be collected. Added Nov-04-2004 Created by: vanee last modification: Tuesday 29 of July, 2008 [19:34:42 UTC] by sarah.lash |
