Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin,...

64
Presented By Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA Training HUD’s eLogic Model

Transcript of Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin,...

Page 1: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Presented ByPresented ByBarbara Dorf, Office of Departmental Grants Management and Oversight

Manuel Valentin, Center for Applied Management Practices

HUD 2010 NOFA Training HUD’s eLogic Model

Page 2: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

What is the HUD eLogic Model?

• The HUD eLogic Model is a tool that provides a “bottoms up” approach to finding out what makes a good program.

• It identifies– What works?– What does not work?– What are the associations between

eligible services/activities and intended outcomes?

Page 3: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

What is the HUD eLogic Model?

• The eLogic Model is a tool that integrates program operations and program accountability.

• It can be used to manage, monitor and evaluate program services.

Page 4: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

What is the HUD eLogic Model?

• The eLogic Model :• Is about active management, not

compliance.• It can provide a real time snapshot of

your program. • It can be used to internally monitor

activity in addition to its use as a reporting tool.

Page 5: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

What is the HUD eLogic Model?

• Provides common/global Needs, Services/Outputs, and Outcomes

• Used in planning, monitoring, and reporting.

• Data can be analyzed to improve decision making.

Page 6: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

What is the HUD eLogic Model?

• Supports allocation of resources.

• Determines what works and what does not.

• Identifies the relationship between the service and the intended outcome.

Page 7: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s Strategic Plan FY2010-2015

• Goal 1: Strengthen the Nation’s Housing Market to Bolster the Economy and Protect Consumers

• Goal 2: Meet the Needs for Quality Affordable Rental Housing

Page 8: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s Strategic Plan FY2010-2015

• Goal 3: Utilize Housing as a Platform for Improving Quality of Life.

• Goal 4: Build Inclusive and Sustainable Communities Free from Discrimination.

• Goal 5: Transform the Way HUD Does Business

Page 9: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s 2010 General Section Policies and Priorities

• HUD is seeking grant applications that align with HUD’s Strategic Goals by establishing cross-cutting policy priorities.

• Each NOFA specifies the policy priorities applicable to the program and the points allocated.

Page 10: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s 2010 General Section Policies and Priorities

• Applicants that undertake specific activities and outcomes to further HUD goals will receive a higher priority in the selection process.

Page 11: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s 2010 General Section Policies and Priorities

Page 12: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s 2010 General Section Policies and Priorities

Page 13: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD’s 2010 General Section Policies and Priorities

Page 14: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and Priorities Job Creation/Employment

Page 15: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesSustainability

Page 16: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesSustainability

Page 17: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesSustainability

Page 18: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesAffirmatively Furthering Fair Housing

Page 19: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesCapacity Building and Knowledge Sharing

Page 20: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesUsing Housing as a Platform for Improving

Other Outcomes

Page 21: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Policies and PrioritiesExpand Cross-Cutting Policy Knowledge

Page 22: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model

Page 23: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model New Features and Functions

• Coversheet

Page 24: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model New Features and Functions

Coversheet

Page 25: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model New Features and Functions

Coversheet

Page 26: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model New Features and Functions

eLogic Model

Page 27: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model

ActivitiesPolicy Priorities are integrated

into the Services and Outcomes dropdown.

Page 28: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD Policy Priority Are Integrated Into The Services And Outcome Dropdowns

Page 29: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

2010 HUD eLogic Model

Outcomes

Page 30: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

One to One RelationshipOne Service is Associated with One Outcome

Page 31: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

One to Many RelationshipOne Service is Associated with Many Outcomes

Page 32: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Many To One RelationshipMany Activities Yield One Outcome

Page 33: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Many to Many Relationship Many Services Yield Many Outcomes

Page 34: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Associating Activities Performed in Year 1 When the Outcome Occurs in Year 2

Leave These Fields Blank

Leave These Fields Blank

Year 1Year 1

Page 35: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Associating Activities Performed in Year 1 When the Outcome Occurs in Year 2

Leave These Fields Blank

Leave These Fields Blank

Year 2Year 2

Page 36: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.
Page 37: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

The HUD eLogic Model • The eLogic Model serves as an executive

summary of the entire grant application and a basis for monitoring and evaluation.

• HUD reviewers look at the statements in the HUD narrative and compare them to the completed Logic Model. They should match!

• Are there appropriate associations between services and outcomes?

• Are the numbers realistic?

Page 38: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD Staff Review and Analysis

• Are there appropriate associations between services and outcomes?

• Was a service selected where there was no HUD Outcome in the Dropdown Menu?

• When “new” or “other” was used for either a service or outcome, was “other “ appropriately defined and was the unit of measure appropriate.

Page 39: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD Staff Review and Analysis

• Data analysis allows a comparison of performance data for a grantee, across all PIH program grantees, and across similar HUD programs

Page 40: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Logic Model Performance Reporting for HUD Grant Programs

Performance data measures a grantee’s progress towards meeting their established benchmarks and outcomes.

Management questions provide unduplicated counts and can be used to determine program effectiveness, cost of services, management improvements, and benefits to clients and communities.

Page 41: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reporting TAB

Page 42: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reporting TAB

Page 43: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reginald Carter’s Seven Key Questions

1. How many clients/households are you serving?

2. Who are they?3. What services do you give them? 4. What does it cost? 5. What does it cost per service delivered? 6. What happens to the clients/households

as a result of the service?7. What does it cost per outcome?

Page 44: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reginald Carter’s Seven Key Questions

1. How many households are you serving? 100.

2. Who are they?Low-income households living in homes which have a need for lead abatement services.

3. What services do you give them?Lead Abatement interventions and blood lead level testing

Page 45: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reginald Carter’s Seven Key Questions

7. What does it cost per outcome? $100,000/100 homes = $10,000 per outcome

or $100,000/350 children under age 6 = $285.71

per child

We can measure: Cost-Q4, Efficiency-Q5, Outcome-Q6, Effectiveness-Q7

We can calculate a simple cost-benefit for delivery of the service:Q4/Q1=Q5

We can calculate a simple cost-benefit for the result of the service:Q4/Q6=Q7

Note: The Seven Questions adapted with permission; Reginald Carter.

Page 46: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

eLogic Model Database

• eLogic Model data is compiled into a Microsoft Access® database that supports individual program data analysis as well as aggregate agency data analysis.

• The database can be queried and used for analysis purposes.

Page 47: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

eLogic Model Data Grantee demographics Who, What Program, Location, Region, etc. What Activities Are Being Conducted What Outcomes Are Anticipated What Outcomes are achieved? How Long Does It

Take to Achieve? The database allows data to be queried/analyzed

by any combination of data elements that are collected by the eLogic Model

Page 48: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Examples of Database Analyses

• Analysis to determine whether particular service(s) yield particular outcome(s).

• Enables analysis to determine what works and what does not work

• Identifies relationships between services and outcomes

Page 49: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HBCU Examples of Database Analyses Activity and Outcome Associations

Page 50: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HBCU Data Analysis

• What the most frequently selected (top ten) Activities FY 07

Page 51: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HBCU Data Analysis • What the most frequently selected (top ten)

Outcomes FY 07

Page 52: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Data Analysis

• What Services and Outcomes are not being selected? Should they be dropped from the model?

• What Services and Outcomes did applicants add? Are they items that were not in the Logic Model. Are they needed additions?

Page 53: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD Staff Review and Analysis

• Are there differences between projections and actual achieved greater or less than 20%?

• Were projections underestimated (lowball) or overestimated?

• Were deviations greater than 20% the result of poor planning or events in the community?

Page 54: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Common Errors

• Many of the errors were a result of not following directions.

• File name too long and had special characters: File names must not be longer than 32 (characters, no spaces and no special characters.)

CALHB0383-08Y1Q4 Riverside County LHC LM - unlocked and sent 05-25-2010.xls

Page 55: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

When to Correct Common Errors

• Check eLogic Model for missing items before closing the model

• When saving the model make sure file name does have spaces, special characters or is longer than 32 characters.

• When negotiating your award statement of work with HUD staff

Page 56: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

When are Changes Made?

• Changes made for the grant agreement or work plan must be made to the Logic Model

• Amendment to Grant AgreementIf an amendment is made to a grant agreement

that changes the performance benchmarks, grantee must complete another Logic Model.

If the applicant has modified the Logic Model form, a new Logic Model has to be completed.

Page 57: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HBCU eLogic Model • In FY 2007, the Department of Housing and Urban

Development awarded 14 HBCU grants. Of these grant awards, 7 or 50% of the grantee Logic Models were submitted to ODGMO.

• In general, activities conducted by the 50% of the HBCU grantees who submitted Logic Models fall into four categories: Homeownership training/counseling, Construction Housing, Rehabilitation-Housing units, Literacy training, and Technical assistance training workshops.

Page 58: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reasons for Rejections

• Bad Template (use wrong FY template)

• Modified Template (workbook/worksheet)

• Bad filename (too long and/or used special characters

• Missing Applicant Legal Name

Page 59: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reasons for Rejection

• Missing projections• Missing actual • Missing Performance Period • Missing DUNS #• Entered invalid DUNS #

Page 60: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reasons for Rejection

• Missing YTD data• Missing project name• Missing project location• Missing project location state• Wrong Format Used in Date Field

(mm/dd/yyyy)

Page 61: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reasons for Rejection

• Projected Data entered in Actual/Outcome fields

• Unmerged Services/Outcome Field

• Length of the “New” Services/Outcomes Too Long

Page 62: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Reasons for Rejection

• Length of “New” Unit of Measure Too Long

• Modified Reporting Tab

Page 63: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

Purpose of Analysis

• Analysis to establish norms. This can be done for both projected and reported data.

• Established norms allow an individual agency to compare their performance against a group, especially if the norm has been derived from historical data.

Page 64: Presented By Barbara Dorf, Office of Departmental Grants Management and Oversight Manuel Valentin, Center for Applied Management Practices HUD 2010 NOFA.

HUD 2010 eLogic Model Training

Questions(Demo Follows)