Decision Making tool for Grant Award Agencies

15
© 2011-2013 Valid Evaluation, Inc., all rights reserved. Transparency and Defensibility for Grant-Awarding Agencies Evidence of the right outcome

description

Learn how Valid Eval provides an easy-to-use online evaluation system that makes decision-making visible, outcomes defensible and feedback actionable. Unlike other feedback mechanisms, only Valid Eval reduces subjectivity through the use of rigorous, purpose-built rubrics and a novel process that facilitates transparent deliberation.

Transcript of Decision Making tool for Grant Award Agencies

Page 1: Decision Making tool for Grant Award Agencies

© 2011-2013 Valid Evaluation, Inc., all rights reserved.

Transparency and Defensibility for Grant-Awarding Agencies

Evidence of the right outcome

Page 2: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Valid Eval is an online evaluation system for government organizations awarding grants. It makes decision-making visible, outcomes defensible and feedback actionable.

2

Page 3: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

When you’re responsible for making tough decisions about who should be awarded a grant, you need to know you’ve arrived at the right result.

More importantly, you need others to know it. Confidence in the outcome begins with a trusted evaluation process. And that process begins with the Valid Eval online evaluation system.

Valid Eval is designed for organizations that must make and defend tough grant award decisions. The system is easy to use, minimizes bias and provides highly useful feedback to participants.

Valid Evaluation...

• Increases your efficiency when working with review panels / committees

• Protects your programs’ viability in the long term with transparency and defensibility

• Surfaces and organizes your complex grant-awarding criteria

• Is an elegant, web-based software hosted on Amazon Cloud Services

3

Page 4: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved 4

TESTIMONIAL

“We are starting our forth consecutive engagement with Valid Eval for our $1.5M small business grant program.

Our expert volunteer judges are impressed with the tool's intuitive design and its efficiency.

As program managers, we love the quality of the feedback it delivers to our applicants, and the transparency we achieve in our decision-making.

The Valid Eval team is invested in our success and is very responsive to our needs. We are excited to be working with them.”

Brian ShermanSVP of Business DevelopmentArizona Commerce Authority

Page 5: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Customers to Date

5

Government Agencies

Universities IncubatorsNon-Profits

Page 6: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved 6

Legacy Tools

Page 7: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Legacy decision-making is:

• Opaque, subjective and biased

• Vulnerable to attack (Solyndra)

• Not designed for learning

7

Page 8: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

A look at our product

Screen shots on following pages:

8

Page 9: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Visible Decision-Making

A

The Box-Plot gives scores context, showing precisely where a team scored in any dimension compared to the applicant pool.

The Score Distribution graphically shows how each judge scored this team.

Freeform comments allow reviewers to add nuanced thoughts to the discussion.

A

B

B

C

C

Page 10: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Actionable Feedback

Here four judges’ scores are summarized.

Darker colors point to areas of high agreement among judges: so-called trustworthy feedback.

Meanwhile, this row indicates a lack of strong agreement among reviewers. This could be an area for discussion during decision-making.

F

G

F

G

H

H

Page 11: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Defensible Outcomes

11

High Score & Low Score columns quickly identify the strongest supporter and strongest detractor, setting the stage for discourse.

The Most Contested Dimension(s) further helps guide the discussion to specific topic areas.

D

E

D E

Page 12: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

“Outlier Judge” Report“Team Analysis” view goes deeper than the previous screenshot.

Various ranking scenarios aid in consensus-building

Outlier judges—if any—appear here. The definition of “outliers” is configurable on the fly.

“Judge Analysis” view looks at the same data through the lens of your judges rather than the “teams.” This helps close the loop with those whose judgements tend to be out of line with consensus.

I

J

F

G

K

H

I J

K

LL

Page 13: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Founders & Partners

13

Adam Rentschler • CEO• Serial entrepreneur. Recovering VC. • Business development expertise• Trained as an engineer, financier

Todd Reimer, Ph.D.• Learning Scientist• Cognition & motivation expert• Performance assessment author• Professor of Education

Kent Hollrah• Designer• Walt Disney Imagineer• IDEO alumnus• Former RMCAD faculty,

Communication Design

HiDef, Inc.• Software development team

Posit Partners• Strategic marketing

Page 14: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

Product Demo

Evaluation Mechanics Video (3:24)

The link above is only training your expert evaluators need for the intuitive Valid Eval system.

Roughly 600 reviewers have been successfully trained to our the system with only this video.

14

Page 15: Decision Making tool for Grant Award Agencies

© 2011 - 2013 Valid Evaluation, Inc. All Rights Reserved

More information

• Our website has a 90-second intro video that will give you a bit more color https://www.valideval.com

• Our product page https://www.valideval.com/product.html provides a deeper look at functionality.

• Questions? Email [email protected]

15