Post on 26-Dec-2015
1
“Survey Says?”
A Survey of the ATI Pilot E&IT Procurement Process at
Sacramento State
Accessible Technology Initiative
2
Best Practices Agenda
• Problem and description • Who is involved? • Technology involved • Results • How does it scale?• Unanticipated obstacles & benefits• Future improvements • Questions & Comments
Problem & Description
Problem: • Part of the Accessible
Technology Initiative (ATI) Procurement Plan was to develop a pilot process and evaluate the process
• Using assessment to shape decisions is a key strategic priority at Sacramento State
Description of Practice:
• An online survey for those involved in the pilot process
• Surveys can be quick, easy for respondents
• Online surveys can provide real time access to responses and summaries for administrators
3
4
Technology: Survey Tool
• A web-based survey on the ATI pilot procurement process was developed http://CTLSilhouette.wsu.edu/surveys/ZS80209
• Flashlight Online Survey Tool - institutional membership
• Flashlight resources and FAQs at http://www.csus.edu/atcs/tools/onlinesurveys/resources.stm#tutorials
• New version of Flashlight is accessible
5
Who is Involved
Survey Respondents: Requestors of IT purchases, IT Consultants, Administrative Support, BuyerSurvey Administrator: ATI CoordinatorGetting a Good Response Rate (~70%)
1. Contacted each person individually2. Made survey anonymous3. Provided contact information for questions
or concerns (ati@csus.edu)4. Mentioned that the survey was short (5 min) 5. Explained that the survey results could help
improve the process
6
Survey Results
• www.csus.edu/accessibility/prosurvey.doc • 71% recommended online training for
learning about accessible E&IT procurement• 64% indicated that vendors were not
familiar with VPATs • 71% indicated that they understood the
CSU accessible E&IT procurement requirement (this needs to be further assessed)
• 50% found the ATI procurement documentation on the Accessibility web page; 43% found it on the Procurement web page
7
Survey Results - Comments
• “Ensure that there is someone who I can contact if I have a question/issue regarding the requirements/process”
• “Continuing education in the form of online training, group training and even newsletters help”
• “Procurement might want to maintain a list of vendors through which frequent & high value purchases are made.”
• “I'd like a link on the [Accessibility] home page that gives a brief overview of the procurement requirements, etc.”
8
How to Use Results to Make Campus ImprovementsA. Added enhancements to Accessibility web pageB. Plan to develop and offer web-based training in
addition to group and individual trainingC. Linked to documentation from both the
Accessibility and Procurement web pages D. Ensure that there is a specialist to contactE. Need to streamline accessibility review processF. Maintain list of frequent/high value IT vendors G. Need to provide education for vendors H. Need additional ATI awareness & educationI. ATI compliance position to design “action plan”
9
Scalability of Results to the CSUA. Shows need to develop shared web-based training
on accessible IT procurement process B. Points to evidence that more vendor education and
training on VPATs is neededC. Suggests importance of a centralized list of
vendors and consistent communication D. Recommends continuing education in the form of
both online and group trainingE. Recommends importance of having an ATI
procurement specialist to contactF. Recognizes need to continue ATI awareness &
education about accessible E&IT procurement
10
Some Unanticipated Obstacles and Benefits
Obstacles:• Survey results don’t capture time/effort
involved in accessible IT procurement• Survey didn’t assess understanding of 508
definitions, exceptions Benefits: • Survey results can help gauge attitudes• Survey provided education about process• Opportunities for collaboration
11
Future Improvements
Need to assess knowledge of Section 508 and requirements for accessible IT procurement
Need to assess understanding of 508 exceptions and alternate access plans
Need more feedback about support needed More accessible version of survey software Survey methodology improvements Better follow up and sharing of results Need to better assess procurement training
activities What other activities could be assessed?
12
Assessment Resources and Tools
• Educause General Assessment Resources:– http://connect.educause.edu/term_view/
Assessment+and+Evaluation • Online Assessment Tools: Do They Work for
Students with Disabilities?– http://connect.educause.edu/Library/Abstract/
OnlineAssessmentToolsDoTh/45599
• Survey Tools: – Flashlight www.tltgroup.org/flashlightP.htm
– Accessibility Survey of Survey Tools: www.wac.ohio-state.edu/workshops/survey_of_surveys/