VOYAGE PROJECT “Voyage Platform Evaluation Report” · 2018. 5. 16. · The Voyage Platform...

1

Project acronym: VOYAGE

Project title: Opportunities for the Young and Graduates Employability in Vietnam

Agreement number: 561656-EPP-1-2015-1-IT-EPPKA2-CBHE-JP (2015 - 3156 / 001 – 002)

Starting date: 15/10/2015 Ending date: 14/10/2018

VOYAGE PROJECT

“Voyage Platform Evaluation Report”

WP.3.2.

-April 2018-

This project is funded by the European Commission. This publication reflects only the view of authors

and the Commission cannot be responsible for any using of the information contained therein.

2

I. Introduction

The Voyage Platform Evaluation Report is the result of assessment activities carried out by the Project

Consortium members within the framework of 561656 Voyage project “Opportunities for the young

and graduates employability in Vietnam” led by AlmaLaurea Interuniversity Consortium (Bologna, Italy).

The Associated Partner Unioncamere Emilia Romagna-UCER had an active role in the assessment

activites carried out through focus group on October 2017 at National University of Art Education

(NUAE) in Hanoi, Vietnam.

The report summarizes the results of the Pilot evaluation of the VOYAGE platform; the assessment

activities have been carried out through the delivery of ad hoc questionnaire to the target groups –

students and companies registered in the Voyage Platform1 - and to focus groups aimed at improve the

results from the questionnaire with suggestions and recommendation related to platform tune up.

The focus groups took place in Hanoi, Vietnam at NUAE (National University of Arts Education)

University on October 2017 and was coordinated by AlmaLaurea in collaboration with Hanoi Industrial

Export Processing Zones Authority - Center for Enterprise Support and Services (HIZA-CES), both

member of the Voyage project consortium.

The report collects the main results of the assessment activities:

-replies to the Voyage Platform Assessment Questionnaire from 78 students coming from the 3 Partner

Universities of HANU, NUAE and PTIT and 20 companies

-observations and suggestion for Platform improvement resulting from the focus group with 20

companies and 40 students (selected as a sub group among Questionnaire respondents).

The report main contents are detailed below:

• Platform Evaluation by Students: main results

• Platform Evaluation by Companies: main results

1 The Voyage Platform is available at: https://voyage.hanu.vn/

https://voyage.hanu.vn/

3

• Annex I: Assessment Questionnaires Sample

• Annex II: VOYAGE Database report

The assessment activities with Voyage Platform Stakeholders have to be considered as a continuous

and sustainable activity; the evaluation questionnaires are made available on the Voyage Platform at

disposal of platform users, students and companies, interested in providing their feedback for platform’

improvement.

4

VOYAGE PROJECT project No. 561656-EPP-1-2015-1-IT-EPPKA2-CBHE-JP - ERASMUS+

CBHE

“Opportunities for the young and graduates employability in Vietnam”

VOYAGE platform Assessment, implemented by students from VOYAGE Vietnamese

Universities

Results

Drafted by the Universities of HANU, NUAE and PTIT

5

VOYAGE platform Assessment, implemented by students from Voyage Project

Vietnamese universities

78 students from Voyage Project Vietnamese universities took part to the fill out of the pilot evaluation questionnaire, starting from June 2017. The questionnaires were collected in order to draft the present report and to have the baseline for the focus group during the meeting at National University of Art Education (NUAE) in Hanoi, Vietnam, October 2017. 40 students (selected as a sub group among Questionnaire respondents) also gave their opinion during the focus group organized in Hanoi. The Report analyses the results of the analysis of the questionnaire filled by the students' and reports main suggestions and consideration from the focus group.

Results from Questionnaire’ Sections: VOYAGE FEEDBACK FORM for Students’ and Graduands

Placement Services Online CV Creation, Job Search and Application Tools

Please provide us with your feedback (your comments and suggestions are very precious).

Section 1. Online CV Creation 1. How do you rate the Online CV Creation tool?

1. Very useful 45 57,69% 2. Quite useful 33 42,31% 2. Not very useful 0 0,00% 3. Not at all useful 0 0,00% TOTAL 78

6

2. Do you find useful the parameters for the creation of your CV?

[1] [2] [3] [4]

Very useful

Quite useful

Not very useful

Not at all

useful Education 52 24 1 0 66,67% Studies abroad 14 30 29 5 17,95% Work experiences 53 21 4 0 67,95% Language skills 42 32 3 0 53,85% Technical skills 19 45 9 5 24,36% Personal skills 27 49 2 0 34,62% Activities, publications and credits 13 53 7 4 16,67%

Attachment 40 26 10 0 51,28% Preffered job 24 49 3 4 30,77%

7

3. What CV parameters would you like to add?

At this open question it was only one answer: “portrait image”

4. What CV parameters would you like to cancel? No answers at this question. 5. Do you find easy and clear the CV creation process?

a) definitely yes 42 53,85% b) more yes than no 33 42,31% c) more no than yes 2 2,56% d) definitely no 1 1,28%

16,67%

17,95%

24,36%

30,77%

34,62%

51,28%

53,85%

66,67%

67,95%

Activities, publications and credits

Studies abroad

Technical skills

Preferred job

Personal skills

Attachment

Language skills

Education

Work experiences

2. Do you find useful the following parameters? (answer 1: very useful)

8

6. Are you satisfied with the CV format?


b) more yes than no65,38%

a) definitely yes

29,49%

c) more no than yes

3,85%d) definitely no

1,28%

6. Are you satisfied with the CV format ?

9

7. Do you find useful the enable/disable alerts and CV visibility?


8. Do you find useful for applying to a position and for finding a job to have possibility to fill out the CV in more than one language?


10

9. Do you find useful a standardization of CV contents (Europass format) for trans-national application?


11

10. How do you rate the Job Search Tool?

Very useful 39 50,00% Quite useful 30 38,46% Not very useful 8 10,26% Not at all useful 1 1,28%

Section 2. Job Offer and Application Tools

11. Do you find useful the Job offer page?


12

12. How do you rate the job offer details?

a) very good 25 32,05% b) good 42 53,85% c) fair 9 11,54% d) poor 1 1,28%

13

13. What job offer details would you like to add?

No answers to this open question.

14. How do you rate the Application tools/CV Sending tool?

Very useful 17 21,79% Quite useful 47 60,26% Not very useful 13 16,67% Not at all useful 1 1,28%

15. Do you find useful to personalize your CV by keeping unchanged the main CV?


14

16. Do you find the VOYAGE system better or worse than other portals for similar purposes?

a) better 28 35,90% b) worse 4 5,13% c) quite similar 45 57,69%

15

Platform Assessment with VOYAGE students: Key significant outcomes from Questionnaires and

Focus Group

The pilot evaluation of the platform by the students gives a very positive evaluation of the VOYAGE

platform and of its functionalities. Most of them assess the placement service the online CV creation

70% very useful, Job search and application tool, very useful: 52,50% and quite useful 32,5%.

What is more, most of the respondent students (58,97%) consider the VOYAGE system conceived better

that the other portals usually used for similar purposes (placement services and online job application).

The reasons provided are the innovative and realistic character of the platform and its completeness.

The informative/dissemination campaign done by the VOYAGE universities that helped the students to

get familiar with the platform is also an explanation for a better conceive of the platform.

The preliminary assessment also emphasize some useful consideration for both the improvement of

the evaluation questionnaire and of the platform. While the latter issue mainly highlights the suggestion

to simplify the interface and the future making of the platform more user friendly, concerning the first

point, students results highlights the need to review some questions as follow:

Question 3. “What CV parameters would you like to add?”

There was only one reply to that open question (“portrait image”).

To all other open questions there were no answers.

Suggestions: in order to increase the efficacy of the platform, the questionnaire should be spread

among a larger community of students registered on the platform in order to increase the number of

feedbacks received, seeing that students/graduates are the main beneficiaries of the Voyage platform.

Another issue is to understand why then students/graduates consider the Voyage Platform similar to

other portals (see question n. 16). Probably should be done more effort in explaining them that,

although the scope of the platform is similar to other portals (matching supply and demand of labour)

one of the most important advantage of the present platform is that the part of the CV regarding the

16

academic career of each students/graduate is certified by the University of belonging and the platform

represent in the same time a useful tool for the assessment of the quality in the Vietnamese Higher

education system as well as an important tool for statistical purposes.

Hereinafter the most relevant contributions issued from the focus group with students:

- Students expressed their willingness to customize their CV uploaded on the project web platform

rather than to use a standard form. They have been explained that it is preferable to use a standard

form because this allow the registered firms to browse all the CV and mobilize the same search

parameters so to identify the one(s) that best match their recruitment needs.

- Students have agreed on the opportunity to specify in their CV their career expectations and their

willingness to travel for working reasons, two key elements highlighted by firms at the issue of the firms’

focus group.

- Students are available to add to their CV a short video presentation (as an optional modality), so to

try out their creativity and same time.

- Students suggested improving the use of social networking by partner universities so to maintain the

links with them once graduated, in order to keep their CV up-to-date throughout their career.

17

VOYAGE PROJECT project No. 561656-EPP-1-2015-1-IT-EPPKA2-

CBHE-JP - ERASMUS+ CBHE “Opportunities for the young and graduates

employability in Vietnam”

VOYAGE Platform assessment, implemented by enterprises in Hanoi

Results

Drafted by Hanoi Industrial Export Processing Zones Authority - Center for

Enterprise Support and Services (HIZA-CES)

18

Pilot evaluation of the VOYAGE platform,

implemented by enteprises in Hanoi Results

20 enterprises in Hanoi took part to the fill out of the pilot evaluation questionnaire. The evaluation process was organized by inviting the enterprises to fill the questionnaire and send it by e-mail; enterprises who does not sent it by e-mail were invited to fill the questionnaire during the focus group that took place on second day of the NUAE meeting in Hanoi (October 2017).

Results from Questionnaire’ Sections: VOYAGE FEEDBACK FORM for Enterprises:

Section 1. Online CV Search

• How do you rate the Online CV search tool?

Quite useful 15 88%

Not very useful 2 12%

Not at all useful 0 0%

TOTAL 17 100%

19

2. Do you find useful the following search parameters?

Very useful Quite useful Not very useful Not at all useful

citizenship 7 7 5 1

country of residence 5 8 6 1

place of residence 4 12 4

gender 6 9 5

age 6 11 2

degree level 13 7

university 14 5 1

institute 12 8 1

programme 5 9 2

data of degree 8 7 4

degree mark 12 5 2

mention (honors) 8 9 2

age at graduation 4 13 2

category 13 6

area 11 7 1

level 10 6 2

Language skills 14 4 1

Work experiences 14 3 2

21

Percentage of enterprise evaluate very useful the following search parameters

5. Do you find easy and clear the CV search process?

Definitely yes 10 56%

More yes than no 7 39%

More no than yes 0 0%

Definitely no 1 6%

TOTAL 18 100%

22

Question 6 - Are you satisfied with the CV format to be viewed before the saving process?




Definitely no 0 0%

TOTAL 17 100%

23

Question 7 – Do you access as a clear and useful the CV format with its all contents




Definitely no 0 0%

TOTAL 18 100%

24

Question 8 – Do you find the VOYAGE system time-deducing respect other e-recruiting portals?




Definitely no 1 6%

TOTAL 18 100%

25

Question 9 – Convenience of using Voyage’s website than another

Better 8 50%

Worse 3 19%

Quite similar 5 31%

TOTAL 16 100%

26

Section 2. Job offer posting

Question 1 – How do you rate the Online Job Offer Posting tool?

Quite useful 16 84%

Not very useful 3 16%

Not at all useful 0 0%

TOTAL 19 100%

27

Question 2 – How do you judge the following aspects of VOYAGE job posting facility?

Overall assessment of the service

VG 6

QG 13

QB 1

VB 0

Exhaustiveness of job offer info supplied

VG 4

QG 15

QB 1

VB 0

Format and graphic quality of job posting form

VG 4

QG 14

QB 2

VB 0

28

Section 3. Price policy

Question 1 – Have you ever used the online recruitment services to employee people for your company?

Yes No

TOTAL 12 6

Percentage 67% 33%

29

Question 2 – What services have you used?

CV data base online 7 32%

Job posting services 11 50%

Other 4 18%

TOTAL 22 100%

30

Question 7 – As you know the VOYAGE platform is free charge for users. If you are asked for a contribution, how much would you be willing to pay for using the Platform for downloading of 100 CV per year using the VOYAGE ploatform?

LEVEL TOTAL PERCENTAGE

900.000 - 1.800.000 Too high 0 0%

Adequate 6 86%

Too low 1 14%

1.800.000 - 3.000.000 Too high 2 17%

Adequate 10 83%

Too low 0 0%

3.000.000 - 4.500.000 Too high 3 43%

Adequate 4 57%

Too low 0 0%

31

Question 8 – Please express your opinion of the follwing prices for the publishing of 1 job-offer on the VOYAGE platform

LEVEL TOTAL PERCENTAGE

900,000

Too high 0 0%

Adequate 6 86%

Too low 1 14%

1,400,000

Too high 2 17%

Adequate 10 83%

Too low 0 0%

1,800,000

Too high 3 43%

Adequate 4 57%

Too low 0 0%

32

Platform Assessment with VOYAGE companies: Key significant outcomes from Questionnaires and Focus Group.

In the 1st section, the pilot evaluation of the platform by the enterprises gives a quite positive evaluation of the VOYAGE website and of its functionalities and convenience. 88% of respondents assess that the online CV search tool is quite useful. In detail, up to 70% of respondents evaluate that working experiences, language skills, university are the most useful categories in CV. On the contrary, age at graduation, place of residence and country of residence got quite useful assessments at 21%, 20%, 25%, respectively. It be lead to 44% of respondents evaluated that all contents of CV are clear and useful. As can be seen, there should have some adjustments in CV format to satisfy more users.

In the 2nd section, 84% of respondents rated that the online offer are quite useful tool. In detail, overall assessment of the service, exhaustiveness of job offer info supplied, format and graphic quality of job posting form are three quite good aspects.

33

Regarding to price policy, online recruitment service is so popular tool to recruit labor for human resource management. The result showed that 67% have used this tool. Moreover, respondents using job-posting services accounted 50% which are higher than CV data base online. For fee charge, 1,800,000 – 3,000,000 VND for 100 CVs download and 1,400,000 VND for 1 job-offer posting are the most reasonable levels for respondents.

*** Open questions:

Part 1:

Question 3 – What kind of search parameters would you like add?

There are 4 comments as follows:

- language certificate (English, Japanese, Korean, etc);

- attach CV ( for IT candidate, attach project or workshop);

- ability about microsoft office, working skills, strong/weak points; expected salary;

- specialist certificate

Question 4 - What kind of search parameters would you like to delete?

There is 1 comment as country of residence

Part 3:

Question 3: If you used CV data base online how many CV did you download in average per year?

There are 7 answers, as follows:

- 100

- 50

- 16000

- >100

- 80

- 700

34

- >2500

Question 4: What was the average price for the CV downloaded?


- free dowloading CV package

- don’t know

- free

- free

- using package service

Question 5: If you used job-posting services how many offers did you usually publish on-line per year?


- 5

- unlimited

- 20-30

- 20

- 1

- 2

- 20

- 10-15

- >100

Question 6: What was the average price for the job posting?


-25-30 millions/year

- 25-30 millions/year

- 1.5 million/job

- free

- 3 million

- 2.5 million

35

- 4 million/job

- 1.6 million/job

- 1 million/job

Results from the focus group with companies

During the second day of the meeting that took place at NUAE in Hanoi (October 2017) the focus group

with enterprises it was very useful for all stakeholders: enterprises, students and universities that are

part of the Voyage Project.

Hereinafter the most relevant contributions issued from the discussion with enterprises:

- Firms suggested enlarging the “company business sector” field in the registration form on the web

platform, so to include those sectors not yet included in the scroll-down menu, in order to allow any

firm to get registered.

- Firms suggested the partner universities to get in touch with their alumni through social networking

in order to encourage them to keep their CV up-to-date once graduated.

- Firms highlighted that at least two additional parameters should be added in the students’ CV on the

web platform: career expectations and willingness to travel for working reasons, because these are

among the first requirements asked during a job interview in Vietnam.

- Firms ask to add a new functionality on the web platform so to be allowed to send a newsletter to the

registered students interested in specific career expectations.

As well, took place the focus group with students, based on the filled questionnaires regarding the

platform assessment (78 questionnaires).

Hereinafter the most relevant contributions issued from the discussion:

- Students expressed their willingness to customize their CV uploaded on the project web platform

rather than to use a standard form. They have been explained that it is preferable to use a standard

form because this allow the registered firms to browse all the CV and mobilize the same search

parameters so to identify the one(s) that best match their recruitment needs.

36

- Students have agreed on the opportunity to specify in their CV their career expectations and their

willingness to travel for working reasons, two key elements highlighted by firms at the issue of the firms’

focus group.

- Some students are available to add to their CV a short video presentation (as an optional modality),

so to try out their creativity and same time.

- Students suggested improving the use of social networking by partner universities so to maintain the

links with them once graduated, in order to keep their CV up-to-date throughout their career.

37

Annex II VOYAGE Database Report

The report collects main data related to the VOYAGE platform for quality assurance and employability,

at April 2018. Information relates to the database population and its usage by the main users: VOYAGE

University’ Graduates and Vietnamese companies. Among the main indicators (benchmark) reported

in the present report: number of registered graduates, filled out questionnaires, rate of questionnaire

completion, CV searched and downloaded, N of active companies and CVs downloaded. VOYAGE data

and information are taken from the online VOYAGE platform data warehouse2 that provides continuous

and updated data on the platform according to the aforementioned set of indicators. Following a brief

remind on platform data collection methods and usage, the report show main indicator in different

project’ moments. Voyage Platform was hosted at AlmaLaurea premises till September 19, 2017 when

it was successfully transferred in Vietnam and hosted by the University of HANU. Collection of data

follows the full activation of the VOYAGE platform for both students and companies.3

Contents

1. The VOYAGE Platform: Introduction

2. The VOYAGE Platform: Data Warehouse

3. The VOYAGE Platform: Indicators

4. VOYAGE Platform: Recommendation

This project is funded by the European Commission. This publication reflects only the view of authors and the Commission cannot be responsible for any using of the information contained therein.

2 VOYAGE platform available at: https://voyage.hanu.vn/. Data warehouse available in “staff area”. 3 System open up to students registration on June 2016 and fully activate for companies on December 2016.

https://voyage.hanu.vn/

38

1. The VOYAGE Platform: Introduction

Figure 1: VOYAGE webpage

VOYAGE Platform is the results of the combination of different information Provided by different “actors” at different time: graduands-below leaving the university, graduates and universities. Figure 2: VOYAGE information collection method

39

2. The VOYAGE Platform: Data warehouse

The VOYAGE platform (staff area section) for quality assurance and employability contains information

related to the database population and its usage by the main users: VOYAGE University’ Graduates and

Vietnamese companies.

Figure 3: VOYAGE platform for quality assurance (staff area section)

The VOYAGE platform collects and releases a set on indicators according to the following criteria:

by University:

Number of registered users and completed questionnaires by university

CV completeness

Number of registered users and percentage of CV completeness by university

Report by faculty and course:

Number of registered users, certificates degrees and completed questionnaires by faculty and

course of study

40

Report by date:

Count of students who have registered and completed questionnaires grouped by day

Student report by faculty and course:

Report by faculty and course of study with details for each student

Percentage of filling in the questionnaire for student:

Report with percentage of completion of the questionnaire and the count of the answers

given for each section for each student

Figure 4: VOYAGE Platform Data Warehouse

41

2. The VOYAGE Platform: Indicators

Data and indicators relates to 1st Project Period when the Platform was hosted at AlmaLaurea

Premises

Table 1. Students’ Registration and Questionnaire Completion (at June 2016)

Table 2. Students’ Registration and Questionnaire Completion (at September 2016)

Table 3. Students’ Registration and Questionnaire Completion at month of Platform Transfer in

Vietnam (September 2017)

Other Indicators at September 2017: 42 enterprises registered in the platform; 17 job offers published

Data and indicators relates to 2nd Project Period when the Platform was migrated in Vietnam and

centralized at HANU in September 2017

Voyage UniversitiesN of

Registered Students

N of CompletedQuestionnaires

N of Questionnaires completed more than 75%

% of Completed Questionnaires

% of Questionnaires completed more than

75%NUAE 219 92 84 42% 38%HANU 480 457 240 95% 50%PTIT 104 46 37 44% 36%Total 803 595 361


Registered Students





75%NUAE 638 567 326 89% 51%HANU 2378 1690 1576 71% 66%

PTIT 771 632 521 82% 68%Total 3787 2889 2423

42

Table 4. Students’ Registration and Questionnaire Completion (at October 2017)

Other Indicators at October 2017: 54 enterprises registered in the platform; 33 job offers published

Table 5. Students’ Registration and Questionnaire Completion (at April 2018)

Table 2. VOYAGE Graduates CVs completed and visible to companies (at April 2018)

Table 3. Company area: indicators (at April 2018)


Registered Students





75%NUAE 640 568 326 89% 51%HANU 2388 1691 1576 71% 66%PTIT 1551 1028 838 66% 54%Total 4579 3287 2740

VOYAGE UniversitiesN of Registered Students

N of Completed Questionnaires

N of Questionnaires Completed more than 75%

%of Completed Questionnaires

%of Questionnaires Completed more than 75%

NUAE 640 569 326 89% 51%HANU 2393 1691 1576 71% 66%PTIT 1824 1212 990 66% 54%Total 4857

VOYAGE UniversitiesN of Registered Students

CV completed and made visible to companies

% of VOYAGE students CVs available to companies

NUAE 640 523 82%HANU 2393 1677 70%PTIT 1824 1343 74%Total 4857 3543

Company DATA

N of companies registered 65

N of active*Companies 63Products unlimited CVs downloadN of CVs downloaded 13296N of CVs Searches performed 117Job Offer Published 40

43

Main consideration

The data show a continuous increase of records in the platform, both in terms of students registration

and in terms of company registration, the last more marked following the transfer of the platform in

Vietnam: from September 2017 the number of companies increases as well as the N of job offer

published. This is a good result of the dissemination activities carried out in Vietnam towards

representatives from the businees world as well as the results of intensive dissemination towards the

students done by the Vietnamese universities within the Consortium.

Also the N of registered graduates and graduands, which accounted for 710 at the time of the first

registration (june 2016) increases 5 times in almost one year and a half reaching 3800 students at the

time of platform transfer in Vietnam (september 2017) and overcome the indicator set in the LFM by

reaching the N of 4900 at the time of the present report. It is sinteresting to know how most of the

students gave their consent for the visibility of their CVs to company, which emphasises their trust for

the platform as an employability tool. Also, the platform includes graduands and not only graduates;

the choice is due to the fact that the Voyage CV has been and will be used for applying to internship

programs which can be curricula training to be performed during the academic studies.

44

4. VOYAGE Platform: Recommendation

The database testing report, based on the paltform data warehouse and its main indicators, show

positive results in terms of platform registration by main stakeholders (student and companies),

underlying how the dissemination activites have been carried out properly by the VOYAGE Consortium.

The N of CVs made at disposal to companies for employment purposes is a signal of trust of the tool by

the students, also arising from the Platform Assessment Report activities carried out.

The insteresting number of companies that registered in the platform and the N of CVs downloaded is

a very good achievement given that in Vietnam direct meeting with students at universities for finding

candidates to hire remain the main channel for companies.

The report also underline how expected outcome have been achieved according to the release of the

VOYAGE platform online for student and companies registration, in most cases overcoming

benchmarks4

As far as the future of the VOYAGE platform is concerned, it is relevant that the database population is

intended by users as continuous activity. This implies, beyond project life, the population of the

VOYAGE database’ both in terms of quantity of data and the continuous improvement of the quality of

the information provided. Also, it would be interesting to use the platform for promoting internship

opportunities to students and organize dissemination event for presenting the platform and promoting

it as an alternative channel for recruiter; exibition might be a strategy for NUAE students giving their

particular background in art education. It is auspicable that new universities join the Consortium so to

increase the N of students and the kind of profiles available to companies and to release statistical

surveys on graduates profile as an updated picture of the National situation.

4 N of students registered higher than the indicator set in LFM (4857 against 4600 in LFM at month 27); N of companies registered in Voyage Platform (65) higher than the indicator set in LFM (20 companies involved in market place).

VOYAGE PROJECT “Voyage Platform Evaluation Report” · 2018. 5. 16. · The Voyage Platform...

Documents

Transcript of VOYAGE PROJECT “Voyage Platform Evaluation Report” · 2018. 5. 16. · The Voyage Platform...