THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ......

112
1 Ministry of Education, Science, Research and Sport of the Slovak Republic Ministry of Economy of the Slovak Republic THE SYSTEM OF MONITORING AND EVALUATION OF THE OPERATIONAL PROGRAMME RESEARCH AND INNOVATION The programming period 2014 – 2020 Managing authority and intermediary authority of the operational programme Research and innovation October 2015

Transcript of THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ......

Page 1: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

1

Ministry of Education, Science, Research and Sport of the Slovak Republic

Ministry of Economy of the Slovak Republic

THE SYSTEM OF MONITORING AND

EVALUATION OF THE

OPERATIONAL PROGRAMME

RESEARCH AND INNOVATION The programming period 2014 – 2020

Managing authority and intermediary authority of the operational programme Research and innovation

October 2015

Page 2: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

2

Contents

1 The system of monitoring and evaluation of the operational programme

Research and Innovation ............................................................................................ 7

2 Monitoring Tools ........................................................................................................... 8

2.1 Attributes measurable indicators ...................................................................................................... 8 2.2 Aggregation of measurable indicators ............................................................................................ 8

3 Aggregated monitoring OP RaI .................................................................................. 9

3.1 Direct substantive outputs .................................................................................................................. 9 3.2 Direct intangible outputs .................................................................................................................... 9 3.3 Innovation .......................................................................................................................................... 10 3.4 Development of business cooperation .......................................................................................... 11 3.5 Social Impacts .................................................................................................................................. 11 3.6 Financial effects ................................................................................................................................ 12 3.7 Environment – Energy ....................................................................................................................... 12 3.8 Information and communication .................................................................................................... 13 3.9 Categorization of recipient .............................................................................................................. 13

4 Intervention Logic ...................................................................................................... 14

5 Monitoring of demand-driven projects .................................................................... 16

6 Monitoring of financial instruments .......................................................................... 17

7 Monitoring of national projects ................................................................................. 18

8 Monitoring of information and communication ...................................................... 19

8.1 An opinion poll OP RaI ..................................................................................................................... 20

9 Glossary ...................................................................................................................... 21

10 The measurable indicators ........................................................................................ 24

10.1 Intervention logic and methodology of selection of measurable indicators ............................. 24 10.2 General principles estimation targets of measurable indicators ................................................ 25 10.3 Measurable indicators of outcome (result indicators) .................................................................. 26

10.3.1 The degree of awareness of the possibilities of support from the OP (R0025) ....................... 26 10.3.2 Number of participations in projects of international cooperation (R0042)........................... 27 10.3.3 The amount of private investment in research and development in Slovakia

except for the Bratislava region (R0044) ....................................................................................... 27 10.3.4 The amount of private investment in research and development in Bratislava

(R0045) ................................................................................................................................................. 28 10.3.5 Share of enterprises applying research, development and innovation (R0046) ................... 28 10.3.6 The share of enterprises with innovation activity in the Bratislava region (R0047) ................ 29 10.3.7 The survival rate of new businesses on the market after two years (R0048) ........................... 29 10.3.8 The share of SMEs in exports (R0049) .............................................................................................. 30 10.3.9 The rate of compliance with the time limits for making payments to beneficiaries

(R0116) ................................................................................................................................................. 30 10.3.10 Rate fluctuations administrative capacity (R0117) ..................................................................... 31 10.3.11 The rate of proper project implementation (R0119) ................................................................... 31 10.3.12 The number of patent applications in Slovakia except for the Bratislava region

(R0126) ................................................................................................................................................. 31 10.3.13 The number of patent applications in the Bratislava region (R0127) ...................................... 32 10.3.14 Number of publications entities from Slovakia in Web of Science and Scopus

Core Collection (R0128) ................................................................................................................... 32 10.3.15 Share of profit of SMEs in the Bratislava region (R0130) .............................................................. 33 10.3.16 The share of SMEs in creating added value in the private sector (R0171) ............................. 33

10.4 Joint measurable output indicators (common indicators) ........................................................... 34

10.4.1 The number of companies receiving support (CO01) ............................................................... 34 10.4.2 Number of enterprises receiving grants (CO02) .......................................................................... 34 10.4.3 Number of enterprises receiving financial support other than grants (CO03) ...................... 35 10.4.4 Number of enterprises receiving non-financial support (CO04) ............................................... 35 10.4.5 Number of supported new businesses (CO05) ............................................................................ 35 10.4.6 Private investment matching public support to enterprises (grants) (CO06)......................... 36

Page 3: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

3

10.4.7 Private investment matching public support to enterprises (excluding grants)

(CO07) ................................................................................................................................................. 36 10.4.8 The growth of employment in assisted companies (CO08) ...................................................... 37 10.4.9 Number of new researchers in assisted companies (CO24) ..................................................... 37 10.4.10 The number of researchers working in the renovated facilities of research

infrastructure (CO25) ........................................................................................................................ 38 10.4.11 Number of enterprises cooperating with research institutions (CO26) ................................... 39 10.4.12 Private investments linked to public support innovative projects or research and

development (CO27) ....................................................................................................................... 39 10.4.13 The number of companies receiving support in order to introduce products that

are new to the market (CO28) ....................................................................................................... 39 10.4.14 The number of companies receiving support in order to introduce products that

are new for the company (CO29) ................................................................................................. 40 10.4.15 Reduction of annual primary energy consumption in public buildings (CO32) .................... 41 10.4.16 The estimated annual reduction in greenhouse gas emissions (CO34) .................................. 41

10.5 Specific measurable output indicators (specific indicators) ....................................................... 42

10.5.1 The number of measures to reduce the administrative burden (O0048) ............................... 42 10.5.2 Number of supported research institutions (O0069) ................................................................... 42 10.5.3 Number of supported research institutions cooperating with companies (O0070) ............. 43 10.5.4 Number of reconstructed facilities of research infrastructure (O0071) ................................... 43 10.5.5 The number of applications for registration of intellectual property rights (O0072) ............. 44 10.5.6 The number of patent applications (O0073)................................................................................ 44 10.5.7 Number incurred start-up and spin-off companies (O0074) ..................................................... 45 10.5.8 The number of participants in advisory and training programs (O0075) ................................ 45 10.5.9 Number of supported cluster organizations (O0076) .................................................................. 46 10.5.10 Number of supported enterprises through advisory centers for SMEs (O0077) ...................... 46 10.5.11 Number of new SMEs established by people from disadvantaged social groups

(O0078) ................................................................................................................................................ 47 10.5.12 Number of supported SMEs run by persons from disadvantaged social groups

(O0079) ................................................................................................................................................ 47 10.5.13 Number of SMEs participating in fairs and exhibitions abroad (O0080) .................................. 48 10.5.14 Number of supported business and support platforms (O0081) ............................................... 48 10.5.15 Number involvement of SMEs in EU programs (O0082) .............................................................. 48 10.5.16 Number of enterprises receiving non-financial support in promoting the provision

of information, advisory and mentoring services for SME development (O0083) ................. 49 10.5.17 Number of enterprises receiving non-financial support in creating new business

models for creative industries (O0084) .......................................................................................... 49 10.5.18 Number of realized educational activities (O0163) .................................................................... 50 10.5.19 The number of administrative capacity financed by technical assistance

(O0175) ................................................................................................................................................ 50 10.5.20 Number of realized information activities (O0178) ...................................................................... 50 10.5.21 The number of public buildings at low energy or ultralow energy or nearly zero

energy needs (O0180) ...................................................................................................................... 51 10.5.22 The number of completed evaluations, analyzes and studies (O0181) .................................. 51 10.5.23 The share of administrative capacities equipped with material and technical

equipment of TP (O0182) ................................................................................................................. 52 10.5.24 Floor area of renewed beyond the minimum requirements (O0183) ..................................... 52

10.6 Financial indicators .......................................................................................................................... 52

10.6.1 Total amount of eligible expenditure for their certification by the certification

body (F0002) ...................................................................................................................................... 52 10.7 Key implementation steps ............................................................................................................... 53

10.7.1 Number of supported enterprises through advisory centers for SMEs (K0001) ....................... 53 10.7.2 Number of contracted research institutions (K0003) .................................................................. 53 10.7.3 Number of enterprises receiving non-financial support in promoting the provision

of information, advisory and mentoring services for SME development (K0004) .................. 54 10.7.4 Number of enterprises receiving non-financial support in creating new business

models for creative industries (K0005) ........................................................................................... 54 10.8 Measurable indicators at the project level (project indicators) .................................................. 54

10.8.1 Financial support “shortlisted” Horizon 2020 projects with Slovak participation

supported from OP RaI (P0054) ...................................................................................................... 54

Page 4: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

4

10.8.2 Financial support events to popularize the protection of intellectual property

rights and technology transfer (P0055) ......................................................................................... 55 10.8.3 The financial aid granted to promote the services of experts on intellectual

property and technology transfer (P0056) ................................................................................... 55 10.8.4 The financial aid granted to promote and registration of intellectual property

rights (P0057) ...................................................................................................................................... 55 10.8.5 Financial support to the reconstruction and modernization of research

infrastructure (P0058) ........................................................................................................................ 56 10.8.6 Financial support under the complementary financing of approved projects

Horizon 2020 with Slovak participation of OP RaI (P0059) .......................................................... 56 10.8.7 The growth of employment in assisted companies (P0091) ...................................................... 57 10.8.8 The estimated annual reduction in greenhouse gas emissions (P0103) .................................. 57 10.8.9 Number “shortlisted” projects under Horizon 2020 with Slovak participation

supported from OP RaI (P0124) ...................................................................................................... 58 10.8.10 The number of administrative capacity financed by technical assistance

(P0130) ................................................................................................................................................. 58 10.8.11 The number of activities to promote national system for technology transfer

(P0134) ................................................................................................................................................. 58 10.8.12 Number demonstration activities (P0147) ..................................................................................... 59 10.8.13 Number of other patent applications (P0170) ............................................................................. 59 10.8.14 Number of SMEs involved in EU programs (P0190) ...................................................................... 59 10.8.15 Number of returnees Slovak researchers from abroad (P0196) ................................................ 60 10.8.16 Number of new SMEs established by people from disadvantaged social groups

(P0205) ................................................................................................................................................. 60 10.8.17 The number of new researchers in assisted companies (P0231) .............................................. 60 10.8.18 Number of patent applications (P0280) ....................................................................................... 61 10.8.19 Number of new researchers in assisted companies (P0282) ..................................................... 61 10.8.20 Number of enterprises receiving financial support other than grants (P0283) ...................... 62 10.8.21 Number of enterprises receiving grants (P0284) .......................................................................... 62 10.8.22 Number of enterprises receiving non-financial support (P0285)............................................... 63 10.8.23 Number of enterprises receiving non-financial support in promoting the provision

of information, advisory and mentoring services for SME development (P0286) .................. 63 10.8.24 Number of enterprises receiving non-financial support in creating new business

models for creative industries (P0287) ........................................................................................... 63 10.8.25 Number of enterprises receiving support in order to introduce products that are

new for the company (P0288) ........................................................................................................ 64 10.8.26 Number of enterprises receiving support in order to introduce products that are

new to the market (P0289) .............................................................................................................. 64 10.8.27 Number of supported cluster organizations (P0295) ................................................................... 65 10.8.28 Number of supported SMEs run by persons from disadvantaged social groups

(P0301) ................................................................................................................................................. 65 10.8.29 Number of supported new businesses (P0302) ............................................................................ 66 10.8.30 Number of supported business and support platforms (P0303) ................................................ 66 10.8.31 Number of supported enterprises through advisory centers for SMEs (P0306) ....................... 67 10.8.32 Number of supported events, to increase the participation of Slovak Republic in

ERA (P0307) ......................................................................................................................................... 67 10.8.33 Number of supported participation of foreign researchers in the project

activities Slovak R&D institutions (P0315) ....................................................................................... 67 10.8.34 Number of supported participation of Slovak Republic in ERA (P0316) .................................. 68 10.8.35 Number of supported participation of SR in other international initiatives (P0317) .............. 68 10.8.36 Number of supported research institutions (P0325) .................................................................... 68 10.8.37 Number of supported research institutions cooperating with companies (P0326) .............. 68 10.8.38 Number of events organized to popularize the study of technical and natural

science (P0336) ................................................................................................................................. 69 10.8.39 Number of events organized for popularization of research and development

(P0337) ................................................................................................................................................. 69 10.8.40 Number of applications for registration of intellectual property rights (P0355) ..................... 70 10.8.41 Number of established services, tools and applications (P0359) ............................................. 70 10.8.42 Number of application solutions for experimental Cloud (P0377) ........................................... 71 10.8.43 Number of participating individuals and teams from Slovakia for “shortlisted”

Horizon 2020 projects with Slovak participation supported from OP RaI (P0434) .................. 71 10.8.44 Number of SMEs participating in fairs and exhibitions abroad (P0435) ................................... 71 10.8.45 Number of participants in advisory and training programs (P0442) ........................................ 72

Page 5: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

5

10.8.46 Number of UVP/VC involved in the creation and operation of technology

transfer centers and incubators (P0467) ....................................................................................... 72 10.8.47 Number of public buildings at low energy or ultranízkoenergetickej or nearly

zero energy requirement (P0469) ................................................................................................... 72 10.8.48 Number of creating centers for popularisation of research and development

(P0474) ................................................................................................................................................. 73 10.8.49 Number of built local centers for technology transfer (P0486) ................................................. 73 10.8.50 Number of built prototype devices and validation infrastructure in areas of

specialization RIS3 SK (P0499) .......................................................................................................... 73 10.8.51 Number of built facilities for research infrastructure (P0500) ..................................................... 73 10.8.52 Number of products that are new for the company (P0512) ................................................... 74 10.8.53 Number of products that are new to the market (P0513) ......................................................... 74 10.8.54 Number of researchers working in the renovated facilities of research

infrastructure (P0514) ........................................................................................................................ 75 10.8.55 Number of created experimental Cloud (P0521) ....................................................................... 75 10.8.56 Number incurred start-up and spin-off companies (P0535) ...................................................... 76 10.8.57 Number of established and improved services, tools and applications (P0560) .................. 76 10.8.58 Number of completed evaluations, analyzes and studies (P0588) ......................................... 77 10.8.59 Number of realized information activities (P0589) ....................................................................... 77 10.8.60 Number of realized events related to the protection of intellectual property

rights and technology per transfer (P0593) .................................................................................. 77 10.8.61 Number of realized educational activities (P0596) ..................................................................... 78 10.8.62 Number of reconstructed facilities of research infrastructure (P0601) .................................... 78 10.8.63 Setting up of national technology platforms (P0602) ................................................................. 78 10.8.64 Share of administrative capacities equipped with material and technical

equipment of TP (P0609) .................................................................................................................. 79 10.8.65 Floor area of renewed beyond the minimum requirements (P0612) ...................................... 79 10.8.66 Private investment matching public support to enterprises (grants) (P0631) ........................ 79 10.8.67 Private investment matching public support to enterprises (excluding grants)

(P0632) ................................................................................................................................................. 80 10.8.68 Reduced annual primary energy consumption in public buildings (P0700) .......................... 80

10.9 Other data ......................................................................................................................................... 80

10.9.1 Number of measures to reduce the administrative burden (D0127) ....................................... 80 10.9.2 Number of completed internal training activities (D0199) ........................................................ 81 10.9.3 Previous Number of external educational activities (D0198) .................................................... 81 10.9.4 Number of employees who took part in educational activities (D0196) ................................ 82 10.9.5 Persons addressed to the general public information activities (D0134) ................................ 82 10.9.6 Persons applicants/beneficiaries involved in information activities (D0136) .......................... 82

11 Performance framework ........................................................................................... 84

11.1 Rationale for selecting the physical progress indicators in the performance

framework ......................................................................................................................................... 84

11.1.1 Priority 1 ............................................................................................................................................... 84 11.1.2 Priority 2 ............................................................................................................................................... 85 11.1.3 Priority 3 ............................................................................................................................................... 85 11.1.4 Priority Axis 4 ....................................................................................................................................... 87

11.2 Financial implementation ................................................................................................................ 87

11.2.1 Baseline with determining financial indicator .............................................................................. 87 11.2.1.1 Baseline with determining financial indicator in 2018 and 2023 based on the

development of OP R & D from 2007 to 2013 .............................................................................................. 87 11.2.1.2 Baseline with determining financial indicator in 2018 and 2023 based on the

development of OP Competitiveness 2007-2013 ........................................................................................ 89 11.2.2 Quantification of the financial indicator based on the expected evolution of

the financial progress of the OP RaI .............................................................................................. 91 11.2.2.1 The expected evolution of the financial progress of Priority Axis 1 ........................................................... 91 11.2.2.2 The expected evolution of the financial progress of Priority Axis 2 ........................................................... 93 11.2.2.3 The expected evolution of the financial progress of Priority Axis 3 ........................................................... 95 11.2.2.4 The expected evolution of the financial progress of Priority Axis 4 ........................................................... 97

11.3 Physical (material) Implementation ............................................................................................... 98

11.3.1 Estimated implementation curve ................................................................................................... 99 11.3.2 Determination of the average length of project implementation ........................................ 100

Page 6: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

6

11.3.3 Determination of the intermediate target on the basis of consideration of the

allocation of the performance reserve ....................................................................................... 101

12 Basic information about the principles of evaluation of OP Research and

Innovation..................................................................................................................103

12.1 Tasks and objectives of assessment ............................................................................................. 103 12.2 Scoping ............................................................................................................................................ 103 12.3 Coordinating evaluation ................................................................................................................ 104

12.3.1 Managing authority/intermediate bodies .................................................................................. 104 12.3.2 Working Group on evaluation of the OP RaI ............................................................................. 104 12.3.3 Monitoring Committee ................................................................................................................... 104 12.3.4 Central Coordinating Authority .................................................................................................... 105 12.3.5 RIS 3 .................................................................................................................................................... 105 12.3.6 Public ................................................................................................................................................. 106

12.4 Process within the evaluation ........................................................................................................ 106 12.5 Types of evaluation ........................................................................................................................ 106

12.5.1 Continuous assessment .................................................................................................................. 106 12.5.2 Impact Assessment ......................................................................................................................... 106

12.6 Organizational arrangements for the evaluation ........................................................................ 106

12.6.1 Internal evaluation .......................................................................................................................... 106 12.6.2 External Evaluation .......................................................................................................................... 107

12.7 Capacity Building ........................................................................................................................... 107 12.8 Principles of ratings ......................................................................................................................... 107 12.9 Usage ratings .................................................................................................................................. 108 12.10 Budget ratings ................................................................................................................................. 108 12.11 Awareness Awareness and Communication Publicity ............................................................... 108

13 Taking into account the negative experience from the programming

period 2007 to 2013 ..................................................................................................109

13.1 Streamlined setup process monitoring and measurable indicators ......................................... 109 13.2 More efficient evaluation system .................................................................................................. 109

14 The Coherence of Monitoring System for RIS3 ........................................................111

15 Earlier Documents .....................................................................................................112

Page 7: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

7

1 The system of monitoring and evaluation of the operational programme

Research and Innovation

Monitoring

Monitoring is an essential tool for operational assessment of the physical and financial

progress of operational programme, as well as its individual priority axes, investment priorities

and individual projects supported. Using data from the monitoring system can be identified

contribution to meeting the objectives of the operational programme at RIS3 SK, twinning

arrangements and other European strategic documents. The information contained

monitoring system not only serves to assess the actual state of implementation, but also to

estimate assuming fulfilment of the objectives at different levels. MA's ambition is to monitor

RaI quantitative data on projects due to the fact that several assisted areas cannot be

properly monitored by continuous numeric variables or categorical variables.

Evaluation

The extension of the monitoring system is the evaluation. Assessment is often based on data

from the monitoring system, in addition to a variety of secondary sources of data and

information role of evaluation is to provide a reflection on the performance/implementation

of the operational programme in a deeper context. Evaluations shall evaluate each field of

interest implementation of the operational programme. It may be areas in which there is a

reasonable suspicion of their ineffective implementation. In this case, the role of evaluation to

diagnose problems, describe it, explain the origin of the problem and provides information on

the removal of such ways, when and what is the expected status after the implementation of

recommended actions. The evaluation report, which only identifies the problem or

inefficiency without remedy recommendation is not acceptable. The rating is a

management tool which is intended to streamline the implementation process continuously.

This should provide objective feedback based on which it will be possible to implement the

measures within the meaning continuous improvement.

Monitoring system

On functional monitoring system is to link the appropriate setting of measurable indicators

(indicators), collection and aggregation of data from the lowest level to monitoring the

progress of the individual projects on the basis of monitoring reports.

Monitoring reports will contain in addition to a basic description of the process of project

implementation and qualitative evaluation of progress made by the beneficiaries.

A functioning monitoring system is essential for the processing of program evaluations,

respectively part of a team early identification of problems and dysfunctional arrangements

and procedures for the implementation of the program and at the same time is a

prerequisite for defining measures to remedy the weaknesses identified.

Rating System

Assessment of the operational programme Research and innovation should be targeted to

capture the effects of various interventions and impact of an operational programme to

change the system of research, development and innovation and enhancing its

performance.

As part of the evaluation process it is necessary to monitor the impact of interventions in the

areas of support that are not directly implemented through the Operational Programme

Research and innovation, but within them supported by complementary interventions that

have an impact on the change of a new research, development and innovation. This

concerns for example the Operational Programme Human Resources, Operational

Programme Infrastructure Integrated, and Operational Programme Rural Development and

so on.

Page 8: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

8

2 Monitoring Tools

An essential tool for monitoring the physical and financial progress is measurable indicators,

key implementation steps as well as other information (data binding). More detailed

information on these can be found in Chapter 4 Glossary.

2.1 Attributes measurable indicators

MU included in CMU reflect the intervention logic and program structure OP. Following this,

each MU in the code measurable indicator assigned the following attributes1: code at

program level (the same as the SFC code) code at the project level name (at a Slovak and

English programming MU), definition/method of calculation, measurement unit resource,

thematic objective (hereinafter referred to as “TO”), the investment priority (the “IP”) fund

category of regions, OP, PO, IP (OP), the specific objectives, the type of activities of

relevance to HP, relevance to the performance framework, frequency of measurements.

All MU are assigned to a specific target at OP and relevant types of activities that are defined

at the level of OP RaI.

2.2 Aggregation of measurable indicators

Aggregation is adding value MU with the same unit of measurement from different levels of

one or more OP. The most common example is the aggregation aggregation MU values

achieved for each project to the appropriate OP RaI, for example priority axis. In specific

cases, aggregation also represents a logical grouping of MU and identifying their mutual

relations.

The aggregate is only possible typological same MU with the same method of calculation

and measurement units. It is not possible to aggregate percentages expressed MU.2 It is

impermissible to aggregate MU with different data sources.

MU aggregation means clustering MU, whose values are then added together.

MU, which are aggregated into one more general (superior) MU represent its subgroups

(slave MU).

MU slave can be monitored at project level3, but for example to monitor the overall program

level “Number of enterprises receiving support”, irrespective of the type of support, so it

contributes to all MU listed in the right column. Note: When aggregation MU certain type of

duplication can occur, leading to incorrect parent resulting value MU. The example is

precisely this type of MU. If the company receives such two types of aid (grant and non-

financial support), an aggregation of MU will be the same undertaking in the resultant

supported holdings counted twice, although this is only one supported enterprises. In this type

MU is recommended to identify any entity (e.g. ID for the enterprise) and in the final, the

master MU weed out duplicates.

Within the OP RaI distinguish two types of aggregation processes:

• Direct counting - in this case, do not enter different process (slave) to him, but to one

MU are read identical indicator values achieved in various projects.

• Merge several into one master MU. In this case, they add up the value of several

individual in his more general one MU (illustrated above example), while respecting

the principles stated in paragraph 22 and in specific cases, eliminate duplication of

effort, as described in point 24. At the level of project beneficiary monitors slave MU

and is responsible for its implementation. Currently it to the master MU makes ITMS

2014+ automatically based on the aggregation map.

1 Mentioned attributes represent all the characteristics of MU.

2 When handling the percentages given MU is first necessary to work with numerical MU, they are derived from the corresponding

percentages MU. For example instead of MU “share successful graduates of education” we work with two numerical MU “The total

number of learners” and “the number of successful graduates of education.” These had already be aggregated in a conventional

manner and from the resulting aggregated data we can calculate the final percentage figure for the whole OP.

3 In general slave indicators can be also at the level of programs.

Page 9: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

9

3 Aggregated monitoring OP RaI

The proposed monitoring system OP RaI is built so that it can be as flexible as possible to

inform about physical and financial progress in terms of the structure of the programming

document:

1. The level of OP RaI,

2. Thematic objective,

3. The level of priority axis,

4. The level of investment priorities,

5. The level of the specific objective,

6. Project level,

7. Horizontal principles,

8. Areas of specialization RIS3.

The second dimension that identified RO/SO OP RaI is providing information on the physical

and financial progress in various areas of outputs that have been achieved due to

implementation of the operational programme within individual projects. The monitoring

system should be from the base project level to inform on the following areas of aggregated

outputs and results of the projects in terms of their individual intervention logic:

1. Direct material output,

2. Direct fixed output,

3. Innovation,

4. Development of business cooperation,

5. The social impacts,

6. Financial implications,

7. Environment – Energy,

8. Information and communication,

9. Categorization recipient.

The individual aggregate area should contribute to the project ascent measurable indicators,

as well as additional information that should be made mandatory provided from aid

recipients during the pre-identified individual time horizon.

3.1 Direct substantive outputs

The aggregate area of monitoring OP RaI consists out of 13 measurable indicators, of which 4

are obligate data that the beneficiary must report without specifying target values.

This part of the aggregate output monitors instant, immediate products provided to the

beneficiaries, i.e. buildings, equipment or center. This set of measurable indicators and data

should be categorized by the required informing the membership category of the type of

innovative technology that has been purchased through the project.4

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data

;

Name of measurable indicator/data;

DXXXX Počet novopostavených budov DXXXX Number of newly constructed buildings

DXXXX Počet zrekonštruovaných budov DXXXX Number of renovated buildings

DXXXX Podlahová plocha novopostavených budov DXXXX Floor area of newly constructed buildings

DXXXX Podlahová ploícha zrekonštruovaných budov DXXXX Floor ploícha renovated buildings

PXXXX Počet vybudovaných centier na popularizáciu výskumu a vývoja PXXXX Number of creating centers for popularisation of research and development

PXXXX Počet vybudovaných lokálnych centier transferu technológií PXXXX The number of new local centers of technology transfer

PXXXX Počet vybudovaných zariadení prototypovej a overovacej infraštruktúry v oblastiach špecializácie RIS3 SK PXXXX The number of new devices and prototype validation infrastructure in areas of specialization RIS3 SK

PXXXX Počet vybudovaných zariadení výskumnej infraštruktúry PXXXX The number of new research infrastructure facilities

PXXXX Počet zrekonštruovaných zariadení výskumnej infraštruktúty PXXXX Number of reconstructed facilities research infraštruktúty

PXXXX Počet zriadených národných technologických platforiem PXXXX The setting up of national technology platforms

PXXXX Počet verejných budov na úrovni nízkoenergetickej alebo ultranízkoenergetickej alebo s takmer nulovou spotrebou energie PXXXX The number of public buildings at low energy or ultranízkoenergetickej or nearly zero energy buildings

PXXXX Podlahová plocha budov obnovených nad rámec minimálnych požiadaviek PXXXX Floor area of buildings renewed beyond the minimum requirements

PXXXX Podiel administratívnych kapacít vybavených materiálno-technickým PXXXX The share of administrative capacities equipped with the material and technical

3.2 Direct intangible outputs

Monitoring intangible outputs of the projects should be implemented through 8 additional

data and 19-Timi measurable indicators.

4 The distribution of the typology of innovative technologies should be a final recommendation within initiated evaluation of results

and impacts of the Operational Programme Competitiveness and Economic Growth and ex - ante assessment of financial

instruments OP RaI the end of 2015.

Page 10: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

10

This thematic unit should inform the number and types of services provided within the

framework of the projects.

Measurable indicators and data should inform about the intensity of support within the

collection and transmission of information, its subsequent output in the form of creating new

businesses. Through these data should be RO/SO OP RaI identify the intensity of the pulses

issued on the market (suggestive information transfer), whose task is to activate, direct

beneficiaries, target groups of users within the meaning of individual theory of change to

achieve policy objectives.

Frequency data and measurable indicators should be used in the efforts to identify the

causal effects within the impact assessment, which should be linked to information on the

supply of direct intangible outputs with information on the results, effects. Econometric and

statistical methods, it will be possible to estimate the functionality of intervention.

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Počet nadviazaných spoluprác s výskumnými inštitúciami DXXXX Establishing cooperation with a number of research institutions

DXXXX Počet podnikov podporených inkubačnými službami DXXXX Number of enterprises supported incubation services

DXXXX Počet podnikov, ktorým boli zabezpečené služby právnej pomoci a poradenstva DXXXX Number of companies that have secured legal aid services and advice

DXXXX Počet realizovaných školiacich aktivít DXXXX Number of completed training activities

DXXXX Počet realizovaných výskumov trhu DXXXX The number of completed market research

DXXXX Počet vytvorených alternatívnych obchidných platforiem DXXXX Number obchidných creation of alternative platforms

DXXXX Počet vytvorených podporných platforiem DXXXX The number of a support platform

DXXXX Počet analýz podnikateľského prostredia MSP DXXXX Number of analyzes the business environment for SMEs

PXXXX Počet "shortlisted" projektov v rámci Horizontu 2020 so slovenskou účasťou podporených z OP VaI PXXXX The number of "shortlisted" projects under Horizon 2020 with Slovak participation supported from OP RaI

PXXXX Počet demonštračných aktivít PXXXX Number demonstration activities

PXXXX Počet podporených podujatí na účely zvyšovania účasti SR v ERA PXXXX Number of supported events, to increase the participation of Slovak Republic in ERA

PXXXX Počet podporených účastí zo SR v ERA PXXXX Number of supporting the participation of Slovak Republic in ERA

PXXXX Počet podporených účastí zo SR v ostatných medzinárodných iniciatívach PXXXX Number of supporting the participation of Slovak Republic in other international initiatives

PXXXX Počet podujatí zorganizovaných na popularizáciu štúdia technických a prírodovedných smerov PXXXX Number of events organized to popularize the study of technical and natural science

PXXXX Počet podujatí zorganizovaných na popularizáciu výskumu a vývoja PXXXX Number of events organized for popularisation of research and development

PXXXX Počet prístupov k zavedeným službám, nástrojom a aplikáciám PXXXX The number of requests to deploy the service, tools and applications

PXXXX Počet riešených aplikácií na experimentálnych cloudoch PXXXX The number of application solutions for experimental Cloud

PXXXX Počet účastí jednotlivcov a tímov zo SR na "shortlisted" projektoch Horizontu 2020 so slovenskou účasťou podporených z OP VAI PXXXX The number of participating individuals and teams from Slovakia for "shortlisted" Horizon 2020 projects with Slovak participation supported from OP RaI

PXXXX Počet UVP/VC zapojených do budovania a prevádzky centier transferu technológií a inkubátorov PXXXX Number of UVP/VC involved in the creation and operation of technology transfer centers and incubators

PXXXX Počet vytvorených experimentálnych cloudov PXXXX Number of created experimental Cloud

PXXXX Počet podporených nových podnikov PXXXX Number of supported new businesses

PXXXX Počet vzuniknutých start-up a spin-off podnikov PXXXX Number of originated start-up and spin-off businesses

PXXXX Počet zrealizovaných hodnotení, analýz a štúdií PXXXX Number of evaluations, analyzes and studies

PXXXX Počet zrealizovaných vzdelávacích aktivít PXXXX Number of training activities

PXXXX Počet podporených podnikov prostredníctvom poradenských centier pre MSP PXXXX Number of enterprises supported through advisory centers for SMEs

PXXXX Počet podnikov, ktoré dostávajú nefinančnú podporu v rámci podpory poskytovania informačných, poradenských a mentorských služieb pre rozvoj MSP PXXXX Number of enterprises receiving non-financial support in promoting the provision of information, advisory and mentoring services for SME development

PXXXX Počet podnikov, ktoré dostávajú nefinančnú podporu v rámci tvorby nových obchodných modelov kreatívneho priemyslu PXXXX Number of enterprises receiving non-financial support in creating new business models for creative industries

3.3 Innovation

This area monitoring should be ensured especially 25 measurable indicators. Within this

aggregate monitoring OP RaI be captured and output as well as the results of individual

projects.

Within outcomes will be monitored, for example, the number of products that are new for the

company, or are allocated to new markets, or the number of filed applications for registration

of intellectual property patents.

The follow-up results provided by the outcomes of the activities include, for example, the

number of generated technological start-up and spin-off businesses, and generated sales

volume in the company due to the sale of innovative products and placing products on new

markets. Based on the foregoing RO/SO OP RaI assumes particular analyse the results of the

gross intervention in comparison with the overall result of the transformation process of the

company. That ratio should be monitored degree of influence on the company. For example,

if the business innovate the product and the product during the period of monitoring the

sustainability of the project will create 30% of total sales in the company, it is an important

intervention in the company's competitiveness.

Page 11: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

11

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Počet výrobkov, ktoré sú pre trh nové DXXXX Number of products that the market is new

DXXXX Tržby z predaja výrobkov, ktoré sú pre firmu nové vplyvom projektu DXXXX Revenues from sales of products that are new for the company due to the project

DXXXX Počet výrobkov dodávaných do dodávateľských reťazcov veľkých domácich a nadnárodných spoločností DXXXX Number of products supplied to the supply chains of major national and multinational companies

DXXXX Počet výrobkov, ktoré sú pre firmu nové DXXXX Products that are new for the company

DXXXX Tržby z predaja výrobkov dodávaných do dodávateľských reťazcov veľkých domácoch a nadnárodných spoločností DXXXX Revenues from sales of products supplied to the supply chains of large domestic and multinational companies

DXXXX Tržby z predaja výrobkov, ktoré sú uvedené na nové trhy vplyvom projektu DXXXX Revenues z sales of products, that are listed on new markets the influence of project

DXXXX Tržby z predaja výrobkov, prostredníctvom elektronického podnikania DXXXX Revenues from sales of products through e-business

PXXXX Finančná podpora podujatí na popularizáciu ochrany práv duševného vlastníctva a transferu technológií PXXXX Financial support events to popularize the protection of intellectual property rights and technology transfer

PXXXX Finančná podpora poskytnutá na podporné služby expertov na duševné vlastníctvo a transfer technológií PXXXX The financial aid granted to promote the services of experts on intellectual property and technology transfer

PXXXX Finančná podpora poskytnutá na podporu a registráciu práv duševného vlastníctva PXXXX The financial support granted to promote and registration of intellectual property rights

PXXXX Finančná podpora poskytnutá na rekonštrukciu a modernizáciu zariadení výskumnej infraštruktúry PXXXX Financial support to the reconstruction and modernization of research infrastructure

PXXXX Počet aktivít na podporu národného sytému pre transfer technológií PXXXX Number of activities to promote a national system for technology transfer

PXXXX Počet iných podaných patentových prihlášok PXXXX The number of other patent applications

PXXXX Počet navrátivších slovenských výskumníkov zo zahraničia PXXXX The number of returnees Slovak researchers from abroad

PXXXX Počet nových výskumných pracovníkov v podporovaných podnikoch PXXXX The number of new researchers in assisted companies

PXXXX Počet podaných patentových prihlášok EPO PXXXX The number of patent applications EPO

PXXXX Počet podaných patentových prihlášok ÚPV SR PXXXX The number of patent applications submitted Gazette

PXXXX Počet podaných patentových prihlášok USPTO PXXXX The number of patent applications USPTO

PXXXX Počet podporených účastí zahraničných výskumníkov v projektových aktivitách slovenskej inštitúcie VaV PXXXX Number of supporting the participation of foreign researchers in the project activities Slovak R&D institutions

PXXXX Počet vzniknutých spin-off podnikov PXXXX The number of generated spin-off businesses

PXXXX Počet vzniknutých start-up podnikov PXXXX Number incurred start-up businesses

PXXXX Počet zavedených a zlepšených služieb, nástrojov a aplikácií PXXXX The number of established and improved services, tools and applications

PXXXX Počet zrealizovaných podujatí súvisiacich s ochranou práv duševného vlastníctva a transferu technológií PXXXX Number of events related to the protection of intellectual property rights and technology transfer

PXXXX Počet podaných patentových prihlášok PXXXX The number of patent applications

PXXXX Počet výrobkov, ktoré sú pre firmu nové PXXXX Products that are new for the company

3.4 Development of business cooperation

Several interventions include within the theory of change activity that should lead to

promoting cooperation amongst the target groups. Such activities are planned within the

thematic objective 1 and 3. The aggregate area should consist of a single project ascent

measurable indicator and five mandatory data.

Monitoring should be information on the frequency of businesses that collaborate with

research institutions involved in supporting platforms associated with the angels, the number

of entrepreneurs within the built clusters.

These monitoring data should provide knowledge on the quantitative extent of cooperation

in different types of cooperation between businesses in order to then be able to assess the

targeted results generated collaborated by assessing the commercialization of outputs

cooperation.

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Počet podnikov v zoskupení DXXXX Number of enterprises in clusters

DXXXX Počet spojených podnikov s nformálnym investorom DXXXX The number of mergers with non-formal investors

DXXXX Počet podnikov zapojených do alternatívnej obchodnej platformy DXXXX The number of companies involved in the alternative trading platform

DXXXX Počet podnikov zapojených do dodávateľských reťazcov veľkých domách a nadnárodných spoločností DXXXX The number of companies involved in the supply chains of large domestic and multinational corporations

DXXXX Počet podnikov zapojených do podpornej platformy DXXXX The number of enterprises involved in the support platform

PXXXX Počet podnikov spolupracujúcich s výskumnými inštitúciami PXXXX Number of enterprises co-operating with research institutions

3.5 Social Impacts

Activities supported under OP RaI should lead to a number of changes that should affect the

social status of the members of society. This social effect is undeniable and desirable

concomitant activities within OP RaI. Despite the fact that in some types of interventions,

particularly within the thematic objective 1 is only a secondary effect.

Social area should be ensured through 36 measurable indicators, as well as relevant data,

many of which contribute to the horizontal principles Equal opportunities and preventing

discrimination.

In particular, the monitoring structure of persons in terms of gender and belonging to

underprivileged social groups, identifying OP RaI. Should be available for the given target

group information on financial support, the establishment of business entities, newly created

jobs etc.

Page 12: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

12

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Dane za zamestnancov DXXXX Taxes for employees

DXXXX Počet dlhodobo nezamestnaných, ktorí dostali nefinančú podporu DXXXX The number of long-term unemployed who have received non-financial support

DXXXX Počet FTE (resp. zamestnancov) DXXXX The number of FTE (i.e. employees)

DXXXX Počet novovytvorených pracovných miest DXXXX The number of new jobs created

DXXXX Počet novovytvoreých pracovných miest obsadených ženami DXXXX The number of newly created jobs filled by women

DXXXX Počet opatrení pre zníženie administratívnej záťaže DXXXX Number of measures to reduce administrative burdens

DXXXX Počet opatrení zabezpečujúcich bezpečný alebo bezbariérový prístup DXXXX Number of measures ensuring the safety and disabled access

DXXXX Počet osôb absolvujúcich zhraničné stáže DXXXX Persons undergoing internship zhraničné

DXXXX Počet osôb mladších ako 29 rokov veku, ktoré dostali nefinančnú podporu DXXXX Number of persons under 29 years of age who receive non-financial support

DXXXX Počet osôb nad 50 rokov veku, ktoré dostali nefinančnú podporu DXXXX Persons over 50 years of age who receive non-financial support

DXXXX Počet osôb so zdravotným postihnutím, ktoré dostali nefinančnú podporu DXXXX Persons with disabilities who receive non-financial support

DXXXX Počet osôb, ktoré dostali nefinančnú podporu DXXXX The number of persons who receive non-financial support

DXXXX Počet podnikov založených dlhodobo nezamestnanými DXXXX The number of enterprises established long-term unemployed

DXXXX Počet podnikov založených osobami mladšími ako 29 rokov veku DXXXX The number of enterprises established by persons below 29 years of age

DXXXX Počet podnikov založených osobami so zdravotným postihnutím DXXXX The number of enterprises established by persons with disabilities

DXXXX Počet podnikov založených osobami nad 50 rokov veku DXXXX The number of enterprises established by persons over 50 years of age

DXXXX Počet podnikov založených Rómami DXXXX The number of enterprises established Roma

DXXXX Počet podnikov založených štátnymi príslušníkmi z tretích krajín DXXXX The number of enterprises established nationals of third countries

DXXXX Počet podnikov založených ženami DXXXX The number of enterprises created by women

DXXXX Počet príslušníkov tretích krajín, ktorí dostali nefinančnú podporu DXXXX The number of third-country nationals who have received non-financial support

DXXXX Počet Rómov, ktorí dostali nefinančnú podporu DXXXX The number of Roma who received non-financial support

DXXXX Počet udržaných pracovných miest DXXXX The number of jobs maintained

DXXXX Počet udržaných pracovných miest obsadených ženami DXXXX The number of jobs maintained by women

DXXXX Počet zamestnancov, ktorí sa zúčastnili vzdelávacích aktivít DXXXX Number of employees who took part in educational activities

DXXXX Počet zrealizovaných externých vzdelávacích aktivít DXXXX Number of external educational activities

DXXXX Počet zrealizovaných interných vzdelávacích aktivít DXXXX Number of internal educational activities

DXXXX Počet žien, ktoré dostali nefinančnú podporu DXXXX Number of women who received non-financial support

PXXXX Finančná podpora podujatí na popularizáciu ochrany práv duševného vlastníctva a transferu technológií PXXXX Financial support events to popularize the protection of intellectual property rights and technology transfer

PXXXX Finančná podpora poskytnutá na podporné služby expertov na duševné vlastníctvo a transfer technológií PXXXX The financial aid granted to promote the services of experts on intellectual property and technology transfer

PXXXX Počet administratívnych kapacít financovaných z technickej pomoci PXXXX The number of administrative capacity financed by technical assistance

PXXXX Počet navrátivších slovenských výskumníkov zo zahraničia PXXXX The number of returnees Slovak researchers from abroad

PXXXX Počet nových výskumných pracovníkov v podporovaných podnikoch PXXXX The number of new researchers in assisted companies

PXXXX Počet podnikov, ktoré dostávajú finančnú podporu inú ako granty PXXXX Number of enterprises receiving financial support other than grants

PXXXX Počet podnikov, ktoré dostávajú granty PXXXX Number of enterprises receiving grants

PXXXX Počet podnikov, ktoré dostávajú nefinančnú podporu PXXXX Number of enterprises receiving non-financial support

PXXXX Počet podporených MSP prevádzkovaných osobami zo znevýhodnených sociálnych skupín PXXXX Number of supported SMEs run by persons from disadvantaged social groups

PXXXX počet výrobkov, ktoré sú pre trh nové PXXXX number of products that are new to the market

PXXXX Počet výskumných pracovníkov pracujúcich v zrekonštruovaných zariadeniach výskumnej infraštruktúry PXXXX The number of researchers working in the renovated facilities of research infrastructure

3.6 Financial effects

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Celkové dane zaplatené do miestneho rozpočtu DXXXX Total taxes paid to the local budget

DXXXX Čistá pridaná hodnota DXXXX Net value added

DXXXX Čisté výnosy DXXXX Net income

DXXXX Daň z príjmu DXXXX Income tax

DXXXX Dane za zamestnancov DXXXX Taxes for employees

DXXXX DPH DXXXX DPH

DXXXX Hodnota hmotného kapitálu (majetku) DXXXX The value of fixed capital (property)

DXXXX Hodnota investícií (dlhodobý finančný majetok) DXXXX The value of investments (current financial assets)

DXXXX Hodnota nehmotného kapitálu (majetku) DXXXX The value of intangible capital (property)

DXXXX Mzdové náklady DXXXX Wages and salaries

DXXXX Príjmy/tržby podniku DXXXX Revenue / sales business

DXXXX Tržby z predaja výrobkov dodávaných do dodávateľských reťazcov veľkých domácich a nadnárodných spoločností DXXXX Revenues from sales of products supplied to the supply chains of major national and multinational companies

DXXXX Tržby z predja výrobkov, ktoré sú pre firmu nové vplyvom projektu DXXXX Overtook sales of products that are new for the company due to the project

DXXXX Tržby z predaj výrobkov, ktoré sú uvedené na nové trhy vplyvom projektu DXXXX Revenues from sales of products referred to new markets due to the project

DXXXX Tržby z predaja výrobkov, prostredníctvom elektronického podnikania DXXXX Revenues from sales of products through e-business

PXXXX Finančná podpora "shortlisted" projektov Horizontu 2020 so slovenskou účasťou podporených z OP VAI PXXXX Financial support "shortlisted" Horizon 2020 projects with Slovak participation supported from OP VAI

PXXXX Finančná podpora podujatí na popularizáciu ochrany práv duševného vlastníctva a transferu technológií PXXXX Financial support events to popularize the protection of intellectual property rights and technology transfer

PXXXX Finančná podpora poskytnutá na podporné služby expertov na duševné vlastníctvo a transfer technológií PXXXX The financial aid granted to promote the services of experts on intellectual property and technology transfer

PXXXX Finančná podpora poskytnutá na podporu a registráciu práv duševného vlastníctva PXXXX The financial support granted to promote and registration of intellectual property rights

PXXXX Finančná podpora v rámci komplementárneho financovania schválených projektov Horizontu 2020 so slovenskou účasťou VaI PXXXX Financial support under the complementary financing of approved projects Horizon 2020 with Slovak participation RaI

The aggregate area is one of the essential resources, especially of result data, which should

serve to assess a theory of change, success commercialization outcomes of the project

activities and impact on the financial condition of the recipient. Awareness of this area

should provide 20 measurable indicators and relevant data. In connection with these

measurable indicators and relevant data will be RO/SO OP RaI able to make partial financial

analysis by an index of profitability, productivity and enterprise activities. It is these three areas

are targeted quantifiable development recipient in the financial condition of the company/

organization. RO/SO plans to collect data on income (revenues), selected expenses (costs) in

order to identify the impact of commercialization share the outcomes of project activities to

the total realized production company.

3.7 Environment – Energy

This area aggregated data and measurable indicators will be monitored especially

immediate tangible outcomes of completed activities as well as capacity-related. Monitoring

should be ensured through 11 measurable indicators and relevant data.

Page 13: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

13

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Energetická trieda novopostavených budov DXXXX Energy class of newly constructed buildings

DXXXX Energetická trieda zrekonštruovaných budov DXXXX Energy class renovated buildings

DXXXX Počet novopostavených budov DXXXX The number of newly constructed buildings

DXXXX Počet zrekonštruovaných budov DXXXX Number of renovated buildings

DXXXX Podlahová plocha novopostavených budov DXXXX Floor area of newly constructed buildings

DXXXX Podlahová plocha zrekonštruovaných budov DXXXX Floor area renovated buildings

PXXXX Odhadované ročné zníženie emisií skleníkových plynov PXXXX The estimated annual reduction in greenhouse gas emissions

PXXXX Počet verejných budov na úrovni nízkoenergetickej alebo ultranízkoenergetickej alebo s takmer nulovou spotebou energie PXXXX The number of public buildings at low energy or ultranízkoenergetickej or nearly zero energy consumption

PXXXX Počet zrekonštruovaných zariadení výskumnej infraštruktúry PXXXX Number of reconstructed facilities of research infrastructure

PXXXX Podlahová plocha budov obnovených nad rámec minimálnych požiadaviek PXXXX Floor area of buildings renewed beyond the minimum requirements

PXXXX Zníženie ročnej spotreby primárnej energie vo verejných budovách PXXXX Reduction of annual primary energy consumption in public buildings

3.8 Information and communication

Monitoring area should be ensured in particular through 12 measurable indicators, but

especially relevant data. In principle, a continuous qualitative polling using basic closed

questions and semantic differential to RO/SO was able to evaluate the effectiveness of more

targeted communication strategy in the individual information campaigns. The use of data is

designed in accordance with the communication strategy of the OP RaI.

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

DXXXX Aké negatívne skúsenosti ste mali v súvislosti s Operačným programom Výskum a inovácie? DXXXX What negative experiences you have had in the operational program Research and innovation?

DXXXX Aké pozitívne vplyvy má realizovaný projekt v rámci Operačného programu Výskum a inovácie na Váš podnik? DXXXX What positive effects of a project implemented under the Operational Programme Research and innovation at your company?

DXXXX Akú formu komunikácie uprednostňujete pri získavaní informácií o nových možnostiach podpora zo štrukturálnych fondov EÚ? DXXXX What form of communication you prefer acquiring information on new funding opportunities from EU funds?

DXXXX Mali by ste záujem o realizáciu ďalšieho projektu v rámci OP VAI? DXXXX Are you interested in implementing projects within the framework of OP RaI?

DXXXX Operačný program Výskum a inovácie je: DXXXX Operational Programme Research and Innovation are:

DXXXX Počet osôb širokej verejnosti oslovených informačnými aktivitami DXXXX Persons interviewed general public information activities

DXXXX Počet osôb žiadateľiv/prijímateľov zapojených do informačných aktivít DXXXX Žiadateľiv persons/beneficiaries involved in information activities

DXXXX Počet realizovaných informačných aktivít DXXXX Number of realized information activities

DXXXX V ktorých oblastiach a ťažko orientujete? DXXXX In which areas and hard to navigate?

DXXXX Z akého zdroja ste sa dozvedeli o možnostiach získania podpory z Operačného programu Výskum a inovácie? DXXXX From what source did you learn about how to obtain support from the Operational Programme Research and innovation?

PXXXX Počet zrealizovaných hodnotení, analýz a štúdií PXXXX Number of evaluations, analyzes and studies

PXXXX Počet zrealizovaných informačných aktivít PXXXX Number of information

3.9 Categorization of recipient

Kód

merateľného

ukazovateľa

Názov merateľného ukazovateľa/údaju

Code of

measurable

indicator/data;

Name of measurable indicator/data;

D0011 Dátum založenia subjektu D0011 Date of establishment of the entity

D0016 Hlavná aktivita (Kód NACE) D0016 Main activity (NACE)

D0017 Hodnota hmotného kapitálu (majetku) D0017 The value of fixed capital (property)

D0019 Hodnota nehmotného kapitálu (majetku) D0019 The value of intangible capital (property)

D0018 Hodnota investícií (dlhodobý finančný majetok) D0018 The value of investments (current financial assets)

D0195 Počet vzniknutých start-up podnikov D0195 Number incurred start -up businesses

D0210 Podnik start-up D0210 Business start -up

D0194 Počet vzniknutých spin-off podnikov D0194 The number of generated spin- off businesses

D0209 Podnik spin-off D0209 Business spin- off

Last aggregated data field consists only of the mandatory data to assist the closer

identification of supported individuals from target groups. In particular, the history, the nature

of the enterprise from the perspective of the business cycle as well as the size of the business

in terms of asset structure.

Overall, the largest proportion of measurable

indicators for the monitoring of the social

impact of interventions as it has proven the

need and requirement to evaluate the

different types of target groups within defined

socially disadvantaged groups within the

thematic objective of OP interventions RaI (in

the case of almost ¼ indicators). The second

most numerous aggregate area of support is

aimed at monitoring intangible outcomes, or

innovation and financial results of the

projects.

Page 14: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

14

4 Intervention Logic

Intervention logic is the identification and explanation of how to achieve what at the various

stages of the project through the logical and chronological synergies tangible, physical,

communication, and financial flows among the participants’ interventions. It is the basis of

any monitoring and evaluation. Managers for monitoring and evaluation should be in

preparation for the preparation of calls for demand-driven projects and invited to submit

projects of national projects acquainted with the intervention logic, if you create it

themselves, so that they know to properly understand the intervention and propose a clear

monitoring and evaluation system. It is therefore appropriate to ask whether the inputs

intervention lead to desired outcomes and whether these outputs then flow into the results

and the impact the intervention has achieved, that is to say, such intervention will achieve its

specific objectives, to what extent it contributes to them.

Within the logic of intervention is necessary to identify at least:

1) Inputs

2) Activities

3) Output

4) Results (Conn. Short and medium term)

5) The results of long-term i.e. effects

1) Inputs

Generally constitute financial, material, human and institutional means or resources used

intervention. Within the OP needs RaI is limited to the definition of the recipient (e.g. SMEs,

large enterprises, R&D organization etc.), definition of target groups (e.g. Research institutions,

public, entrepreneurs interested in business etc.) and the definition of the project. It is

necessary to define which entity is the applicant and the target group. Inputs and outputs

are within the activities supported by OPVaV, respectively the outputs of the other activities in

the past.

Comments: • Who are beneficiaries, target group, the conditions under which the recipient/target

groups receive the intervention (e.g. only SMEs)? • Do the outputs from the previous period impact on the implementation of planned

activities within the project OP RaI?

2) Activities

Is a process implemented within the project period, which provide services or products to the

beneficiary. Within the activities it is appropriate to estimate the time frame for project

implementation. Main activity may consist of several sub activities.

Comments: • What project activities (sub activities) will be implemented?

• To provide the project tangible, intangible assets? • Are the implemented training? This is training for the need to use the new

infrastructure projects? Or seminars for the planned research or to realized or research

to technology transfer, or to popularize? What training (type), for whom they are

intended (researchers, new employees, doctoral candidates, students, general

public, etc.).”

• Searching for employees to new positions? • Will the creation of new jobs? • Feeling with existing employees? • Outsourcing services, research, innovation?” • To implement the development and research, respectively. building infrastructure,

respectively combination?

3) Output

Represent directly, immediately created products, services and infrastructure on the

recipient, whether the target group implementation of project activities. Each activity should

Page 15: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

15

lead to some of the identified outputs. The output is a product of activity of the recipient, be

it a service or facility for, created respectively. supported interventions (e.g. training of

unemployed kilometer road constructed, reconstructed infrastructure). Outputs are fully

responsible under the control of beneficiaries, therefore, those who govern intervention.

Those responsible for the implementation of interventions and their outcomes. Beneficiaries

periodic reports on completed activities and their output through the monitoring system.

Output is seen within the project, but not later than the end of the project.

Comments: • Gain beneficiary software built/procured a new production line, new infrastructure,

carry out research activities? • Trained personnel? • Create a Monastery? • What won the beneficiary/target group implementation of activities? • Created jobs?

4) Results

The results are immediate benefits, effects which arrived at the beneficiary, the subject of the

target group because of the provision of outputs generated through activities (e.g. jobs for

the unemployed, part-time traffic). Beneficiaries cannot be for them fully compliant, for

example they cannot force the unemployed to start a business on the basis of a submission.

As far as possible beneficiary regularly reports on the results. Results may often appear after

the end of intervention and can be planned or unplanned. They are monitored through

monitoring and evaluation.

It is important to recognize that, under the terms of the output product/service /infrastructure,

in contrast to the results, which is an advantage and effect.

Results in the first appropriate to choose from the structure shown in each specific targets, so

as to verify their justification.

Comments: • For enterprises could be increased, sales, value added and to obtain new business

contacts, export business, development of new products and services, their

application to new markets;

• In terms of employment, jobs; • in terms of research, development and innovation: commercialization of R&D results,

the application of patent, patents, publications, citations, more students research and

development as a result of popularization, better and more efficient use of

infrastructure constructed, respectively constructed of e-information sources, etc.; • In terms of environmental protection: reduction of energy intensity (heat, electricity) • It may be case of utilization of built capacities.

5) Long-term outcomes/impacts

Impacts are the consequences of any intervention following the result and concern the

broader population. They usually present only in hindsight and can be evaluated two to three

years after the end of intervention.

Are not under the control of the operators, they cannot report on them knows about them

only through evaluation. Impacts are usually distributed to the intended or unintended,

positive or negative, direct or indirect.

To identify the score can also use measurable indicators (rise of new competitive enterprises,

increase exports, increase employment, etc..

inputs

Vstupy

activitie

s

outputs results Long-term

outcomes/impact

s

Implementation of the project

Realizácia projektu Term sustainability of the project

Page 16: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

16

5 Monitoring of demand-driven projects

Demand-oriented projects should be provided with the most numerous among all types of

projects supported under OP RaI. Basic cell monitoring system shall be: - Financial indicators, - Measurable indicators of project output with symptoms, - Project measurable output indicators with signs and, - Other data.

Precisely measurable indicators of project have a direct or indirect link aggregation program

on measurable indicators. These project measurable indicators, and other information have

their applicability in the context of the assessment and analysis of OP RaI. Serve the purpose

of a more detailed assessment of the state of implementation and physical progress of

projects; predict the development of OP RaI or estimating the effectiveness of interventions

provided.

All measurable indicators, and other data are collected from the current dial measurable

indicators5. That document contains the program, project measurable indicators, other data

shall: a code thematic objective, investment priority, fund, OP priority axis Indicator

definition/calculation method, unit of measure, source, time of performance, measurement

frequency, contribution to meeting performance framework, relevance to horizontal

principles.

5 Methodological Guideline CCA No. 17 on the dial of measurable indicators

Page 17: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

17

6 Monitoring of financial instruments

Based on knowledge of the process of implementation of financial instruments, it is clear that

it is necessary to pay special attention to the implementation of the OP RaI form of financial

instruments. MA and have reduced the intensity of the impact of the implementation

process, as well as aided final beneficiaries, as well as the process of selecting subjects of the

target groups in the OP RaI. MA and the OP RaI logically cannot fully responsible for

contributing to the objectives set; particularly because of its specific goals theory of change

is in support recipient’s financial instruments considerably weak and simple.

The intermediary financial instruments are to accumulate and electronically submitted to the

Managing Authority individually electronically processed editable and photocopiable micro

(CSV, XLS, MS Excel) of embodiment using the data shall be obliged to include at least the

following attributes: • Identification number of SIH, • The date of limiting the period of the aid,

• Type of financial instrument and the amount of support from financial instruments, • The planned termination of the contractual relationship with the beneficiaries of

contributions from financial instruments.

These will be developed as of 31.12. and 6.30 each year and will be electronically sent to the

Managing Authority within 30 calendar days from the date on which the data were

developed.

The intermediary financial instruments are required to keep a register of all parties (final

beneficiaries) who apply for a contribution from financial instruments. Evidence will include

mandatory: • Identification number of the establishment, • The date of the request for assistance, • The date of decision to approve or reject an application for repayable forms of

assistance, justification.

These will be developed as of 31.12. and 6.30 each year and will be electronically sent to the

Managing Authority within 30 calendar days of the date on which the data were developed.

Page 18: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

18

7 Monitoring of national projects

National projects are separate entities in the monitoring and evaluation of the OP RaI

because from the perspective of the relevance of representativeness it refers to activities that

are highly expensive, complex, and long-term realized therefore in a significant extent

represent operational programme. National projects OP RaI should implement activities

especially of non-ivestment nature that represent a fairly wide range of diverse products and

services provided to target entities and individuals.

This distinguishing fact must be adapted to the actual preparation and monitoring of the

national projects. Therefore, each national project has to process a design matrix before the

actual implementation of the national project. This designer matrix consists of: - The name of the national project - Recipient. - Main activity - Under-activity.

- target group, - Type of measurable indicator, - Code measurable indicator / other information, - The name of a measurable indicator / other information, - Measurement unit - Target value,

- The expected result, - Method of measuring the expected results, - Evaluation of expected result.

The above figures clearly identified national project, as well as the detailed structure of

activities implemented method for measuring outputs, i.e., products and services provided by

the target entities or persons. Finally matrix provides basic information about the identification

result, i.e. the expected effect, which should lead to the provision of services or products of

the target groups.

Measurable indicators and results are the first level attributable to the individual sub-activities

within individual national projects. They are then aggregated to the second level, which

shows the aggregate measurable indicators, or “other information” with sporadic incidence

and cumulative numbers for the entire national project.

Page 19: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

19

8 Monitoring of information and communication

Information and communication is a separate area that will be monitored quite difficult given

the wide range of activities within the information and communications operating in the

target groups. More precisely, the monitoring system is described in the communication

strategy of the OP RaI programming period 2014-2020.

The monitoring process includes the following threads:

a) obtaining data (recipient, SO/RO, CCA, CO)

b) the presentation of data (SO/RO, recipient, CCA, CO)

c) ex-ante, interim and ex-post evaluation.

The basis for the successful implementation of the communication strategy is the continuous

monitoring and evaluation of the implemented communication activities. Evaluation of results

of implementation of the communication strategy will take place on the basis of the following

evaluation criteria:

a) the level of the operational programme (indicators of results)

1) the overall level of public awareness about EU activities and ESI + OP RaI

2) Applications for support of OP RaI

3) percentage of OP RaI (in percentage utilization, error rates, good practice

examples)

b) level of individual activities Communication Strategy (output indicators)

1) The number of published reports, interviews, posts, advertisements in all types

of media,

2) web-site visits,

3) The number of seminars, conferences and other events and number of

participants in those events

4) Number of issued and distributed specialized and information publications.

The individual criteria will be defined indicators and established methods listed in the table

below:

Evaluation criteria Indicator Method of detection

Level Operational Programme (indicators of results)

the overall level of public

awareness about EU

cohesion policy and ESI +

OP RaI

% of knowledge of the

role of EU cohesion policy

and ESI + OP RaI

opinion poll

interest in support of OP the number of grant

applicants monitoring reports

prediction of the program

the number of successfully

completed projects (no

negative publicity/high

profile initiatives, filling

indicators)

monitoring reports

The level of activity Communication Strategy (output indicators)

number of participants in

seminars, conferences and

other events

number

daily

records/monitoring

reports of national

projects

number of distributed

specialized and

information publications

number summarization of own

data

web site visits number of accesses summarization of own

data

Page 20: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

20

8.1 An opinion poll OP RaI

One of the basic instruments, information about the level of public awareness about EU

cohesion policy and ESI + OP RaI the implementation of opinion polls OP RaI.

For these purposes RO/SO OP RaI designs regular and continuous collection method through

an online questionnaire, which will be compulsory for applicants completing the OP RaI.

Basic areas that will be evaluated are:

• Identification of the respondent by means of ID, in order to allow for the respondent

pairing with already existing database • semantic differential should reveal the perception ESI + (EU funds) and to determine

the basic attributes, • detect a driver decision for the aid application, • preferences of communication tools and information resources,

• risks of successful project implementation, • pursuit of the project with the support of other external sources of funding, • establish contacts and interest in further communication.

In connection with the timestamp will be to estimate the impact of the ongoing

communication tools to inform the applicants. Timestamp refers to the date, day and time to

send us your application to the system by the respondent.

A similar questionnaire will be prepared for the beneficiaries of the OP RaI which will be

completed by the beneficiaries within the framework of the final monitoring report, as well as

within the last follow-up monitoring report. In this way it will be possible to analyze the

development longitudinal opinion and awareness of beneficiaries OP RaI before and after

the intervention, as well as impacts, i.e. effects at the end of the project (overall impression of

the ESI +).

number of seminars,

conferences and other

events

number summarization of own

data

number of issued

specialized and

information publications

number

summarization of own

data

1. number of published

reports, interviews, posts,

advertisements in all types

of media

number

summarization of own

data, media

monitoring

Page 21: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

21

9 Glossary

Aggregation map

List of MU and other data OP RaI which is the sum of all MU and other data OP RaI all levels of

implementation and include information on the aggregation of individual MU and other data

in the form of defined relevant rules of aggregation. It is processed electronically in MS Excel

format.

Interim Destination (milestone)

Intermediate target value of the indicator is continuous, which is part of the performance

framework, planned on 31. 12. 2018. This means that the milestone represents a partial,

medium-term objective associated with the particular specific objective within the priority

axis. Achieving the milestone it is evaluated in 2019.

Full Time Equivalent (FTE, man years)

Jobs can be on a full or part-time or seasonal. Seasonal jobs and jobs to part-time are

converted into FTE (Full Time Equivalents) as follows:

FTE per employee = (sum of hours worked on R&D activities in the current year)/2000

where 2000 represents an annual capacity of staff working hours.

Financial indicators (FU)

Means the total amount of eligible expenditure (resources provided for ESI +), national public

funds and national private sources) for their certification by the certification body. This

represents the total amount paid by beneficiaries and reimbursed completed operations

(projects). The need for performance framework is set one financial indicator of the level of

each priority axis of the program in addition to the priority axis of technical assistance.

Other data

There are other data resp. parameters (other than MU) monitored at the level of supported

projects. These are all details that need to monitor/gather and not be a MU. Other data also

includes statistics on cross-cutting nature whose uniform reporting at all OP is important in

terms of objectives of the partnership SR-being and are monitored at all or clearly identified

projects, regardless of their source (i.e. does not go directly on the information provided to

the beneficiaries but may be the data obtained from other sources such as the Statistical

Office, Social Insurance, etc.).

Key implementation (implementation) action (KVK)

An important step in meeting the objectives of the priority axes of the program (excluding

technical assistance), which are verifiable. Their use is particularly applicable where by the

end of 2018 expected measurable outputs relevant within the appropriate priority axes i.e. it

is used only for the needs of the performance framework.

Measurable indicators (MU)

They are the main instrument for monitoring and evaluating progress in achieving the

objectives of the OP. Constitute baseline information for the review program performance.

MU to the essential characteristics are: name, definition, calculation method, unit of measure,

which indicate average levels MU and filling time. We distinguish the following types of

measurable indicators:

Financial indicators • Indicators at the program level, • Indicators on the project level, • Output indicators • Result indicators

Measurable indicators at the program level (program measurable indicators)

These are measurable indicators that are monitored and reported to the appropriate level of

the operational programme. This may be a result indicators and common output indicators

Page 22: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

22

(policy) specific output indicators. MU monitoring program will ensure continuous information

on progress towards the objectives of the OP, investment priorities, specific objectives and

types of activities.

Measurable indicators at the project level (project measurable indicators)

They are defined and monitored by the management or intermediate body at the project

level. For their implementation and evaluating is responsible the recipient. MU at the project

level should provide the ability to track and binding set targets to be achieved and the

project implementation to ensure achievement of objectives at OP. For projects under

operational programs supported by the ERDF they are in terms of character the output

indicators. Measurable result indicators

Indicators with a direct link to set specific targets. Measurable result indicators quantify the

change that is following the activities implemented to achieve. Result measurable indicators

is a wider dimension changes such as converting the direct inputs into outputs and achieving

them it can be influenced by factors that are not directly generated or influenced by the

implementation of interventions under the program. The results of the programs should be

defined so that an external factor never does prevail over factors under the control of the

program. That is why the creation of the key to identify the program as far as possible all the

factors that may affect the achievement of the selected result and decide which of them will

be subject to the program.

Measurable Outcome

Provide information on the immediate exit of implementation of individual activities under the

program. They represent a quantification of real outcomes which are obtained directly for

the investment (inputs). The indicators are the rule expressed in physical units, financial or

number of units (e.g. length of newly built roads km, the number of SMEs supported, etc.).

Output indicators directly related to activities to be implemented under the different

investment priorities OP and their values correspond to the financial inputs designed to

support these activities. Output indicators also need to be in direct relation to outcome

indicators, because the outputs contribute to the required changes due to the intervention,

which is measured by indicators of achievement.

Business

Organization producing goods or providing services to meet the needs of the market and

thus make a profit. Corporate legal form can vary (self-employed, partnerships, etc.)

The enterprise is the smallest combination of legal units that is an organizational unit

producing goods or services, which has a degree of decisional autonomy, particularly in

matters of its current resources. An enterprise carries out one or more activities at one or more

locations. An enterprise may be a sole legal unit. This includes corporations (companies

owned by the group entities such as joint stock companies, cooperatives, limited liability

companies, etc.) and quasi (companies owned by one entity).

Legal entity based on business under the Commercial Code or the natural person under the

Trade Act within the scheme or de minimis scheme.

Common measurable output indicators

They are measurable output indicators defined at EU level. Provides the ability to monitor the

implementation of cohesion policy objectives EU-wide. In all areas ESIF where the national

policy objectives coincide with the objectives of the EU, are included in a file shared MU MU

monitored at the level of the OP. ERDF are defined at EU level, only joint measurable output,

which serve to collect information in the Member State and Member States and speak

frequently used investment from the ERDF.

Specific measurable indicators of output

They are measurable output indicators defined at the level of the operational programme i.

e. they are not included in the Common MU and do not target at the EU level.

Page 23: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

23

Performance reserve

The performance reserve is the amount of money forming part of resources from ERDF, ESF

and the Cohesion Fund under the Investment for growth and jobs, as well as EAFRD and

EMFF. The performance reserve is provided for in the partnership agreement (the national

level) and OP (at OP and priority axes). The performance reserve is a motivational tool for

efficient and effective achievement of the objectives of individual priority axes of the OP.

Performance Reserve may be used after the OP targets. Achieving milestones set at 31. 12.

2018 assessed by the European Commission on the basis of annual reports on the

implementation of the OP for the year of 2018. The intention of the performance reserve to

respond to the shortcomings in the implementation of ESI + and if necessary to reallocate

funds from inefficient priority axes to more promising areas of support other priority axes, if

necessary other operational programs.

Performance framework

It represents a framework of planned values of selected indicators of each priority axis within

the OP ESI + (including the European territorial cooperation) programming period 2014-2020,

with the exception of the priority axis of technical assistance. Performance framework consists

of indicators and their targets and objectives. More information about the performance

framework and its indicators is provided in Chapter 11 Performance framework.

Research institutions

Organization or research and development centers outside the scheme: • independent R&D organizations, i.e. legal or natural person whose predominant

activity is research and development; • non-independent research and development organizations, i.e. legal or natural

person whose predominant activity is different from research and development, but

its R&D potential calculated to the full-time equivalent (FTE) is at least one person

years.

Purpose (overall goal)

The intention is planned final value of the indicator on the deadline for completion 31. 12.

2023. The achievement shall be evaluated in 2025 for the conclusion of the programming

period.

Page 24: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

24

10 The measurable indicators

10.1 Intervention logic and methodology of selection of measurable indicators

Intervention logic

For detailed information on processes that should happen in various forms of support in the

individual specific objectives and appointed them examples of activities, the intervention

logic. This is a schematic representation of or narrative processes divided into main parts, in

particular on inputs or resources necessary for implementing the activities and their individual

shares. Just show detailed examples of activities of individual actions serve as a basis for

determining outputs i.e. instant products or services to the recipient of aid the final recipient.

Identified outcomes serve as the basis for determining the structure of output measurable

indicators.

They were subsequently identified potential outcomes as perceived effect ', which is to take

place due to the existence of outlets. It is appropriate to perceive the impact of outputs on

long-term results only marginally, whereas in the long-term effects result is the statistical

indicators of the entire population, for example employment rate, the number of profitable

enterprises. The development of these indicators can be therefore largely influenced by the

independent decision of each person or business.

Based on the understanding of the logic of intervention has been developed structure of

measurable indicators at examples of actions that are then reflected in the level of specific

objectives.

Balance of measurable indicators

Fixed measurable indicators will be monitored from individual projects supported and

recorded in the monitoring system, and then the data will be collectivized at the level of

specific objective and priority investment program.

The need to assess the physical progress of the operational progress will be mainly given

measurable indicators approved in the structure of the operational programme for the

purpose of description as appropriate of the analyzed indicators that will only additional

information from the recipient, such as revenue, number of employees in the structure of

technical and administrative staff and production staff etc. The above data will also serve the

needs of the performance impact assessment for each investment priority once during the

programming period in line with current EC generally binding regulations. For monitoring

interventions thematic objective 1 were primarily selected6 common output indicators from

the “Research and innovation” and then the output common measurable indicators defined

under the section “Productive investments”. For interventions supported within the thematic

objective 3 were selected common ascent measurable indicators primarily from the

“Productive investments” and only then relevant common ascent measurable indicators

defined under the Section “Research and innovation”.

Fixed specific measurable indicators have been designed to reflect the most important

outcomes that were not included within the common output indicators, and thus illustrate the

physical progress in the interventions supported in that specific targets particular investment

priorities.

Result measurable indicators were selected to reflect the specificities of the interventions

included under the specific objective. Performance indicators they consider the evaluation

of the areas under all potential beneficiaries of the interventions included in particular

specific objective. Often it has been applying the principles of the initial determination, the

wording of the specific objective i.e. the precise purpose predestined by the wording of result

6 of Annex No. 1 Common output indicators for ERDF support under the Investment for Growth and Jobs

of the European Parliament and of the Council (EU) No. 1301/2013 of 17 December 2013 on the

European Regional Development Fund and on specific provisions relating to the Investment for growth

and jobs, and repealing Regulation (EC)

Page 25: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

25

Trend of the overall inflation in SR

% c

ha

ng

e

monitored/predicated period

in measurable indicator of respecting the majority representation results-oriented

interventions in the specific target group.

10.2 General principles estimation targets of measurable indicators

The cost to drive measurable performance indicator (unit cost)

Often using the principle of setting a target to use unit cost for a given output of information

from the previous programming period.

The unit costs were generally estimated based on data from the ITMS implementation of

operational programs of the previous programming period - Operational Programme

Research and Development and the Operational Programme Competitiveness and

Economic Growth. For instance, the number of new jobs, and applications of intellectual

property rights. The unit costs were estimated for the whole period of implementation

available. Extremes were removed and outlier that significantly reduce or increase the final

unit price. Then these values, the mean value was determined.

Leaving some independent variables in the above equation as optional. In particular, the

likelihood of duplication of support, or the average of inflation.

Alternatively

The likelihood of duplication of support

This factor takes into account the substitutability of individual companies several times in

support of the measure priority axes of the operational programme of the previous

programming period. This factor has been incorporated mainly due to the definition of

common measurable indicators, which show conditional monitoring with removing

duplicates with respect to the organization identification number or identification number of

the citizen.

The average impact of inflation

Fully aware of the undeniable influence the price level in Slovakia over the next nine years.

Accordingly, this effect incorporated in the estimation of the targets that should be affected

by an increase in unit costs, for example the procured technology. The impact of inflation is

significant precisely when innovative technologies that take quite a turbulent impact of

innovation added value, i.e. taking into consideration only in those parts of the operational

programme that are addressed - within one thematic objective in specific objectives 1.2.2

and 2.2.2 and the thematic objective of 3 priority axes 3 and 4. In other specific objectives

within the thematic objective 1, abstracting from the impact of inflation, since most potential

beneficiaries are not entities established for the purpose of business. This also concerns the

priority axis 5.

First, it is appropriate to analyze time series

evolution SR headline inflation in the previous

period. This time series is characterized by

considerable variability and extreme values. An

inflation estimate for long-term horizons ahead is

Overall inflation [%] 2005 2006 2007 2008 2009 2010 2011 2012 2013

The average annual change 3% 5% 3% 5% 2% 1% 4% 4% 1%

Source: ŠÚ SR

Page 26: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

26

very difficult, if not impossible. Given the need for prediction, it is necessary to create the

most realistic model predictions. In the picture alongside it shows graphically the exponential

development with the Directive trend extended into 2023. That exponential model is

characterized by the highest coefficient of determination between all models. Figure

graphically indicates the prediction of gradual reduction of the price level to almost zero. This

long-term development is extreme and somewhat unimaginable that the bleak due to the

fact that it disputed the recovery condition of the Slovak economy. Slightly more optimistic is

logarithmic model which calculates inflation ranging from about 1.5% to 2% in the coming

years.

Very similar developments in the overall inflation were predicted on the basis of three-year

average basis. The development was compromised in 2011. We expect that the economy

will begin to recover gradually in the coming years, which would put pressure on the price

level in the market due to intensifying demand and supply.

The table in the first row of estimated average rate of overall inflation at 1.7% constant. The

value for 2014 was estimated based on the forecast of the National Bank of Slovakia7. With

regard to the implementation, however, it cannot be considered as a constant effect. We

expect the first significant contracting in 2015, reflected the impact of inflation on goods and

services already during 2014. Subsequently, the mechanism to allocate each year of simple

interest rates in proportion to the contracting of the total allocation, resulting in the estimated

average rate of contracting normalized impact on unit costs for the need to set targets. In

conclusion, the impact of inflation on relevant interventions OP RaI should be on average at

the level of 9.02% in the course of years 2014 to 2023.

Qualitative expert judgment

Another approach which has been applied was a qualitative expert judgment, especially in

the case of measurable indicators which have not yet been monitored, and therefore there

was no experience of their prediction and fulfillment. Therefore there were requested experts

in the field, who generally estimated particularly the likelihood of such business entities within

the measurable indicator. It is therefore a percentage of the total number of supported

enterprises.

10.3 Measurable indicators of outcome (result indicators)

10.3.1 The degree of awareness of the possibilities of support from the OP (R0025)

Definition

The overall level of awareness (consciousness) on public support through OP. The rate

information is measured by opinion polls.

Note

Indicator displays the result of actions taken and their impact on the external environment, by

achieving a certain degree of awareness projects.

Unit of measure

%

7 http://www.nbs.sk/_img/Documents/_Publikacie/PREDIK/2014/P1Q-2014.pdf

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023

average

effect of the

inflation

average annual change 0,1% 1,7% 1,7% 1,7% 1,7% 1,7% 1,7% 1,7% 1,7% 1,7%

contraction (% p. a.) 0% 9% 11% 11% 13% 13% 10% 11% 12% 11%

cumulative 0% 9% 19% 30% 43% 57% 67% 78% 89% 100%

% effect of the inflation

per allocation0,0% 8,4% 10,1% 10,0% 12,2% 12,0% 8,9% 9,7% 9,9% 8,9% 9,02%

Source: MH SR, NBS

Page 27: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

27

Data source and frequency of measurement

Is further specified in the Action Plan identifying baseline and target value of result indicator

“degree of awareness of the possibilities of support from the OP”.

Using marker

Specific objective 5.1.2

10.3.2 Number of participations in projects of international cooperation (R0042)

Definition

Number of participation of Slovak research organizations respectively foreign organizations

performing R&D in the Slovak Republic in projects of international cooperation.

Note

Within the specific objective 1.1.2 will be supported all activities that are connected with the

participation of the Slovak Republic and its entities in the activities of the European Research

Area. The activities under this specific objective is expected • An increase of the level of Slovak research excellence, • An overall increase in submitted projects involving operators from Slovakia in the calls

of Horizon 2020

• Increased number of successful project participations. • Increased participation in international activities, in particular under international and

European programs, • An overall increase in the contributions received from the EU through a higher number

of successful projects. • It is also connected with the following expected results of the Partnership Agreement

SR: • strengthening research excellence, • increase cooperation and exchange with research and development institutions

within the ERA and European programs and initiatives RaI (e.g. Horizon 2020) • increased international mobility of Slovak researchers and graduate students.

Unit of measure

Number

Data source and frequency of measurement

Information system research and development potential, annually.

Using marker

Specific objective 1.1.2

10.3.3 The amount of private investment in research and development in Slovakia except

for the Bratislava region (R0044)

Definition

Expenditure on research and development include the total amount of expenditure incurred

in the organization of the R&D activities, i.e. they are internal expenses. They include capital

and current expenditure. For expenses incurred outside the organization includes only those

that serve to support internal research and development (e.g. Purchase of equipment for

R&D). Depreciation of buildings, machinery technical equipment and installations are from

the statistical survey of internal expenditure on R&D is excluded. Expenditure on research and

development are identified and by source of funding, socio-economic goals and the current

expenditure by R&D activities. Further, also it had funding R&D projects together, including

the state budget. For the purposes of this indicator OP RaI are monitored only R&D

expenditure from business sources, regardless of the sector of destination, taking the value of

the whole country are deducted the value of the Bratislava region.

Page 28: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

28

Note

Due to the nature of supported projects - i.e. various forms of partnerships between the

scientific research sector and industry, within which will be carried out research and

development within the specific objective 1.2.1 is expected to increase private investment in

research and development. Comparing the results obtained from the OP RaI value of the

indicator of result we find post OP RaI. It is also linked to the expected results of the

Partnership Agreement SR “increase in private investment spending in academic science

and research through partnerships between R & D institutions and industry.”

Unit of measure

EUR

Data source and frequency of measurement

The Statistical Office of the Slovak Republic annually.

Using of marker

Specific objective 1.2.1

10.3.4 The amount of private investment in research and development in Bratislava (R0045)

Definition

Expenditure on research and development includes the total amount of expenditure incurred

in the organization of the R&D activities, i.e. they are internal expenses. They include capital

and current expenditure. For expenses incurred outside the organization includes only those

that serve to support internal research and development (e.g. purchase of equipment for

R&D). Depreciation of buildings, machinery technical equipment and installations are from

the statistical survey of internal expenditure on R&D is excluded. Expenditure on research and

development are identified and by source of funding, socio-economic goals and the current

expenditure by R&D activities. Further, it also had funding R&D projects together, including

the state budget. For the purposes of this indicator OP RaI are monitored only R&D

expenditure from business sources irrespective of the sector of destination within the

Bratislava region.

Note

Due to the nature of supported projects - i.e. various forms of partnerships between the

scientific research sector and industry, within which will be carried out research and

development within the specific objective 2.2.1 is expected to increase private investment in

research and development. Comparing the results obtained from the OP RaI value of the

indicator of result we find post OP RaI. It is also linked to the expected results of the

Partnership Agreement SR “increase in private investment spending in academic science

and research through partnerships between R & D institutions and industry”.

Unit of measure

EUR

Data source and frequency of measurement

The Statistical Office of the Slovak Republic annually.

Using marker

Specific objective 2.2.1

10.3.5 Share of enterprises applying research, development and innovation (R0046)

Definition

This is a measure applying corporate activities focus on research, development and

innovation in Slovakia.

Page 29: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

29

Note

The innovation Union Scoreboard is a unified measure of progress in the field of innovations

within individual EU Member States, which includes a number of measurable indicators at the

national level. A year-on-year increase in the share of enterprises applying research,

development and innovation fully respects the internal contents and representativeness of

the specific objective 1.2.2.

Unit of measure

%

Data source and frequency of measurement

Innovation Union Scoreboard, yearly.

Using marker

Specific objective 1.2.2

10.3.6 The share of enterprises with innovation activity in the Bratislava region (R0047)

Definition

This is a measure of enterprises with innovative potential in the Bratislava region.

Note

It is expected that the output of research and development activities are in practice

innovation in particular innovation. It is this linkage makes room for innovation in the

monitoring role of the etalon growth in R & D and innovation capacity in industry and services

in the Bratislava region, which is the specific objective of linking the Result measurable

indicator.

Unit of measure

%

Data source and frequency of measurement

The Statistical Office of the SR, 2018 and 2023.

Using marker

Specific objective 2.2.2

10.3.7 The survival rate of new businesses on the market after two years (R0048)

Definition

It is the ratio of the number of enterprises with a survival time of more than two years on the

total number of new businesses.

Note

Growth of new, competitive SMEs will be supported interventions aimed specifically at new

businesses. Lack of business environment in Slovakia is not lack of interest of citizens in

business. The planned intervention has as its goal to encourage new entrepreneurs and guide

them towards sustainability in the open market due to the formation of management

decisions that would be competitive. For a competitive firm can be considered a firm that

proves its products, services apply the open market in a healthy competitive. An undertaking

which, after its creation surpassed the biennium market (survived) likely in theory,

microeconomics overcame so. Death Valley, i.e. the period during which the new

entrepreneur decides between the end of the business activities and remain under

consideration its financial and economic condition, or reflection of market saturation it

offered products/services. The survival rate of businesses business after two years in Slovakia

should be compared with a survival rate of entrepreneurs supported within OP RaI which can

be at least estimate the impact of interventions.

The survival rate might not contribute to growth, but this does not preclude efforts to promote

competitiveness OP RaI new businesses. Despite the hypothetical decrease in survival.

Page 30: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

30

Measurable indicator counts the number of enterprises operating = max. two years since the

establishment/total number of enterprises. The interventions have an impact on the reader

equation is the number of enterprises.

Unit of measure

%

Data source and frequency of measurement

The Slovak Business Agency, annually.

Using marker

Specific objective 3.1.1

10.3.8 The share of SMEs in exports (R0049)

Definition

It is the proportion of the value of exports of SMEs in total exports.

Note

Internationalization of enterprises supported should lead to the presentation of subjects in

foreign markets, thus businesses should gain new business contacts and to commence within

them competitive struggle at the supranational level. If Slovak companies begin to allocate

their products and services to foreign markets, it should thus increase the country's export.

Unit of measure

%

Data source and frequency of measurement

The Statistical Office of the Slovak Republic annually.

Using marker

Specific objective 3.2.1

10.3.9 The rate of compliance with the time limits for making payments to beneficiaries

(R0116)

Definition

The share of the payment claims submitted by beneficiaries, within the framework of

approval have been complied with the deadline set for PJ RO and the total number of

payment claims submitted by the beneficiaries under which was completed the process of

their approval by the MA and PJ. This figure does not include procedural deadlines for

approving payment under the auspices CO.

Note

The indicator shows the result of measures taken and their consequences for the stabilization

process in the field of environment, through maintaining some degree of compliance with

the deadlines laid down in the approval process grant applications and administrative

checks on applications for payment.

Unit of measure

%

Data source and frequency of measurement

ITMS yearly.

Using marker

Specific objective 5.1.1

Page 31: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

31

10.3.10 Rate fluctuations administrative capacity (R0117)

Definition

The ratio of the number of employees involved in the OP implementation with termination of

employment (number of outputs) for the calendar year to the average annual total

recorded number of employees involved in the OP implementation, converted to full-time

equivalent (FTE). Do not count the number of outputs to the maternity and parental leave.

Note

Indicator display the result of actions taken and their impact on the internal stabilization of

the environment in human resources, by maintaining and stabilizing qualified officials and

cooperating with special potential for quality management and process of implementation

of the operational programme.

Unit of measure

%

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, yearly.

Using marker

Specific objective 5.1.1

10.3.11 The rate of proper project implementation (R0119)

Definition

The share of projects executed correctly (all completed projects with exception to special

completed projects) the total number of completed projects (ordinary and extraordinary

termination of the project). The number of implemented projects is excluded projects

completed due to extraordinary legal succession in the person of the recipient.

Note

Indicator displays the result of actions taken and their impact on the external environment in

organizations of aid recipients, and to some extent through successful projects.

Unit of measure

%

Data source and frequency of measurement

ITMS yearly.

Using marker

Specific objective 5.1.2

10.3.12 The number of patent applications in Slovakia except for the Bratislava region

(R0126)

Definition

The number of European patent applications filed by applicants residing/established in

Slovakia except for the Bratislava region.

Note

It is related to the expected results of the specific objective 1.1.1: • increase overall system performance research and development, through increased

application of the concept of intellectual property (patenting, licensing, and creation

of spin-off and start-up effects) in government and public sector research and

development, • increasing the number of outputs and activities of public R&D institutions of state for

industry and society in relation to implementing activities related to the promotion of

the national system for technology transfer.

Page 32: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

32

It is also linked to the expected results of the Partnership Agreement SR “improving the

protection and use of intellectual property and the number of patent applications.”

Unit of measure

Number

Data source and frequency of measurement

The European Patent Office and the Statistics Office, annually.

Using marker

Specific objective 1.1.1

10.3.13 The number of patent applications in the Bratislava region (R0127)

Definition

The number of European patent applications filed by applicants residing/headquartered in

the Bratislava region.

Note

Implementation of activities under the specific objective 2.1.1 will be inter alia a systemic way • increase research activity, research-oriented universities in Bratislava, • increase research activities of the Institute of the Slovak Academy of Sciences and

departmental research institutions based in Bratislava, • increase the R & D potential of the Bratislava region, linked to higher quality

education, • increased participation in international activities, in particular under international and

European programs.

Given the projected results shall increase the number of patent applications.

It is also linked to the expected results of the Partnership Agreement SR “improving the

protection and use of intellectual property and the number of patent applications.”

Unit of measure

Number

Data source and frequency of measurement

The European Patent Office and the Statistics Office, annually.

Using marker

Specific objective 2.1.1

10.3.14 Number of publications entities from Slovakia in Web of Science and Scopus Core

Collection (R0128)

Definition

The indicator is the cumulative number of records of publication activities of Slovak authors in

the worldwide use of database collections, Web of Science Core Collection by Thomson

Reuters and Scopus from Elsevier Company in a given calendar year. It is one that is all kinds

of publications, whether the document type for all fields of science and technology.

Note

The selected indicator will inter alia reflect the activities supported under the specific

objective 1.1.3, which will result in:

• Increase research activity of state and public research institutions,

• improve the coordination of research potential of the state and public research institutions,

It is also linked to the expected results of the Partnership Agreement SR “increase in publishing

activities.”

Publications are one of the most used and most relevant indicators to assess research and

development activities used worldwide. Scientometric and bibliographic data publications

Page 33: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

33

are tracked in different databases and systems at national and supranational level. The

information contained in the database Web of Science Core Collection (publisher Thomson

Reuters) and Scopus (Elsevier Publisher) can be jointly considered an exhaustive source of

publications of Slovak authors.

Unit of measure

Number

Data source and frequency of measurement

Web of Science Core Collection (Thomson Reuters) and Scopus (Elsevier), annually.

Using marker

Specific objective 1.1.3

10.3.15 Share of profit of SMEs in the Bratislava region (R0130)

Definition

It is the proportion of SMEs in Bratislava during the reference period a profit.

Note

One of the signs of success in the competition is even and profitability of firms that it will

achieve.

Unit of measure

%

Data source and frequency of measurement

Register accounts, annually.

Using marker

Specific objective 4.1.1

10.3.16 The share of SMEs in creating added value in the private sector (R0171)

Definition

It is the annual percentage change in the differences between production at basic prices

and intermediate consumption at purchasers' prices. The production consists of the products

created during the current accounting period and intermediate consumption consists of the

value of goods and services consumed in the production process as inputs, excluding fixed

assets whose consumption is retained as fixed capital consumption.

Note

The added value of SMEs and its increase reflects a fundamental expression of the

competitiveness of entrepreneurs to create added value at the time t. j. generating revenues

from products sold and services that are an essential source of business. It is this measurable

indicator should reflect the nationwide increase the competitiveness of SMEs in the

development phase, i.e. existing businesses.

Unit of measure

%

Data source and frequency of measurement

The Statistical Office of the Slovak Republic annually.

Using marker

Specific objective 3.3.1

Page 34: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

34

10.4 Joint measurable output indicators (common indicators)

10.4.1 The number of companies receiving support (CO01)

Definition

Number of enterprises receiving support in any form from the Structural Funds (regardless of

whether the aid constitutes State aid or not). Enterprise: Organisation producing products or

providing services to meet the needs of the market and thus make a profit. Corporate legal

form can vary (self-employed, partnerships, etc.)

Note

Indicators CO01 - CO04 measured by number of enterprises and multiple set-off must be

eliminated (i.e. firms receiving grants more than once is still the only one enterprise receiving

grants) based on the unique identifier for each undertaking Identification best preventing

any multiple counting.

Sum indicators CO02, CO03 and CO04 can be higher than the indicator CO01 if companies

can receive various types of support or combined support.

This indicator should be used in conjunction with the indicator is the number of firms that

receive support in order to introduce products to the market is new (CO28) and the number

of firms that receive support in order to introduce products which are for the company new

(CO29) for innovation in enterprises. Indicator is also needed when the aid granted in order to

improve levels of energy efficiency in enterprises.

It is superior to the following common MU: • Number of enterprises receiving grants (CO02)

• Number of enterprises receiving financial support other than grants (CO03) • Number of enterprises receiving non-financial support (CO04) • Number of supported new businesses (CO05)

Unit of measure

Number (companies)

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2, 3.1, 3.2, 3.3, 4.1

10.4.2 Number of enterprises receiving grants (CO02)

Definition

Number of enterprises receiving support in the form of non-repayable direct financial

assistance is conditional on completion of the project (grants).

Subgroup “The number of companies receiving support.”

Note

Subgroup of MU The number of companies receiving support (CO01). The number of

companies and their multiple set-off must be eliminated (i.e. companies receiving grants

more than once is still the only one enterprise receiving grants).

The indicator is superior to the Project MU Number of enterprises receiving grants (P0284).

Variable is part of the performance framework Priority Axis 3.

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Page 35: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

35

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2, 3.1, 3.2, 3.3

10.4.3 Number of enterprises receiving financial support other than grants (CO03)

Definition

The number of enterprises receiving financial support other than a grant in the form of loans,

interest subsidies, loan guarantees, venture capital or other financial instrument.

Subgroup "The number of companies receiving support."

Note

Subgroup of Number of enterprises receiving support (CO01).

The indicator is superior to the Project MU Number of enterprises receiving financial support

other than grants (P0283).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.3, 4.1

10.4.4 Number of enterprises receiving non-financial support (CO04)

Definition

The number of enterprises receiving support, which does not involve a direct financial transfer

(guidance, counseling, business incubators, etc.). Venture capital is considered financial

assistance.

Subgroup “The number of companies receiving support.”

Note

Subgroup of MU The number of companies receiving support (CO01).

The indicator is superior to the Project MU Number of enterprises receiving financial support

other than grants (P0285).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.4.5 Number of supported new businesses (CO05)

Definition

The number of enterprises created receiving financial or other assistance (counseling,

guidance, etc.) from the Structural Funds and instruments financed by the Structural Funds.

Created enterprise did not exist three years before the project. The enterprise becomes the

new venture, if the only change its legal form.

Subgroup “The number of companies receiving support.”

Page 36: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

36

Note

This indicator should be used for development and the level of innovation in enterprises

where the objective is to create and support new businesses (e.g. the spin-off companies,

technology start-up companies).

Subgroup of MU The number of companies receiving support (CO01). Within the investment

priorities 1.1 and 2.1 is identical to a specific number of MU incurred start-up and spin-off

companies (O0074).

The indicator is superior to the Project MU supported Number of new enterprises (P0302).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2, 3.1, 4.1

10.4.6 Private investment matching public support to enterprises (grants) (CO06)

Definition

The total value of private contribution in supported projects that meet the definition of State

aid, where aid takes the form of a grant (see 2 common indicator “Number of enterprises

receiving grants”), including the unjustified part of the project.

Note

It is calculated as the sum of private equity funding sources from payment requests for

projects supported by the grant awarded.

The indicator is superior to the Project MU Private investment matching public support to

enterprises (grants) (P0631).

Unit of measure

EUR

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 3.1, 3.2, 3.3

10.4.7 Private investment matching public support to enterprises (excluding grants) (CO07)

Definition

The total value of private contribution in supported projects that meet the definition of State

aid, where aid has the form of a grant (see 3 common indicator “Number of enterprises

receiving financial support other than grants”), including the unjustified part of the project.

Note

By means other than grants means the provision of repayable assistance in the context of the

financial instruments.

The indicator is superior to the Project MU Private investment matching public support to

enterprises (excluding grants) (P0632).

Unit of measure

EUR

Data source and frequency of measurement

ITMS, annually.

Page 37: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

37

Using marker

Investment priorities 3.1, 3.3, 4.1

10.4.8 The growth of employment in assisted companies (CO08)

Definition

Gross new jobs in supported businesses in full time equivalents (FTE). Basically indicator of the

situation before and after, which collects the employment gain directly due to project

completion (workers employed for project implementation are not counted). The posts must

be filled (vacant posts are not counted) and increase the total number of jobs in the

company. If the total employment in the company does not increase, the value is zero - it is

considered reshuffle, not the increase. Preserved and similar jobs are not included.

Gross: The creation of official posts does not count if it does not contribute directly to an

increase in the total number of jobs in the organization. Variable is used in projects whose

activities clearly contributing to increased employment.

The equivalent of full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs

and jobs to part-time are converted to FTE using ILO standards /statistical/ other standards.

Durability: jobs should be permanent, i.e., exist over a sufficiently long period depending on

industrial-technological characteristics; seasonal jobs should be repeated. Data of enterprises

which have gone bankrupt, register as a zero increase in employment.

Timing: Data were obtained before the project and after its completion. Average

employment based on one year is mainly used for employment data to a specific date.

Note

The indicator is superior to the Project MU employment growth in assisted companies (P0091).

Unit of measure

FTE

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.3, 4.1

10.4.9 Number of new researchers in assisted companies (CO24)

Definition

Gross new jobs (which did not exist before) that will carry out directly research and

development activities in full time equivalents. Location must arise from the execution or

completion of the project, to be filled (vacant posts are not counted) and increase the total

number of research jobs in the organization. Support staff for R & D (i.e. workers who are not

directly involved in R & D activities) are not counted.

The creation of official posts do not count if does not directly contribute to an increase in the

total number of research sites in the organization.

The equivalents of full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs

and jobs to part-time are converted to FTE using ILO standards /statistical/ other standards.

RTD jobs are usually created for a shorter time (“support”). Jobs created for different projects

are added together (under the condition that all projects receiving support), where it is

considered multiple counting.

Note

Gross new jobs in supported businesses in full time equivalents (FTE). Basically indicator of the

situation before and after, which collects the employment gain directly due to project

completion (workers employed for project implementation are not counted). The posts must

be filled (vacant posts are not counted) and increase the total number of jobs in the

Page 38: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

38

company. If the total employment in the company does not increase, the value is zero - it is

considered reshuffle, not the increase. Preserved and similar jobs are not included.

To avoid double counting of jobs created, increase in employment is calculated not for

projects, but in view of the organization identification number (ID). Within two different

organizations, while it may be one person reported several times and thus is an employee of

both organizations. During the process of starting and processing measured values are

registering employees net of duplicity with regard to the identification number and the period

of registration at the Social Insurance Agency employee. The Social Insurance Agency is a

provider of administrative data on registration of insured persons (employed with a regular

income) without interrupting the registration of the registration sheet individuals Social

Insurance Agency. The ITMS2014 + and RO/SO longitudal data processing system that

has/has not been granted aid from the OP RaI so that it can express the net effect of the

increase in employment in supported projects.

Default value is calculated as the average monthly number of registered employees with a

regular income for a period of 12 months for the commencement of the first activities of the

project.

Unit of measure

FTE

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

10.4.10 The number of researchers working in the renovated facilities of research

infrastructure (CO25)

Definition

Existing workers (1) directly carrying out R&D activities and (2) are directly affected by the

project. Posts must be filled (vacant posts are not counted). Auxiliary staff for R&D (i.e.,

workers who are not directly involved in R&D activities), are not counted. If the number of

research jobs will increase as a result of the project, the new site will be included (see also

“The number of new researchers supported entities”).

The project must improve the facilities, i.e. their maintenance is excluded.

The equivalent full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs and

jobs to part-time are converted to FTE using ILO standards/statistical/other standards.

Research infrastructure is a term used to denote a very diverse group of tangible or intangible

assets, and therefore cannot be captured using a limited number of physical indicators. In this

case, the approach, which focuses on non-financial investment dimension (employment)

and is able to express the range (size) of intervention.

Note

The indicator is superior to the Project MU number of researchers working in the renovated

facilities of research infrastructure (CO25).

Unit of measure

FTE

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

Page 39: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

39

10.4.11 Number of enterprises cooperating with research institutions (CO26)

Definition

The number of companies that collaborate with research institutions for R&D projects. The

project involving at least one company and one research institution. Support may get one or

several cooperating entities (research institutions or enterprises), but the granting of support is

conditional on cooperation. Cooperation may be new or existing. The cooperation should

last for at least the duration of the project.

Enterprise: Organization producing products or services to meet the needs of the market and

thus make a profit. At the headquarters of the company (within the EU or outside it) does not

matter. If the company formally take the lead and other actors are subcontractors, but

cooperation with research institution, counted all businesses.

Research institution: an organization whose main activity is R & D.

Cooperation may be counted on the basis of operations or subscribers. This indicator focuses

on enterprises as participants in accordance with the general objective of innovation to

improve competitiveness.

Note

The indicator is superior to the Project MU Number of enterprises cooperating with research

institutions (P0282).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.1, 2.2

10.4.12 Private investments linked to public support innovative projects or research and

development (CO27)

Definition

The total value of private contribution received to support innovation and R & D projects.

Note

It is calculated as the sum of private equity funding sources of the requests for payment.

Unit of measure

EUR

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

10.4.13 The number of companies receiving support in order to introduce products that are

new to the market (CO28)

Definition

Indicator assesses whether assisted companies develop a product that is “new to market”

due to the project in any of its markets. It includes the innovation process if the process

contributes to the development of the product. Projects which aim to actual product

development are excluded. If the company markets several products, it shall be counted as

one enterprise. For cooperation projects this indicator takes into account all the undertakings

involved.

Page 40: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

40

The product is new to the market if the market there is no other product offering the same

functionality, or the technology that the new product is used is significantly different from the

technology of existing products. Products can be tangible or intangible (including services).

The supported projects were aimed at putting products "new to market", but which failed,

were also counted.

Frontier markets (geographical or other) define RO based on business activity, receiving

support.

Please note the relationship with the pointer 29 “Number of enterprises receiving support in

order to introduce products that are new for the company.” Although most classical

innovation leads to products that are new to the market and the company, some products

may be new to the market, but not for the company, for example adapting existing products

to the new market without changing functionality.

Note

It should be used together with the joint MU The number of companies receiving support

(CO01).

Relating to the common MU Number of enterprises receiving support in order to introduce

products that are new for the company (CO29).

The indicator is superior to the Project MU Number of enterprises receiving support in order to

introduce products that are new to the market (P0289).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.4.14 The number of companies receiving support in order to introduce products that are

new for the company (CO29)

Definition

This indicator assesses whether backed company developing a product that is “new for the

company”, as a result of the project. It includes the innovation process if that process

contributes to product development. Projects which aim to actual product development are

excluded. If the company makes a number of products, it shall be counted as one enterprise.

For cooperation projects this indicator takes into account all the participating companies for

which the product is new.

The product is new for the relevant company if the company does not produce a product

with the same functionality, or if production technology is substantially different from the

technology already manufactured products. Products can be tangible or intangible

(including services). Supported projects that were aimed at launching new products for the

company, but failed, were also counted.

Please note the relationship with the pointer 28 “Number of enterprises receiving support in

order to introduce products that are new to the market.” Although most classical innovation

leads to products that are new to the market and the company, some products may be new

to the company but not for the market, for example. Some technology transfer.

Note

It should be used together with the joint MU The number of companies receiving support

(CO01).

Page 41: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

41

Relating to the common MU Number of enterprises receiving support in order to introduce

products that are new to the market (CO28) as MU project The number of products that are

new for the company (P0512).

The indicator is superior to the Project MU Number of enterprises receiving support in order to

introduce products that are new for the company (P0288).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, annually

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.4.15 Reduction of annual primary energy consumption in public buildings (CO32)

Definition

The calculations are based on building energy certificate (see Art. 12, paragraph 1, point b)

of the Directive 2010/31/EU). In accordance with the deadlines stipulated in the Directive

pointer must be valid for all public buildings with a total useful floor area over 500 m2 and

reconstructed with structural funds. If construction begins after 9 July 2015, the threshold for

public buildings will be reduced to total usable area of 250 m2. RO can be included in the

calculation of the building with a floor area of less than 250 m2 (500 m2 or before July 9, 2015).

The value is calculated from the energy performance certificates issued before and after

reconstruction. Indicator shows overall decrease in annual consumption by the end of the

period, not the total savings over the period.

Note

The indicator is superior to the Project MU Reduced annual primary energy consumption in

public buildings (P0700).

Unit of measure

KWh/year

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 2.1

10.4.16 The estimated annual reduction in greenhouse gas emissions (CO34)

Definition

This indicator is calculated for interventions that are directly aimed at increasing the

production of renewable energy and reduce energy consumption through energy-saving

measures; therefore its use is mandatory only in cases where these indicators are relevant. Its

use for other interventions with a potential impact of greenhouse gases is voluntary; in this

instance, the methodology developed RO.

In the case of renewable energy estimate based on the amount of primary energy produced

supported devices. Renewable energy should be neutral regarding the emergence of

greenhouse gases and to replace non-renewable energy production. Non-renewable

energy impact of greenhouse gases is estimated by the total greenhouse gas emissions per

unit of non-renewable energy production in the Member State.

In the case of measures for energy savings estimate based on the amount of primary energy

that was saved using the supported operations. Energy saved should replace non-renewable

energy production. Non-renewable energy impact of greenhouse gases is estimated by the

Page 42: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

42

total greenhouse gas emissions per unit of non-renewable energy production in the Member

State.

Note

The indicator reflects the total expected annual decline at the end of the reporting period

does not reflect the overall decline during the reporting period.

The indicator is superior to the Project MU estimated annual reduction in greenhouse gas

emissions (P0103).

Unit of measure

t eq. CO2

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 2.1

10.5 Specific measurable output indicators (specific indicators)

10.5.1 The number of measures to reduce the administrative burden (O0048)

Definition

The total number of measures adopted by the RO/SO in order to reduce the administrative

burden on applicants/beneficiaries in connection with the preparation and implementation

of projects.

Note

Analyzes and other activities will contribute to the introduction of systems simplification and

reduction of administrative burden on the RO, SO, beneficiaries.

The indicator is related to other data, the number of measures for reducing administrative

burdens (D0127).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.5.2 Number of supported research institutions (O0069)

Definition

Number of research institutions receiving non-repayable and repayable support from the OP

RaI (regardless of whether aid constitutes State aid or not).

Research institution: an organization whose main activity is R&D.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within one OP.

Note

The indicator is superior to a specific MU Number of supported research institutions

cooperating with companies (O0070) and project MU Number of supported research

institutions (P0325).

Variable is part of the performance framework Priority Axes 1 and 2.

Page 43: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

43

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

10.5.3 Number of supported research institutions cooperating with companies (O0070)

Definition

Number of research institutions receiving non-repayable and repayable support from the OP

RaI (regardless of whether aid constitutes State aid or not). The project involving at least one

research institution cooperating with at least one undertaking. Support may get one or

several cooperating entities (research institutions or enterprises), but the granting of support is

conditional on cooperation. Cooperation may be new or existing. Cooperation should be

continued for at least the duration of the project. Cooperation may be counted on the basis

of operations or subscribers. This indicator focuses on research institutions as participants.

Research institution: an organization whose main activity is R&D.

Enterprise: Organization producing products or services to meet the needs of the market and

thus make a profit. At the headquarters of the company (within the EU or outside it) does not

matter.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within one OP.

Note

Specific indicator is inferior MU Number of supported research institutions (O0069) and

superior project MU Number of supported research institutions cooperating with companies

(P0326).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

10.5.4 Number of reconstructed facilities of research infrastructure (O0071)

Definition

Number of workplace research infrastructures with a reconstructed interior fittings and exterior

modifications to modernize in terms of research and development and energy saving,

reduction of environmental burden or barrier-free entry and movement for work, t. j.

Maintenance is excluded.

It is the number of workplace research infrastructure projects there - it is therefore necessary

to avoid duplication of the research institutions with more projects.

Note

The indicator is superior to the Project MU Number of reconstructed facilities of research

infrastructure (P0601).

Unit of measure

Number

Page 44: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

44

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 2.1

10.5.5 The number of applications for registration of intellectual property rights (O0072)

Definition

Intellectual property means farmhouse generated by certain intellectual content that term

objective is amenable to social relations without having to be its embodiment in tangible

form.

IPR can be: • Copyright, rights related to copyright and rights related to copyright, • Industrial rights and similar industrial rights.

1. Industrial rights to intellectual creations:

a) Patent Law (inventions),

b) The right (industrial) designs,

c) The right to utility models,

d) The right of topographies of semiconductor products,

e) Rights of new varieties of plants and new breeds of animals,

2. Industrial right to designate:

a) Trademark law (trademark law),

b) The right of designations of origin and geographical indications for products,

c) The right to trade names,

3. The rights similar to industrial rights:

a) Innovatory Law (rationalization proposals),

b) The right to new methods of prevention, diagnosis and treatment of human

and animal health and protecting plants against pests and diseases,

c) The right know-how,

d) The right of the logo,

e) The right domain names,

f) The right to protect the name and reputation of the legal entity.

Note

Within the investment priorities 1.2 and 2.2 is a superior indicator specific MU The number of

patent applications (O0073).

The indicator is superior to the Project MU registration number of applications of intellectual

property rights (P0355).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.5.6 The number of patent applications (O0073)

Definition

The number of patent applications filed at Slovak or foreign patent office within the

supported projects. The patent application must be filed during the project and must result

from implementation of the project concerned.

Page 45: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

45

Note

Within the investment priorities 1.2 and 2.2 is a specific indicator of inferior MU registration

number of applications of intellectual property rights (O0072).

Indicator is superior MU the following project: • The number of other patent applications (P0170) • The number of patent applications (P0280)

The indicator also is related to other data: • The number of patent applications EPO (D0139) • The number of patent applications submitted Gazette (D0140) • The number of patent applications USPTO (D0141)

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2

10.5.7 Number incurred start-up and spin-off companies (O0074)

Definition

Number incurred start-up and spin-off businesses within the supported projects. Must be

incurred during the project.

Start-up Enterprise: Emerging Company often still at the stage of developing a business plan

with a low starting costs, higher business risk and potentially higher returns in the event that

such an undertaking established itself in the market.

Spin-off Enterprise: holdings arising after splitting certain group of people or activities from the

parent organization for the purpose of commercialization of research and development

respectively. Intellectual property rights of the parent organization.

The indicator is a subset of indicator C5.

Note

The indicator is inferior joint MU supported Number of new enterprises (CO05).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.1, 1.2, 2.1, 2.2, 3.1

10.5.8 The number of participants in advisory and training programs (O0075)

Definition

The number of all people in the target groups involved in counseling and educational

activities.

The method of calculation: Calculates the number of participants (e.g. business) and not the

number of consultations (visits).

Note

The indicator is superior to the Project MU Number of counseling and educational programs

(P0442).

Page 46: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

46

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 3.1, 3.2, 3.3, 4.1

10.5.9 Number of supported cluster organizations (O0076)

Definition

Cluster organization means an institution representing mutually cooperating companies,

specialized suppliers, service providers, firms in related industries and institutions (e.g.

Universities, R & D organizations, trade unions) in certain areas (sectors), which both compete

but also cooperate.

The cluster organization has a separate legal form of business.

For backed by cluster organizations is considered that organization, which is provided:

• Grant,

• Repayable financial support,

• Non-financial support (e.g. counseling).

Note

The indicator is superior to the Project MU Number of supported cluster organizations (P0295).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 1.2, 2.2

10.5.10 Number of supported enterprises through advisory centers for SMEs (O0077)

Definition

Counseling center means the institution providing advisory and other supported services

intended primarily for businesses.

Note

The indicator is superior to the Project MU Number of enterprises supported through advisory

centers for SMEs (P0306).

Variable is part of the performance framework Priority Axes 3 and 4.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 3.1, 4.1

Page 47: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

47

10.5.11 Number of new SMEs established by people from disadvantaged social groups

(O0078)

Definition

The number of enterprises created receiving financial or other assistance (counseling,

guidance, etc.) from the Structural Funds and instruments financed by the Structural Funds.

Created enterprise did not exist three years before the project, but the management

authority or the national legislation may lay down a time criterion. The enterprise becomes

the new venture, if the only change its legal form.

Start-up, respectively Spin-off businesses are entities arising under § 56 et seq. Law No.

513/1991 Coll. Commercial Code, as amended.

Entities incorporated in the marginalized social groups set up by SMEs means: women, young

people up to 30 years, seniors over 50 years, long-term unemployed, nationals of third

countries, and socially disabled.

These enterprises created on the basis of the support provided in the form of:

• Grant, • Repayable financial support, • Non-financial support (e.g. counseling).

Note

The indicator is superior to the Project MU Number of new SMEs established by people from

disadvantaged social groups (P0205).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 3.1

10.5.12 Number of supported SMEs run by persons from disadvantaged social groups

(O0079)

Definition

Number of supported holdings receiving financial or other assistance (counseling, guidance,

etc.) from the Structural Funds and instruments financed by the Structural Funds. Supported

enterprises did not exist three years before the project, but the management authority or the

national legislation may lay down a time criterion. An enterprise does not become a new

venture, if it only changes its legal form.

Start-up, respectively Spin-off businesses are entities arising under §56 et seq. of Act No.

513/1991 Coll. of Commercial Code, as amended.

Entities incorporated in the marginalized social groups set up by SMEs means: women, young

people up to 30 years, seniors over 50 years, long-term unemployed, nationals of third

countries, and socially disabled.

These enterprises created on the basis of the support provided in the form of: • Grant, • Repayable financial support, • Non-financial support (e.g. counseling).

Note

The indicator is superior to the Project MU Number of supported SMEs run by persons from

disadvantaged social groups (P0301).

Page 48: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

48

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priority 4.1

10.5.13 Number of SMEs participating in fairs and exhibitions abroad (O0080)

Definition

Measurable indicator monitors the number of participating SMEs on promotions. Within these

shares of companies presenting their products and services with a view to their application

on the open market. This is a promotional actions conducted outside Slovakia.

Note

The indicator is superior to the Project MU Number of SMEs participating in fairs and exhibitions

abroad (P0435).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually

Using marker

Investment priority 3.2

10.5.14 Number of supported business and support platforms (O0081)

Definition

In particular, the support platform (export consortia), which are a form of strategic

cooperation between enterprises. They serve as mediation service provider access to foreign

markets. Activities of these platforms may relate for example the basic administrative

functions; help with translations, providing market research, assistance in developing an

overall export strategy, joint purchase of inputs, legal assistance, creating a common brand

alliance and other marketing services.

Note

The indicator is superior to the Project MU Number of supported business and support

platforms

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priority 3.2

10.5.15 Number involvement of SMEs in EU programs (O0082)

Definition

It is the frequency of referred business entities that were involved in community programs

such as Horizon 2020, COSME and others. It is the Community programs aimed at the

integration of EU policies through the implementation of projects promoting and expanding

cooperation between Member States and the candidate countries of the EU in the long run.

Page 49: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

49

Note

The indicator is superior to the Project MU Number of SMEs involved in EU programs (P0190).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment priorities 3.2 and 4.1

10.5.16 Number of enterprises receiving non-financial support in promoting the provision of

information, advisory and mentoring services for SME development (O0083)

Definition

Number of enterprises receiving support under the support of the provision of information,

advisory and mentoring services for the development of SMEs, which does not involve a

direct financial transfer (guidance, counseling, business incubators, etc.). Venture capital is

considered financial assistance.

Subgroup C4.

Note

Specific indicator is inferior MU Number of enterprises receiving non-financial support (CO04).

The indicator is superior to the Project MU Number of enterprises receiving non-financial

support in promoting the provision of information, advisory and mentoring services for SME

development (P0286).

Variable is part of the performance framework Priority Axis 3.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 3.3

10.5.17 Number of enterprises receiving non-financial support in creating new business

models for creative industries (O0084)

Definition

Number of enterprises receiving support in creating new business models for the creative

industry, which does not involve a direct financial transfer (guidance, counseling, business

incubators, etc.) in creating new business models for the creative industries. Venture capital is

considered financial assistance.

Subgroup C4.

Note

The indicator is inferior joint MU Number of enterprises receiving non-financial support (CO04).

The indicator is superior to the Project MU Number of enterprises receiving non-financial

support in creating new business models for creative industries (P0287).

Variable is part of the performance framework Priority Axis third

Unit of measure

Number

Page 50: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

50

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 3.3

10.5.18 Number of realized educational activities (O0163)

Definition

The total number of training actions for administrative capacity involved in the

implementation of OP funds realized from the technical assistance OPs. Educational activities

mean training, seminars, workshops, professional traineeship aimed at exchange of

experience and under.

Note

Indicator is superior project indicators Number of completed training activities (P0596) and

the other related to the following information: • The number of completed internal training activities (D0199), • The number of completed external training activities (D0198), • Number of employees who took part in educational activities (D0196).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.5.19 The number of administrative capacity financed by technical assistance (O0175)

Definition

The total annual average registered number of administrative capacity involved in the

implementation of the OP converted to full-time equivalent (FTE) whose wages are funded

from technical assistance.

Note

The indicator is superior to the Project MU Number of administrative capacity financed by

technical assistance (P0129).

Unit of measure

FTE

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.5.20 Number of realized information activities (O0178)

Definition

The total number of information activities realized through projects.

Information activities shall mean in particular: conferences, trainings, seminars, workshops,

INFODENT, fairs, exhibitions, TV / radio spot, advertising on the Internet, advertising in the press,

publication, website, polling and other activities aimed at informing the target groups.

Page 51: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

51

Note

The indicator is superior to the Project MU previous Number of information activities (P0589)

and the other related to the following information: • Persons applicants / beneficiaries involved in information activities (D0136), • The number of persons interviewed general public information activities (D0134).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.5.21 The number of public buildings at low energy or ultralow energy or nearly zero

energy needs (O0180)

Definition

The number of buildings that meet the requirements of laws of general application:

a) Upper limit Energy Class B for all the indicators determines the level of low-energy

construction,

b) upper limit of the energy class and for individual indicators, while the upper limit of the

energy class A1 for global indicator ultralow energy determine the level of construction

(MDVRR SR Decree no. 364/2012 Coll.).

Note

The indicator is superior to the Project MU number of public buildings at low energy or ultralow

energy or nearly zero energy requirement (P0469).

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 2.1

10.5.22 The number of completed evaluations, analyzes and studies (O0181)

Definition

The total number of evaluations, analyzes and studies of realized funds from OP TP.

Note

The indicator is superior to the Project MU Number of completed evaluations, analyzes and

studies (P0588).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

Page 52: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

52

10.5.23 The share of administrative capacities equipped with material and technical

equipment of TP (O0182)

Definition

The share of the average annual number of registered administrative capacity involved in

the implementation of the OP equipped with material - technical equipment of TP means the

total average annual number of registered administrative capacity involved in the

implementation of the OP.

Note

The indicator is superior to the Project MU share of administrative capacities equipped with

material and technical equipment of TP (P0131).

Unit of measure

%

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.5.24 Floor area of renewed beyond the minimum requirements (O0183)

Definition

Total floor area of restored buildings beyond the minimum requirements based on data from

energy audits required for the purposes of this measure.

Note

The indicator is superior to the Project MU floor area of renewed beyond the minimum

requirements (P0612).

Unit of measure

m2

Data source and frequency of measurement

ITMS, annually.

Using marker

Investment Priority 2.1

10.6 Financial indicators

10.6.1 Total amount of eligible expenditure for their certification by the certification body

(F0002)

Definition

It represents the total amount of eligible expenditure (ESI + for money resources, national

public funds and national private sources) for their certification by the certification body. This

represents the total amount paid by beneficiaries and reimbursed implemented operations.

The sum of all eligible expenditures from payment claims submitted by the beneficiaries after

their certification.

Note

This is a special indicator at the program created in order to monitor financial progress in the

implementation of individual priority axes (except the Priority Axis Technical Assistance) under

the operational programme performance framework.

Unit of measure

EUR

Page 53: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

53

Data source and frequency of measurement

ITMS, annually.

Using marker

Priority Axis 1, 2, 3 and 4

10.7 Key implementation steps

10.7.1 Number of supported enterprises through advisory centers for SMEs (K0001)

Definition

Counseling center means the institution providing advisory and other supported services

intended primarily for businesses.

Note

For more details and rationale for the selection of the KVK are given in Chapter 11.1

Justification for the choice of indicators of physical progress in the performance framework.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Priority Axis 3 and 4

10.7.2 Number of contracted research institutions (K0003)

Definition

Number of research institutions receiving non-repayable and repayable support from the OP

(regardless of whether aid constitutes State aid or not). The project involving at least one

research institution cooperating with at least one undertaking. Support may get one or

several cooperating entities (research institutions or enterprises), but the granting of support is

conditional on cooperation. Cooperation may be new or existing. Cooperation should be

continued for at least the duration of the project. Cooperation may be counted on the basis

of operations or subscribers. This indicator focuses on research institutions as participants.

Research institution: an organization whose main activity is R & D.

Enterprise: Organization producing products or services to meet the needs of the market and

thus make a profit. At the headquarters of the company (within the EU or outside it) does not

matter.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within the OP.

Note

For more details and rationale for the selection of the KVK are given in Chapter 11.1

Justification for the choice of indicators of physical progress in the performance framework.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Priority Axis 1 and 2

Page 54: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

54

10.7.3 Number of enterprises receiving non-financial support in promoting the provision of

information, advisory and mentoring services for SME development (K0004)

Definition

Number of enterprises receiving support, which does not involve a direct financial transfer

(guidance, counseling, business incubators, etc.). Venture capital is considered financial

assistance.

Note

For more details and rationale for the selection of the KVK are given in Chapter 11.1

Justification for the choice of indicators of physical progress in the performance framework.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Priority 3

10.7.4 Number of enterprises receiving non-financial support in creating new business

models for creative industries (K0005)

Definition

Number of enterprises receiving support, which does not involve a direct financial transfer

(guidance, counseling, business incubators, etc.) in creating new business models for the

creative industries. Venture capital is considered financial assistance.

Note

For more details and rationale for the selection of the KVK are given in Chapter 11.1

Justification for the choice of indicators of physical progress in the performance framework.

Unit of measure

Number

Data source and frequency of measurement

ITMS, annually.

Using marker

Priority 3

10.8 Measurable indicators at the project level (project indicators)

10.8.1 Financial support “shortlisted” Horizon 2020 projects with Slovak participation

supported from OP RaI (P0054)

Definition

Amount supported “shortlisted” projects under Horizon 2020 with Slovak participation. In the

case of projects with Slovak participation are rated as good quality, but not funded due to

lack of financial resources of the EU (the so-called “Shortlisted” projects), it will be possible to

reorient towards OP and financed under OP rules.

Note

It is calculated as the sum of public funds for the ERDF payment applications supported

“shortlisted” projects.

Unit of measure

EUR

Page 55: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

55

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1 and 2.1

10.8.2 Financial support events to popularize the protection of intellectual property rights

and technology transfer (P0055)

Definition

The amount of aid granted to finance events to raise awareness of the scientific community

about the importance of intellectual property protection and the whole process of

technology transfer aimed at raising awareness of the need for protection and

commercialization of intellectual property and creating professional background capacities

that worked on the implementation of technology transfer in the Slovak Republic.

Note

It is calculated as the sum of public funds for the ERDF payment applications in projects with

the sponsored events to popularize the protection of intellectual property rights and

technology transfer.

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.3 The financial aid granted to promote the services of experts on intellectual property

and technology transfer (P0056)

Definition

The amount of aid granted to cover financial expert support services to leading domestic

and foreign experts on technology transfer and evaluation of the commercial potential of

the results of R&D, research institutions help to ensure the protection of intellectual property

created by and for the payment of necessary experts (patent attorneys, translators, licensing

experts).

Note

It is calculated as the sum of public funds for the ERDF payment requests in projects to

support services of experts on intellectual property and technology transfer.

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.4 The financial aid granted to promote and registration of intellectual property rights

(P0057)

Definition

The amount of aid granted to promote and registration of intellectual property rights by way

of payment credential and renewal fees for international patents.

Page 56: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

56

Note

It is calculated as the sum of public funds for the ERDF payment requests in projects

supporting the registration of intellectual property rights.

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.5 Financial support to the reconstruction and modernization of research infrastructure

(P0058)

Definition

The amount of aid granted for reconstruction, modernization and further development of

infrastructure and technological background research institutions outside of the business

sector in the areas of specialization RIS3 SK.

As part of the supported projects will be carried out necessary upgrading and modernization

of research centers/infrastructure supported in the years 2007 - 2013 as well as the

educational infrastructure /equipment research-oriented study programs to the needs of

practice. Creation of new infrastructure/new research centers will be in segments, which

have not been carried out any R&D investment as long as the said investment in accordance

with the areas of specialization defined RIS3 SK and simultaneously will benefit from

complementary/synergistic investments in research infrastructure implemented in the 2007 -

2013, where appropriate and possible.

Note

It is calculated as the sum of public funds for the ERDF payment applications in projects with

grant aid for the reconstruction and modernization of research infrastructure.

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1 and 2.2

10.8.6 Financial support under the complementary financing of approved projects Horizon

2020 with Slovak participation of OP RaI (P0059)

Definition

The amount of support complementary financing approved projects Horizon 2020 of Slovak

participation. Implementation of approved projects within the European research/mobility

programs and initiatives often may require additional expenses to fulfill the objective of the

project as far as possible. Complementary funding for approved projects at an international

level will allow coverage of compulsory funding, but will allow cover additional expenditure

under approved projects at international level, for example instruments/devices that allow

solving the approved project better and better results, respectively allow the extension of its

results/further research.

Note

It is calculated as the sum of public funds for the ERDF payment requests in projects

supported by the complementary financing of approved projects Horizon 2020 with Slovak

participation.

Page 57: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

57

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1 and 2.1

10.8.7 The growth of employment in assisted companies (P0091)

Definition

Gross new jobs in supported businesses in full time equivalents (FTE). Basically, indicator of the

situation before and after, which collects the employment gain directly due to project

completion (workers employed for project implementation are not counted). The posts must

be filled (vacant posts are not counted) and increase the total number of jobs in the

company. If the total employment in the company does not increase, the value is zero - it is

considered reshuffle, not the increase. Preserved and similar jobs are not included.

The equivalent full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs and

jobs to part-time are converted to FTE using ILO standards/statistical/other standards.

Durability: jobs should be permanent, i.e., exist over a sufficiently long period depending on

industrial-technological characteristics; seasonal jobs should be repeated. Data of enterprises

which have gone bankrupt, register as a zero increase in employment. The number will be

established on the basis of the monitoring reports and summary reports ITMS.

Note

The indicator is inferior joint MU Employment growth in assisted companies (CO08).

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.8 The estimated annual reduction in greenhouse gas emissions (P0103)

Definition

This indicator is calculated for interventions that are directly aimed at increasing the

production of renewable energy and reduce energy consumption through energy-saving

measures, therefore its use is mandatory only in cases where these indicators are relevant. Its

use for other interventions with a potential impact of greenhouse gases is voluntary.

The indicator reflects the total expected annual decline at the end of the reporting period

does not reflect the overall decline during the reporting period.

In the case of renewable energy estimate based on the amount of primary energy that is

produced supported devices in a given year (for one year after completion of the project or

for a calendar year after the project). Renewable energy should be neutral regarding the

emergence of greenhouse gases and to replace non-renewable energy production. Non-

renewable energy impact of greenhouse gases is estimated by the total greenhouse gas

emissions per unit of non-renewable energy production in the Member State.

For energy saving measures, estimated based on the amount of primary energy to be saved

supported activities in a given year (for one year after completion of the project or for a

calendar year after the project). Energy saving is to be replaced by non-renewable energy

production. Non-renewable energy impact of greenhouse gases is estimated by the total

greenhouse gas emissions per unit of non-renewable energy production in the Member State.

Page 58: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

58

Note

Indicator is common inferior MU Estimated annual reduction in greenhouse gas emissions

(CO34).

Unit of measure

t eq. CO2

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 2.1

10.8.9 Number “shortlisted” projects under Horizon 2020 with Slovak participation supported

from OP RaI (P0124)

Definition

The number of supported “shortlisted” projects under Horizon 2020 with Slovak participation.

In the case of projects with Slovak participation are rated as good quality, but not funded

due to lack of financial resources of the EU (the so-called “Shortlisted” projects), it will be

possible to reorient towards OP and financed under OP rules.

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Using marker

Priority axis 5

10.8.10 The number of administrative capacity financed by technical assistance (P0130)

Definition

The total annual average registered number of administrative capacity involved in the

implementation of the OP converted to full-time equivalent (FTE) whose wages are funded

from technical assistance.

Note

The indicator is inferior MU specific number of administrative capacity financed by technical

assistance (O0175).

Unit of measure

FTE

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Using marker

Priority axis 5

10.8.11 The number of activities to promote national system for technology transfer (P0134)

Definition

Number of activities to support the national system for technology transfer, for example

involvement of public research institutions in the functioning of the National Technology

Transfer Centre of the Slovak Republic, construction and operation of the patent pool, “proof

of concept” fund, setting out guidelines for providing support at the national level,

development of services of the National Technology Transfer Centre of the Slovak Republic.

Page 59: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

59

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.12 Number demonstration activities (P0147)

Definition

Number of demonstration activities using modern technologies in the areas of specialization

RIS3 SK.

Unit of measure

count

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.13 Number of other patent applications (P0170)

Definition

The number of patent applications filed at the patent office other than Gazette, EPO or the

USPTO within the supported projects. The patent application must be filed during the project

and must result from implementation of the project concerned.

Note

The indicator is inferior MU specific number of patent applications (O0073) Total project MU

The number of patent applications (P0280) and the other related to the following information: • The number of patent applications EPO (D0139), • The number of patent applications submitted Gazette (D0140), • The number of patent applications USPTO (D0141).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.14 Number of SMEs involved in EU programs (P0190)

Definition

It is the frequency of referred business entities that were involved in community programs

such as Horizon 2020, COSME and others. It is the Community programs aimed at the

integration of EU policies through the implementation of projects promoting and expanding

cooperation between Member States and the candidate countries of the EU in the long run.

Note

Specific indicator is inferior MU Number involvement of SMEs in EU programs (O0082).

Unit of measure

Number

Page 60: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

60

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 3.2 and 4.1

10.8.15 Number of returnees Slovak researchers from abroad (P0196)

Definition

Number of top Slovak scientists working abroad who have chosen to return to Slovakia. It

regards quality Slovak researchers, respectively promising Slovak young scientists from

abroad.

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1 and 2.2

10.8.16 Number of new SMEs established by people from disadvantaged social groups

(P0205)

Definition

The number of enterprises created receiving financial or other assistance (counseling,

guidance, etc.) from the Structural Funds and instruments financed by the Structural Funds.

Created enterprise did not exist three years before the project, but the management

authority or the national legislation may lay down a time criterion. The enterprise becomes

the new venture, if the only change its legal form.

Start-up, respectively Spin-off businesses are entities arising under §56 et seq. of Law No.

513/1991 Coll. of Commercial Code, as amended.

Entities incorporated in the marginalized social groups set up by SMEs mean: women, young

people up to 30 years, seniors over 50 years, long-term unemployed, nationals of third

countries, and socially disabled.

These enterprises created on the basis of the support provided in the form of: • grant, • repayable financial support, • non-financial support (e.g. counseling).

Note

Specific indicator is inferior MU Number of new SMEs established by people from

disadvantaged social groups (O0078).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 3.1

10.8.17 The number of new researchers in assisted companies (P0231)

Definition

Gross new jobs (which did not exist before) that will carry out directly research and

development activities in full time equivalents. Location must arise from the execution or

Page 61: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

61

completion of the project, to be filled (vacant posts are not counted) and increase the total

number of research jobs in the organization. Support staff for R&D (i.e., workers who are not

directly involved in R&D activities) are not counted.

The creation of official posts do not count if does not directly contribute to an increase in the

total number of research sites in the organization.

The equivalent of full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs

and jobs to part-time are converted to FTE using the methodology of the Statistical Office.

R&D jobs are usually created for a shorter time (“support”). Jobs created for different projects

are added together (under the condition that all projects receiving support), where it is

considered multiple counting.

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1 and 2.2

10.8.18 Number of patent applications (P0280)

Definition

The number of patent applications filed at Slovak or foreign patent office within the

supported projects. The patent application must be filed during the project and must result

from implementation of the project concerned.

Note

The indicator is inferior MU specific Number of patent applications (O0073) together with the

project MU Number of other patent applications (P0170) and the other related to the

following information: • The number of patent applications EPO (D0139), • The number of patent applications submitted Gazette (D0140), • The number of patent applications USPTO (D0141).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.19 Number of new researchers in assisted companies (P0282)

Definition

Gross new jobs (which did not exist before) that will carry out directly research and

development activities in full time equivalents. Location must arise from the execution or

completion of the project, to be filled (vacant posts are not counted) and increase the total

number of research jobs in the organization. Support staff for R&D (i.e., workers who are not

directly involved in R&D activities) are not counted.

The creation of official posts do not count if does not directly contribute to an increase in the

total number of research sites in the organization.

The equivalent full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs and

jobs to part-time are converted to FTE using the methodology of the Statistical Office. R&D

jobs are usually created for a shorter time (“support”). Jobs created for different projects are

Page 62: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

62

added together (under the condition that all projects receiving support), where it is

Considered multiple counting.

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1, 1.2, 2.1 and 2.2

10.8.20 Number of enterprises receiving financial support other than grants (P0283)

Definition

Number of enterprises receiving financial support other than a grant in the form of loans,

interest subsidies, loan guarantees, venture capital or other financial instrument.

Subgroup “The number of companies receiving support.”

The indicator is calculated as the total number of enterprises that have been granted

financial support other than grants.

Note

The indicator is inferior joint MU Number of enterprises receiving financial support other than

grants (CO03).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.3, 4.1

10.8.21 Number of enterprises receiving grants (P0284)

Definition

Number of enterprises receiving support in the form of non-repayable direct financial

assistance, subject to the completion of the project (grant) within the PO 2014-2020.

Subgroup “The number of companies receiving support.”

The indicator is calculated as the total number of enterprises that were given grants.

The number will be established on the basis of the monitoring reports and summary reports

ITMS.

Note

The indicator is inferior joint MU Number of enterprises receiving grants (CO03).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2, 3.1, 3.2, 3.3

Page 63: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

63

10.8.22 Number of enterprises receiving non-financial support (P0285)

Definition

Number of enterprises receiving support, which does not involve a direct financial transfer

(guidance, counseling, business incubators, etc.). Venture capital is considered financial

assistance.

Subgroup “The number of companies receiving support.”

Note

The indicator is inferior joint MU Number of enterprises receiving non-financial support (CO04).

Unit of measure

businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.23 Number of enterprises receiving non-financial support in promoting the provision of

information, advisory and mentoring services for SME development (P0286)

Definition

Number of enterprises receiving support under the support of the provision of information,

advisory and mentoring services for the development of SMEs, which does not involve a

direct financial transfer (guidance, counseling, business incubators, etc.). Venture capital is

considered financial assistance.

Subgroup C4.

Note

Specific indicator is inferior MU Number of enterprises receiving non-financial support in

promoting the provision of information, advisory and mentoring services for SME development

(O0083).

Unit of measure

businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 3.3

10.8.24 Number of enterprises receiving non-financial support in creating new business

models for creative industries (P0287)

Definition

Number of enterprises receiving support in creating new business models for the creative

industry, which does not involve a direct financial transfer (guidance, counseling, business

incubators, etc.) in creating new business models for the creative industries. Venture capital is

considered financial assistance.

Subgroup C4.

Note

Specific indicator is inferior MU Number of enterprises receiving non-financial support in

creating new business models for creative industries (O0084).

Page 64: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

64

Unit of measure

businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 3.3

10.8.25 Number of enterprises receiving support in order to introduce products that are new

for the company (P0288)

Definition

This indicator assesses whether backed company developing a product that is "new for the

company", as a result of the project. It includes the innovation process if that process

contributes to product development. Projects which aim to actual product development are

excluded. If the company makes a number of products, it shall be counted as one enterprise.

For cooperation projects this indicator takes into account all the participating companies for

which the product is new.

It should be used together with the C1 pointer.

Linked to an indicator C28. Although most classical innovation leads to products that are new

to the market and the company, some products may be new to the company but not for the

market, for example some technology transfer.

Note

The indicator is inferior joint MU Number of enterprises receiving support in order to introduce

products that are new for the company (CO29).

Unit of measure

Businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.26 Number of enterprises receiving support in order to introduce products that are new

to the market (P0289)

Definition

Indicator assesses whether assisted companies develop a product that is “new to market”

due to the project in any of its markets. It includes the innovation process if the process

contributes to the development of the product. Projects which aim to actual product

development are excluded. If the company markets several products, it shall be counted as

one enterprise. For cooperation projects this indicator takes into account all the undertakings

involved.

It should be used together with the C1 pointer.

It is linked to an indicator C29. Although most classical innovation leads to products that are

new to the market and the company, some products may be new to the market, but not for

the company, for example adapting existing products to the new market without changing

functionality.

Note

The indicator is inferior joint MU Number of enterprises receiving support in order to introduce

products that are new to the market (CO28).

Page 65: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

65

Unit of measure

businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.27 Number of supported cluster organizations (P0295)

Definition

Cluster organization means an institution representing mutually cooperating companies,

specialized suppliers, service providers, firms in related industries and institutions (e.g.

Universities, R&D organizations, trade unions) in certain areas (sectors), which both compete

but also cooperate.

The cluster organization has a separate legal form of business.

For backed by cluster organizations is considered that organization, which is provided:

• grant, • Repayable financial support, • Non-financial support (e.g. counseling).

Note

The indicator is inferior MU specific Number of supported cluster organizations (O0076).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2

10.8.28 Number of supported SMEs run by persons from disadvantaged social groups (P0301)

Definition

Number of supported holdings receiving financial or other assistance (counseling, guidance,

etc.) from the Structural Funds and instruments financed by the Structural Funds. Supported

enterprises did not exist three years before the project, but the management authority or the

national legislation may lay down a time criterion. The enterprise becomes the new venture, if

the only change its legal form.

Start-up, respectively Spin-off businesses are entities arising under §56 et seq. of Law No.

513/1991 Coll. of Commercial Code, as amended.

Entities incorporated in the marginalized social groups set up by SMEs means: women, young

people up to 30 years, seniors over 50 years, long-term unemployed, nationals of third

countries, and socially disabled.

These enterprises created on the basis of the support provided in the form of: • grant,

• repayable financial support, • non-financial support (e.g. counseling).

Note

Specific indicator is inferior MU Number of supported SMEs run by persons from

disadvantaged social groups (O0079).

Page 66: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

66

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priority 4.1

10.8.29 Number of supported new businesses (P0302)

Definition

The number of newly established enterprises receiving financial or other assistance

(counseling, guidance, etc.) from the Structural Funds and instruments financed by the

Structural Funds. The newly created company is one that patient died three years before the

project. The managing authority or national legislation may provide for a shorter time

criterion. For a newly created company is not undertaking which only changes its legal form.

Subgroup “The number of companies receiving support.”

The indicator is calculated as the total number of new businesses that have been granted

support.

The number will be established on the basis of the monitoring reports and summary reports

ITMS.

Note

Within the investment priorities 1.1 and 2.1 are identical to the project Number MU incurred

start-up and spin-off companies (P0535).

The indicator is inferior joint MU supported Number of new enterprises (CO05).

Unit of measure

businesses

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2, 3.1, 4.1

10.8.30 Number of supported business and support platforms (P0303)

Definition

In particular, the support platform (export consortia), which are a form of strategic

cooperation between enterprises. They serve as mediation service provider access to foreign

markets. Activities of these platforms may relate for example to the basic administrative

functions, help with translations, providing market research, assistance in developing an

overall export strategy, joint purchase of inputs, legal assistance, creating a common brand

alliance and other marketing services.

Note

Specific indicator is inferior MU Number of supported business and support platforms (O0081).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priority 3.2

Page 67: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

67

10.8.31 Number of supported enterprises through advisory centers for SMEs (P0306)

Definition

Counseling center means the institution providing advisory and other supported services

intended primarily for businesses.

Note

Specific indicator is inferior MU Number of enterprises supported through advisory centers for

SMEs (O0077).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 3.1, 4.1

10.8.32 Number of supported events, to increase the participation of Slovak Republic in ERA

(P0307)

Definition

Number of supported events, to increase the participation of the Slovak Republic in ERA.

Events will be implemented in the territory of the Slovak Republic - and will seek the support of

all types of events (information days, i.e. match-making events) and the related evaluation

and analysis of activities aimed at enhancing the participation of research institutions in SR

ERA. Support will also be events organized through the activities of the Liaison Office of the

Slovak Republic in Brussels, and will be supported networking events, which aim to integrate

more Slovak research institutions in consortia which have good chances to be successful in

projects Horizon 2020 strategy.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.33 Number of supported participation of foreign researchers in the project activities

Slovak R&D institutions (P0315)

Definition

Number of supporting the participation of top foreign researchers engaged in a specific

research project activities Slovak research institutions in the areas of specialization RIS3 SK.

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 2.1, 2.2

Page 68: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

68

10.8.34 Number of supported participation of Slovak Republic in ERA (P0316)

Definition

Number of supported participations of Slovak Republic in ERA through all kinds of Slovak

research institutions in international research consortia in the areas of specialization RIS3 SK.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.35 Number of supported participation of SR in other international initiatives (P0317)

Definition

Number of supporting the participation of Slovak Republic in other international initiatives,

such as ERA-NET, European Technology Platforms, EURAXESS.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.36 Number of supported research institutions (P0325)

Definition

Number of research institutions receiving non-repayable and repayable support from the OP

RaI (regardless of whether aid constitutes State aid or not).

Research institution: an organization whose main activity is R&D.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within one OP.

Note

Specific indicator is inferior MU Number of supported research institutions (O0069).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.37 Number of supported research institutions cooperating with companies (P0326)

Definition

Number of research institutions receiving non-repayable and repayable support from the OP

RaI (regardless of whether aid constitutes State aid or not). The project involving at least one

research institution cooperating with at least one undertaking. Support may get one or

several cooperating entities (research institutions or enterprises), but the granting of support is

conditional on cooperation. Cooperation may be new or existing. Cooperation should be

Page 69: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

69

continued for at least the duration of the project. Cooperation may be counted on the basis

of operations or subscribers. This indicator focuses on research institutions as participants.

Research institution: an organization whose main activity is R&D.

Enterprise: Organization producing products or services to meet the needs of the market and

thus make a profit. At the headquarters of the company (within the EU or outside it) does not

matter.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within one OP.

Note

Specific indicator is inferior MU Number of supported research institutions cooperating with

companies (O0070).

Unit of measure

count

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.38 Number of events organized to popularize the study of technical and natural science

(P0336)

Definition

Number of Targeted events organized to attract public interest and in particular the younger

generation of researchers' career, respectively workers for key industries identified RIS3 SK.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.39 Number of events organized for popularization of research and development (P0337)

Definition

Number of events organized for popularization of research and development, for example.

To support the implementation of coordinated national festival of science and technology,

professional events related to the science, research, development and society.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

Page 70: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

70

10.8.40 Number of applications for registration of intellectual property rights (P0355)

Definition

Intellectual property means farmhouse generated by certain intellectual content that term

objective is amenable to social relations without having to be its embodiment in tangible

form.

IPR can be: • copyright, rights related to copyright and rights related to copyright, • industrial rights and similar industrial rights.

1. Industrial rights to intellectual creations:

a) Patent Law (inventions),

b) the right (industrial) designs,

c) The right to utility models,

d) the right of topographies of semiconductor products,

e) rights of new varieties of plants and new breeds of animals,

2. Industrial right to designate:

a) trademark law (trademark law),

b) the right of designations of origin and geographical indications for products,

c) The right to trade names,

3. The rights similar to industrial rights:

a) innovatory Law (rationalization proposals),

b) the right to new methods of prevention, diagnosis and treatment of human

and animal health and protecting plants against pests and diseases,

c) the right know-how,

d) the right of the logo,

e) the right domain names,

f) the right to protect the name and reputation of the legal entity.

Note

Specific indicator is inferior MU registration number of applications of intellectual property

rights (O0072).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.41 Number of established services, tools and applications (P0359)

Definition

The number of requests to deploy the service, tools and applications designed to: • systematic access to computing and storage capacities and specialized application

software research institutions for the purpose of effective implementation of the

process of technology transfer, • coordinated approach to specialized, bibliometric, scientometric and scientifically-

oriented electronic information resources for the needs of research institutions, • computing capacity and high-performance computing in research projects, • consolidation of complementary wider use of Slovak infrastructure for high-

performance computing at the level of application and utility software equipment, • ensure sufficient high-speed data links between research institutions.

Unit of measure

Number

Page 71: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

71

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.42 Number of application solutions for experimental Cloud (P0377)

Definition

The number of application solutions on creating experimental cloud that will serve on ICT

research in the field of cloud applications, security systems and other related topics.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.43 Number of participating individuals and teams from Slovakia for “shortlisted” Horizon

2020 projects with Slovak participation supported from OP RaI (P0434)

Definition

Number of participating individuals and teams from Slovakia for “shortlisted” Horizon 2020

projects with Slovak participation supported from OP RaI. supported “shortlisted” projects

under Horizon 2020 with Slovak participation. In the case of projects with Slovak participation

are rated as good quality, but not funded due to lack of financial resources of the EU (the so-

called. "Shortlisted" projects), it will be possible to reorient towards OP RaI and financed under

OP RaI rules.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 2.1

10.8.44 Number of SMEs participating in fairs and exhibitions abroad (P0435)

Definition

Measurable indicator monitors the number of participating SMEs on promotions. Within these

shares of companies presenting their products and services with a view to their application

on the open market. This is a promotional actions conducted outside Slovakia.

Note

The indicator is inferior MU specific Number of SME participation in fairs and exhibitions

abroad (O0080).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priority 3.2

Page 72: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

72

10.8.45 Number of participants in advisory and training programs (P0442)

Definition

Number of all people in the target groups involved in counseling and educational activities.

The method of calculation: Calculates the number of participants (e.g. business) and not the

number of consultations (visits).

Note

Indicator is inferior MU specific number of participants counseling and educational programs

(O0075).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 3.1, 3.2, 3.3, 4.1

10.8.46 Number of UVP/VC involved in the creation and operation of technology transfer

centers and incubators (P0467)

Definition

Number of university science parks and research centers supported by the Operational

Programme Research and development involved in building and operating technology

transfer centers and incubators.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 2.1

10.8.47 Number of public buildings at low energy or ultranízkoenergetickej or nearly zero

energy requirement (P0469)

Definition

a) upper limit Energy Class B for all the indicators determines the level of low-energy

construction,

b) upper limit of the energy class and for individual indicators, while the upper limit of the

energy class A1 for global indicator ultralow energy determine the level of

construction (MDVRR SR Decree No. 364/2012 Coll. of Laws).

Note

The indicator is inferior MU specific Number of public buildings at low energy or ultralow

energy or nearly zero energy needs (O0180).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 2.1

Page 73: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

73

10.8.48 Number of creating centers for popularisation of research and development (P0474)

Definition

Number of creating centers for popularization of research and development, for example

Centers R&D infrastructure in the areas of specialization RIS3 SK in selected areas - particularly

Košice, Žilina, Nitra, or smaller centers in other geographical areas, provided the use of the

own resources of the partner institutions.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.49 Number of built local centers for technology transfer (P0486)

Definition

The number of local centers of technology transfer built following the realization of activities

related to the promotion of the national system for technology transfer.

Unit of measure

count

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.50 Number of built prototype devices and validation infrastructure in areas of

specialization RIS3 SK (P0499)

Definition

The number of devices and prototype validation infrastructure built in those areas of

specialization RIS3 SK, which are listed in Annex 4 Operational Programme Research and

Innovation.

Unit

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.51 Number of built facilities for research infrastructure (P0500)

Definition

Number of newly built offices infrastructures.

It is the number of workplace research infrastructure projects there - it is therefore necessary

to avoid duplication of the research institutions with more projects.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Page 74: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

74

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.52 Number of products that are new for the company (P0512)

Definition

This indicator assesses whether backed company developing a product that is “new for the

company”, as a result of the project. It includes the innovation process if that process

contributes to product development. Projects which aim to actual product development are

excluded. If the company makes a number of products, it shall be counted as one enterprise.

For cooperation projects this indicator takes into account all the participating companies for

which the product is new.

It should be used together with the C1 pointer.

It is linked to an indicator C28. Although most classical innovation leads to products that are

new to the market and the company, some products may be new to the company but not

for the market, for example, some technology transfer.

Note

It is related to the project MU: • The number of firms that receive support in order to introduce products that are new

for the company (P0288), • The number of firms that receive support in order to introduce products that are new to

the market (P0289), • The number of products that are new to the market (P0513).

It is also connected with the following common MU • The number of firms that receive support in order to introduce products that are new to

the market (CO28), • The number of firms that receive support in order to introduce products that are new

for the company (CO29).

Unit

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.53 Number of products that are new to the market (P0513)

Definition

Indicator assesses whether assisted companies develop a product that is “new to market”

due to the project in any of its markets. It includes the innovation process if the process

contributes to the development of the product. Projects which aim to actual product

development are excluded. If the company markets several products, it shall be counted as

one enterprise. For cooperation projects this indicator takes into account all the undertakings

involved.

It should be used together with the C1 pointer.

It is linked to an indicator C29. Although most classical innovation leads to products that are

new to the market and the company, some products may be new to the market, but not for

the company, for example adapting existing products to the new market without changing

functionality.

Note

It is related to the project MU:

Page 75: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

75

• The number of firms that receive support in order to introduce products that are new

for the company (P0288), • The number of firms that receive support in order to introduce products that are new to

the market (P0289), • The number of products which are new for the company (P0512).

It is also connected with the following common MU • The number of firms that receive support in order to introduce products that are new to

the market (CO28), • The number of firms that receive support in order to introduce products that are new

for the company (CO29).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.2, 2.2, 3.1, 3.2, 3.3, 4.1

10.8.54 Number of researchers working in the renovated facilities of research infrastructure

(P0514)

Definition

Existing workers (1) directly carrying out R&D activities and (2) are directly affected by the

project. Posts must be filled (vacant posts are not counted). Auxiliary staff for R&D (i.e.,

workers who are not directly involved in R&D activities), are not counted. If the number of

researchers’ jobs will increase as a result of the project, the new site will be included (see also

“The number of new researchers supported entities”).

The project must improve the facilities, i.e. their maintenance is excluded.

The equivalent full-time jobs: Jobs can be full-time or part-time or seasonal. Seasonal jobs and

jobs to part-time are converted to FTE using ILO standards / statistical / other standards.

Research infrastructure is a term used to denote a very diverse group of tangible or intangible

assets, and therefore cannot be captured using a limited number of physical indicators. In this

case, the approach, which focuses on non-financial investment dimension (employment)

and is able to express the range (size) intervention.

Note

The indicator is inferior joint MU number of researchers working in the renovated facilities of

research infrastructure (P0514).

Unit of measure

FTE

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2

10.8.55 Number of created experimental Cloud (P0521)

Definition

Number of created experimental cloud that will serve on ICT research in the field of cloud

applications, security systems and other related topics.

Unit of measure

Number

Page 76: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

76

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.56 Number incurred start-up and spin-off companies (P0535)

Definition

Number incurred start-up and spin-off businesses within the supported projects. Must be

incurred during the project.

Start-up Enterprise: Emerging company often still at the stage of developing a business plan

with a low starting costs, higher business risk and potentially higher returns in the event that

such an undertaking established itself in the market.

Spin-off Enterprise: holdings arising after splitting certain group of people or activities from the

parent organization for the purpose of commercialization of research and development

respectively. Intellectual property rights of the parent organization.

The indicator is a subset of indicator C5.

Note

Specific indicator is inferior MU Number incurred start-up and spin-off companies (O0074).

The indicator is also related to the common MU supported Number of new enterprises

(CO05).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 1.2, 2.1, 2.2, 3.1

10.8.57 Number of established and improved services, tools and applications (P0560)

Definition

The number of established and improved services, tools and applications designed to:

• systematic access to computing and storage capacities and specialized application

software research institutions for the purpose of effective implementation of the

process of technology transfer • coordinated approach to specialized, bibliometric, scientometric and scientifically-

oriented electronic information resources for the needs of research institutions • computing capacity and high-performance computing in research projects

• consolidation of complementary wider use of Slovak infrastructure for high-

performance computing at the level of application and utility software equipment • ensure sufficient high-speed data links between research institutions.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

Page 77: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

77

10.8.58 Number of completed evaluations, analyzes and studies (P0588)

Definition

Total number of evaluations, analyzes and studies of realized funds from OP TP.

Note

The indicator is inferior MU specific number of completed evaluations, analyzes and studies

(O0181).

Unit of measure

businesses

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Use of indicator

Priority axis 5

10.8.59 Number of realized information activities (P0589)

Definition

The total number of information activities realized from the funds of technical assistance OP.

Information activities means of conferences, trainings, seminars, workshops, INFODENT, fairs,

exhibitions, TV / radio spot, advertising on the Internet, advertising in the press, publication,

website, polling and other activities aimed at informing the target groups (including the

general public).

Note

Specific indicator is inferior MU previous Number of information activities (O0178) and the

other related to the following information: • The number of persons interviewed general public information activities (D0134), • Persons applicants /beneficiaries involved in information activities (D0136).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Using marker

Priority axis 5

10.8.60 Number of realized events related to the protection of intellectual property rights and

technology per transfer (P0593)

Definition

Number of events to raise awareness of the scientific community about the importance of

intellectual property protection and the whole process of technology transfer aimed at

raising awareness of the need for protection and commercialization of intellectual property

and creating professional background capacities that worked on the implementation of

technology transfer in the Slovak Republic.

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

Page 78: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

78

10.8.61 Number of realized educational activities (P0596)

Definition

The total number of training actions for administrative capacity involved in the

implementation of OP funds realized from the technical assistance OPs. Educational activities

mean training, seminars, workshops, professional traineeship aimed at exchange of

experience and under.

Note

The indicator is inferior MU specific number of completed training activities (O0163) and the

other related to the following information:

• Number of employees who took part in educational activities (D0196),

• The number of completed external training activities (D0198),

• The number of completed internal training activities (D0199).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Using marker

Priority axis 5

10.8.62 Number of reconstructed facilities of research infrastructure (P0601)

Definition

Number of workplace research infrastructures with a reconstructed interior fittings and exterior

modifications to modernize in terms of research and development and energy saving,

reduction of environmental burden or barrier-free entry and movement for work, t. j.

Maintenance is excluded.

It is the number of workplace research infrastructure projects there - it is therefore necessary

to avoid duplication of the research institutions with more projects.

Note

Specific indicator is inferior MU reconstructed facilities Number of research infrastructures

(O0071).

Unit of measure

Number

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 1.1, 2.1

10.8.63 Setting up of national technology platforms (P0602)

Definition

Setting up of national technology platforms as a tool for Slovakia's participation in the

European technology platforms and joint technology initiatives in the areas of specialization

RIS3 SK. The identification of a list of platforms that are relevant to the SR will support the

establishment of national technological initiatives/platforms and networking activities to

ensure active participation of Slovak institutions in the European platform through their

counterpart organizations established in the Slovak Republic.

Unit of measure

Number

Page 79: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

79

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 1.1

10.8.64 Share of administrative capacities equipped with material and technical equipment

of TP (P0609)

Definition

The share of the average annual number of registered administrative capacity involved in

the implementation of the OP-equipped material and technical equipment of TP means the

total average annual number of registered administrative capacity involved in the

implementation of the OP.

Note

Specific indicator is inferior MU share of administrative capacities equipped with material and

technical equipment of TP (O0182).

Unit of measure

%

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, ongoing.

Using marker

Priority axis 5

10.8.65 Floor area of renewed beyond the minimum requirements (P0612)

Definition

Total floor area of restored buildings beyond the minimum requirements based on data from

energy audits required for the purposes of this measure.

Note

The indicator is inferior MU Specific area of a building restored beyond the minimum

requirements (O0183).

Unit of measure

m2

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 2.1

10.8.66 Private investment matching public support to enterprises (grants) (P0631)

Definition

The total value of private contribution in supported projects that meet the definition of State

aid, where aid takes the form of a grant (see 2 common indicator “Number of enterprises

receiving grants”), including the unjustified part of the project.

Note

The indicator is inferior joint MU Private investment matching public support to enterprises

(grants) (CO06).

Unit of measure

EUR

Page 80: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

80

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 3.1, 3.2, 3.3, 4.1

10.8.67 Private investment matching public support to enterprises (excluding grants) (P0632)

Definition

The total value of private contribution in supported projects that meet the definition of State

aid, where aid takes the form of a grant (see 2 common indicator "Number of enterprises

receiving grants"), including the unjustified part of the project.

Note

The indicator is inferior joint MU Private investment matching public support to enterprises

(excluding grants) (CO07).

Unit of measure

EUR

Data source and frequency of measurement

ITMS, ongoing.

Using marker

investment priorities 3.1, 3.2, 3.3, 4.1

10.8.68 Reduced annual primary energy consumption in public buildings (P0700)

Definition

The calculations are based on building energy certificate (see Art. 12, paragraph 1, point. b)

of the Directive 2010/31/EU). In accordance with the deadlines stipulated in the Directive

pointer must be valid for all public buildings with a total useful floor area over 500 m2 and

reconstructed with the help of the Structural Funds. If construction begins after 9 July 2015, the

threshold for public buildings will be reduced to total usable area of 250 m2. RO can be

included in the calculation of the building with a floor area of less than 250 m2 (500 m2 or

before July 9, 2015).

Note

The indicator is inferior joint MU reduced annual primary energy consumption in public

buildings (CO32).

Unit of measure

kWh/year

Data source and frequency of measurement

ITMS, ongoing.

Using marker

Investment Priority 2.1

10.9 Other data

10.9.1 Number of measures to reduce the administrative burden (D0127)

Definition

The total number of measures adopted by the RO/SO in order to reduce the administrative

burden on applicants /beneficiaries in connection with the preparation and implementation

of projects.

Page 81: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

81

Note

Data relate to a specific output indicators Number of measures for reducing administrative

burdens (O0048).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.9.2 Number of completed internal training activities (D0199)

Definition

The total number of training activities organized by the RO/SO identified administrative

capacity involved in the implementation of OP funds realized from the technical assistance

OPs. Educational activities mean training, seminars, workshops, professional traineeship aimed

at exchange of experience and under.

Note

Data relate to a specific output indicators Number of completed training activities (O0163) is

part of a project of Number of realized educational activities (P0596) along with the following

other data: • The number of completed external training activities (D0198), • Number of employees who took part in educational activities (D0196).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.9.3 Previous Number of external educational activities (D0198)

Definition

The total number of training activities organized by external actors (outside RO/SO) intended

for administrative capacity involved in the implementation of the OP. Educational activities

means training, seminars, workshops, professional traineeship aimed at exchange of

experience and under.

Note

Data relate to a specific output indicators Number of completed training activities (O0163) is

part of a project of Number of realized educational activities (P0596) along with the following

other data: • The number of completed internal training activities (D0199), • Number of employees who took part in educational activities (D0196).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

Page 82: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

82

10.9.4 Number of employees who took part in educational activities (D0196)

Definition

Total administrative capacity involved in the implementation of the OP, which participated in

educational activities to be financed by TP OP.

Note

Data relate to a specific output indicators Number of completed training activities (O0163) is

part of a project of Number of realized educational activities (P0596) along with the following

other data: • The number of completed internal training activities (D0199), • The number of completed external training activities (D0198).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.9.5 Persons addressed to the general public information activities (D0134)

Definition

The total number of persons who were informed through information activities on the basis of

completed projects OP RaI.

Information activities shall mean in particular: conferences, fairs, exhibition, TV/radio spot,

advertising on the Internet, advertising in the press, publication, website, polling and other

activities aimed at informing the general public.

Note

Data relate to a specific output indicators Number of completed informative activities

(O0178) is part of a project of Number of realized information activities (P0589) along with

other data Number of persons applicants /beneficiaries involved in information activities

(D0136).

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

10.9.6 Persons applicants/beneficiaries involved in information activities (D0136)

Definition

Total number of persons applicant /recipient who were informed through information

activities on the basis of completed projects OP RaI.

Information activities shall mean in particular: training, seminars, workshops, INFODENT, and

other activities aimed at informing the applicants / beneficiaries.

Note

Data relate to a specific output indicators Number of completed informative activities

(O0178) is part of a project of Number of realized information activities (P0589) along with

other data Number of persons interviewed general public information activities (D0134).

Page 83: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

83

Unit of measure

Number

Data source and frequency of measurement

Managing Authority and Intermediate Bodies, annually.

Using marker

Priority axis 5

Page 84: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

84

11 Performance framework

Performance framework RaI OP constitutes a financial indicator for each priority axis, which is

a mandatory part, some specific indicators of output and common. There were also the

performance framework used key implementation steps.

MA's RaI not used for any of the priority axes Result measurable indicator because the result

measurable indicators monitor a wider audience to which intervention does not affect

performance due to the capacity allocation as determined. Therefore MA's RaI not

responsible for the individual behavior of the entire population of the target groups.

In the process of selection of measurable indicators included in the performance framework

indicators were all certified under paragraph. 3 of Annex II of the Regulation, which speaks of

the quality requirements indicators of performance framework. Specifically, the requirement

for the indicators to be:

1. realistic and achievable,

2. relevant and reflect the basic information on the progress made in the

implementation of the priority axis,

3. In accordance with the nature and character of the specific objectives of the priority

axis,

4. transparent, with objectively verifiable targets and identified and, where possible,

publicly available source data,

5. verifiable, without disproportionate administrative burden,

6. The uniform for all programs, where necessary, respectively. appropriate.

11.1 Rationale for selecting the physical progress indicators in the performance framework

11.1.1 Priority 1

The number of contracted research institutions (key implementation step, K0003)

As the value of plan for 2023, as well as intermediate targets for 2018 are set to discontinued

operations and length of project implementation is expected two to three years, 31 12 2018

are anticipated from discontinued operations respectively. only the minimum, that reason

was to determine the milestones selected key implementation step, which comprises 51.89%

of the allocation priority axis i.e. 1.1 Investment priorities and specific objectives 1.2.1.

In this step, implementing the key cover the same research institutions as the output for

variable “Number of supported research institutions”, the difference is that the key

implementation feature also applies to the uncompleted operations (projects), i.e. it is

sufficient that the relevant research institution been awarded the contract for the provision of

the grant. The values for 2018 are based on the unit price of OP R&D and accumulated

financial allocation OP RaI investment priority 1.1 and 1.2.1 specific target values for the year

2023 are consistent with the estimated final number of supported research institutions.

Number of supported research institutions (output indicator, O0069)

In most of the activities within this priority (51.89% of the allocation, i.e. all the activities of

investment priorities 1.1 and specific objectives 1.2.1) will be supported by research

institutions. It will track the number of research institutions receiving non-repayable support OP

RaI (regardless of whether aid constitutes State aid or not) and also whether it participates in

the project, at least one research institution cooperating with at least one undertaking, with

the headquarters of the company (the EU or outside it) does not matter. Support may get

one or several cooperating entities (research institutions or enterprises), but the granting of

support is conditional on cooperation. Cooperation may be new or existing. Cooperation

should be continued for at least the duration of the project. Cooperation may be counted

on the basis of operations or subscribers. This indicator focuses on research institutions as

participants.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within the OP RaI through unique identification number, which will be monitored by

the monitoring system.

Page 85: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

85

For the year 2018 does not foresee discontinued operations (which is the reason for the key

implementing step), so that by the end of 2018 is expected to be zero in this indicator, the

figure for 2023 was determined based on the unit price of OP R & D and the total allocation

for the priority axis OP RaI.

11.1.2 Priority 2

The number of contracted research institutions (key implementation step, K0003)

As the value of plan for 2023, as well as intermediate targets for 2018 are set to discontinued

operations and length of project implementation is expected two to three years, 31 12 2018

are anticipated from discontinued operations respectively. only the minimum, that reason

was to determine the milestones selected key implementation step, which comprises 72.15%

of the allocation priority axis i.e. 2.1 Investment priorities and specific objectives 2.2.1.

In this step, implementing the key cover the same research institutions as the output for

variable “Number of supported research institutions”, the difference is that the key

implementation feature also applies to the uncompleted operations (projects), i.e. it is

sufficient that the relevant research institution been awarded the contract for the provision of

the grant. The values for 2018 are based on the unit price of OP R&D and accumulated

financial allocation OP RaI investment priority 1.1 and 1.2.1 specific target values for the year

2023 are consistent with the estimated final number of supported research institutions.

Number of supported research institutions (output indicator, O0069)

In most of the activities within this priority (72.15% of the allocation, i.e. all the activities of

investment priorities 2.1 and specific objectives 2.2.1) will be supported by research

institutions. It will track the number of research institutions receiving non-repayable support OP

RaI (regardless of whether aid constitutes State aid or not) and also whether it participates in

the project, at least one research institution cooperating with at least one undertaking, with

the headquarters of the company (the EU or outside it) does not matter. Support may get

one or several cooperating entities (research institutions or enterprises), but the granting of

support is conditional on cooperation. Cooperation may be new or existing. Cooperation

should be continued for at least the duration of the project. Cooperation may be counted

on the basis of operations or subscribers. This indicator focuses on research institutions as

participants.

It is necessary to avoid multiple counting of the research institutions participating in several

projects within the OP RaI through unique identification number, which will be monitored by

the monitoring system.

For the year 2018 does not foresee discontinued operations (which is the reason for the key

implementing step), so that by the end of 2018 is expected to be zero in this indicator, the

figure for 2023 was determined based on the unit price of OP R&D and the total allocation for

the priority axis OP RaI.

11.1.3 Priority 3

Number of enterprises supported through advisory centers for SMEs (key implementation step,

K0001)

Key implementation step was introduced into the structure of the performance framework for

the priority axis 3 due to the fact that a large part of the allocation should be implemented

through projects of a national implementation throughout the entire program period. The

condition of offsetting output to an annual physical progress is that the given value should be

as successfully completed operations (projects), therefore it would not be possible to report

any value in 2018.

To that keyword Implementing step should help national project include the activity: Support

activities and development of business centers in the regions of Slovakia - the type of one-

stop-shop) to established institutions for SMEs, as well as those interested in business with the

use of existing infrastructure.

Page 86: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

86

Number of enterprises supported through advisory centers for SMEs (output indicator, O0077)

The measurable characteristic is mirrored on the aforementioned Implementing a key step.

Number of enterprises receiving non-financial support in promoting the provision of

information, advisory and mentoring services for SME development (key implementation step,

K0004)

Justification for the choice of implementing key step is identical to the previous one. To that

keyword implementing step should help national project falling under activity: provision of

information, counseling and mentoring services for SME development.

Number of enterprises receiving non-financial support in promoting the provision of

information, advisory and mentoring services for SME development (output indicator, O0083)

The measurable characteristic is mirrored on the aforementioned Implementing a key step.

Number of enterprises receiving non-financial support in creating new business models for

creative industries (key implementation step, K0005)

Justification for the choice of implementing key step is identical to the previous one. To that

keyword implementing step should help national project include the activity: Creating new

business models for the creative industries.

Number of enterprises receiving non-financial support in creating new business models for

creative industries (output indicator, O0084)

The measurable characteristic is mirrored on the aforementioned Implementing a key step.

Number of enterprises receiving grants (variable output CO02)

The measurable indicator based on a number of activities that would be given to him post

due to the fact that the activity would be implemented through grant support. Number of

businesses receiving grants is easily monitorable measurable indicator, which may have MA's

RaI largely influence through challenges that will be said. This indicator reflects only the

number of successfully supported enterprises, as will be counted only successfully supported

enterprises. Also on the part of the recipient's motivation to fill the measurable indicator, given

the fact that without the successful completion of the physical implementation will not be

reimbursed final payment.

This indicator should be filled through projects implemented within the following exemplary

activities:

• Support for new and start-up SMEs through grants and financial instruments (credit

program to support new and start-up SMEs, venture capital for start-ups in phases

seed and start up) also seeks to support industry and services, including knowledge-

intensive services (KIS) and new , progressive industries); • Support networking informal investors in financing the initial stages of the business

cycle

• Promoting the use of new ideas in the economy - SBIR scheme, • Identification and use of social business innovation and job creation, particularly for

disadvantaged social groups (women, young people up to 30 years, seniors over 50

years, long-term unemployed, nationals of third countries, the social and disabled); • The participation of Slovak enterprises in presentation events;

• The participation of Slovak enterprises in presentation events; • involvement of SMEs in EU community programs • Provision of information, advisory and mentoring services for SME development; • The development of existing SMEs through grants and financial instruments (credit

programs for various SME segments, respectively. Various thematic areas, venture

capital for developing SMEs);

• Use of e-business tools SMEs • Development of alternative business models, • raise standards of performance and functionality of SMEs, including the green

economy.

Page 87: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

87

11.1.4 Priority Axis 4

Number of enterprises supported through advisory centers for SMEs (key implementation step,

K0001)

Justification for the choice of implementing key step is identical to the previous ones. To that

keyword Implementing step should help national project included the activity: Support

activities and development of business centers in Bratislava region (National Business center

(NPC) in Bratislava) with a view to establishment of supporting institutions for SMEs, as well as

those interested in entrepreneurship.

Number of enterprises supported through advisory centers for SMEs (output indicator, O0077)

The measurable characteristic is mirrored on the aforementioned Implementing a key step.

11.2 Financial implementation

11.2.1 Baseline with determining financial indicator

When estimating the financial progress of the OP RaI in the programming period 2014-2020 it

is primarily based on the development of contracting and spending the previous

programming period 2007-2013 under OP Competitiveness aa OP R&D, where the managing

authorities of the Ministry of Economy and the Ministry of Education, Science, Research and

Sports of the Slovak Republic.

11.2.1.1 Baseline with determining financial indicator in 2018 and 2023 based on the

development of OP R & D from 2007 to 2013

As regards developments in the financial OPVaV implementation in the 2007-2013 period , it

should be noted that only thanks exempt from the rule N + 3/N + 2 at the end of 2013 did not

automatically adjusted commitment in 2011 for both programs' objectives . One major

reason was the significant time difference at the level of contracting allocated funds , which

were not provided adequate financial provision for the smooth implementation of the N +

3/N + 2 rule.

Development of the national contracting and demand-driven projects in the period 2007-

2014 OPVaV

To date Cumulativ increase

(ERDF)

% of the

total

allocation

Annually increase (ERDF)

% of the

total

allocation

2007 0,00 0,00% 0,00 0,00%

31.12.2008 66 126 948,09 5,47% 66 126 948,09 5,47%

31.12.2009 308 528 981,80 25,51% 242 402 033,71 20,04%

31.12.2010 661 287 722,12 54,68% 352 758 740,32 29,17%

31.12.2011 724 161 451,98 59,88% 62 873 729,86 5,20%

31.12.2012 867 082 294,63 71,69% 142 920 842,65 11,82%

31.12.2013 1 260 199 603,28 104,20% 393 117 308,65 32,50%

31.7.2014 1 333 907 459,58 110,29% 73 707 856,30 6,09%

Data on the development of contracted funds OPVaV shows that a significant decrease in

the volume of concluded contracts for the grant occurred in the period 2011-2012, which

was contracted by up to 12% less funding than those in 2010. The annual decrease is resulted

in a lower rate of annual growth of drawdowns over the next years 2012 to 2013.

Page 88: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

88

Other significant increase in contracted funds occurred in 2013 when there was a yearly

increase of more than 32% of the total allocation, creating the assumption of higher annual

growth of spending against the remaining period 2014-2015.

The development of the financial implementation of national and demand-driven projects in

the period 2007-2014 OPVaV

To date Cumulativ increase

(ERDF)

% of the

total

allocation

Annually increase (ERDF)

% of the

total

allocation

2007 0,00 0,00% 0,00 0,00%

31.12.2008 681 985,86 0,06% 681 985,86 0,06%

31.12.2009 33 450 587,46 2,77% 32 768 601,60 2,71%

31.12.2010 119 798 054,76 9,91% 86 347 467,30 7,14%

31.12.2011 243 544 096,30 20,14% 123 746 041,54 10,23%

31.12.2012 389 736 436,57 32,23% 146 192 340,27 12,09%

31.12.2013 546 651 450,15 45,20% 156 915 013,58 12,97%

31.7.2014 660 189 884,26 54,59% 113 538 434,11 9,39%

plán k 31.12.2014 870 981 354,26 72,02% 210 791 470,00 17,43%

The data on the evolution of the financial implementation of national and demand-driven

projects OPVaV shows that during the period there was a slowdown in the annual growth of

drawdowns during 2012 and 2013. In the case of the projected for 2014 would total

exhaustion of allocation for the 2007-2013 programming period had reach the level of 72%,

which also represented the highest annual increase spending by 17,43% . In 2015 it can

expect probably the highest year on year increase in the volume of approved eligible

expenses in view of the fact that this year will be the final period for eligibility of expenditure

and for the projected and expected expenditure in 2014 would still be 28% remained an

unused allocation.

Page 89: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

89

For this reason the Ministry of Education, Science, Research and Sports of the Slovak Republic

in estimating spending allocations assigned in the programming period 2014-2020 based on

the optimistic assumption that contracts for non-repayable financial contribution of 100% of

the allocation will be concluded with the beneficiaries at an earlier date than in the previous

programming period 2007-2013. That assumption also changes the view on the overall

development of the financial implementation of contracted projects at a time, which means

that in its fulfillment should be achieved the highest annual increase spending already in

progress and not until the last year of the period of eligibility of expenditure as in the case

OPVaV. When estimating spending was the influence of the financial implementation of

each planned projects depending on their type, which means that in case of demand-driven

projects on the assumption shorter period of their financial implementation from the date of

contracting as in the case of national projects.

11.2.1.2 Baseline with determining financial indicator in 2018 and 2023 based on the

development of OP Competitiveness 2007-2013

Financial progress in the implementation of each

year can be estimated on the basis of utilization

during the previous programming period i.e.

Measure 1.1 and 1.3 of the OP C&EG, which are

most similar intervention logic priority axes OP RaI

under the auspices of the Ministry of Economy.

681 985,86

32 768 601,60

86 347 467,30 123 746 041,54

146 192 340,27 156 915 013,58

113 538 434,11

210 791 470,00

0,00

50 000 000,00

100 000 000,00

150 000 000,00

200 000 000,00

250 000 000,00

300 000 000,00

350 000 000,00

400 000 000,00

450 000 000,00

0,00

50 000 000,00

100 000 000,00

150 000 000,00

200 000 000,00

250 000 000,00

The development of contracting and fin. OPVaV implementation in the

period 2007-2014

Vývoj kontrahovania projektov OPVaV v období 2007-2014

Vývoj finančnej implemtácie OPVaV v období 2007-2014Trend of the OPVaV project contracting in the periond 2007 - 2014 Trend of the OPVaV financial implementation in the period 2007 - 2014

2007 2008 2009 2010 2011

drawn NFC 0 169 51 044 76 683 7 560

cumulative 0 169 51 213 127 896 135 456

ratio of the total allocation 0% 0,03% 10% 25% 27%

annual increase 0% 0,03% 10% 15% 12%

Source: ITMS

NFC ERDF drawing in thousands Euros for successfully completed projects

The drawing trend within the

measures 1.1 and 1.3 of the OP KaHR

% a

llo

ca

tio

n d

raw

nin

g

monitored period

drawing ratio on the overall allocation cumulative

Page 90: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

90

From the table it is obvious that in the fifth year of the

programming period has been exhausted 27% under

Measure 1.1 and 1.3 of the OP C & EG. The fifth year of

the program period will be crucial in terms of setting a

milestone in the performance framework OP RaI.

The graph is also apparent that in drawing recipients

originated quite significant interannual fluctuations.

For example, between 2010 and 2011 it was reduced

annual utilization ratio of the total allocation of around

3%.

In comparison with the evolution of the entire OP KaH was implemented under measures 1.1

and 1.3 OP Competitiveness relatively smoothly (see chart opposite). In the fifth year of the

programming period, but exhausted only 22 % of the total allocation. This means that total

spending is slower than spending under measures 1.1 and 1.3 In 2013 requests were

processed for payment “problem” projects. This phenomenon is to some extent also reduced

the percentage of the total spending allocation during that period.

It is advisable to plan spending priority axes and parts of the priority axes of OP RaI under the

auspices of the Ministry of Economy of the prior drawing by a stable trend for the previous

period smoothed by local extremes.

In 2018, it is possible to calculate the financial up of projects supported at the level of 29%.

According to the methodological instructions of the CCA for the performance framework is

necessary to subtract the allocation earmarked for the performance reserve in the

calculation of the cornerstones of the priority axis.

After deduction of the performance

reserve of the total allocation of priority

axes and investment priorities OP RaI

under the auspices of the Ministry of

Economy can be assumed that at the

end of the fifth year of the programming

period, i.e. in 2018, it should be pumped

at around 27,16 % or 27,22 %, depending

on the operations belonging to the

priority axis of the OP RaI. Impact of the

performance reserve has been

calculated by a mathematical algorithm

below

[

(

)]

2007 2008 2009 2010 2011 2012 2013 2014 2015 alocation

drawing 753 973 13 152 135 67 392 854 133 392 252 129 276 408 34 651 162 22 116 445 59 590 824 968 250 000

cumulative 13 152 135 80 544 989 213 937 241 343 213 649 377 864 811 399 981 256 459 572 080

% from total 0% 0% 1% 7% 14% 13% 4% 2% 6% 48%

% from total cumulative 0% 0% 1% 8% 22% 35% 39% 41% 47%

Source: ITMS

Drawing plan without the allocation for the national projects

annual drawing ratio 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023

entire allocation (% p. a.) 0% 0% 1% 14% 14% 15% 15% 15% 15% 11%

entire allocation (% cumulative) 0% 0% 1% 15% 29% 44% 59% 75% 89% 100%

entire allocation (EUR p. a.) 0 0 12 357 351 173 002 915 173 002 915 185 360 267 185 360 267 185 360 267 185 360 267 135 930 862

entire allocation (EUR cumulative) 0 0 12 357 351 185 360 267 358 363 182 543 723 448 729 083 715 914 443 981 1 099 804 248 1 235 735 110

Source: MH SR

% d

raw

ing

fro

m t

he

all

oc

ati

on

monitored period

drawing fom the allocation cumulative

The drawing trend within the

entire OP KaHR (ERDF)

% d

raw

ing

fro

m t

he

all

oc

ati

on

monitored period

drawing plan cumulative plan

Estimated drawing plan within the OP RaI

priority axis under the auspices of MH SR

Page 91: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

91

In the table are recalculated each drawing ratios of the total allocation for the priority axis.

The percentages are the sum of ratios for individual activities within the priority axis in which

the level of spending was planned in terms of estimated learning curve RaI OP

implementation of activities under the auspices of the Ministry of Economy. From the table it is

obvious that for each priority axis OP RaI will draw others. The biggest spending in 2018 can

be expected under Priority Axis 1 of the OP RaI smallest in priority axis 4 OP RaI in proportion to

the national project which should be completed at the end of the program period.

We do not expect significant not

drawing the total allocation for the

Ministry of Economy of the OP RaI

therefore presented in 2024 zero

conditions.

The curve shown in the graph is

characterized by extremes in the end

due to completion of the above-

mentioned national projects by

beneficiaries in 2023 should receive

the final payment.

% Mentioned ratios can be used to estimate

the financial spending of financial indicators

for intervention activities. The allocations for

individual activities must be added the co-

financing from the state budget and private

national resources to do so could be estimated spending for the purposes of verifying

compliance with the conditions set out in the performance framework for OP RaI.

11.2.2 Quantification of the financial indicator based on the expected evolution of the

financial progress of the OP RaI

11.2.2.1 The expected evolution of the financial progress of Priority Axis 1

Priority axis 1

Non-cumulative data Cumulative data

ERDF

National

co-financing

(indicative) *

ERDF

National

co-financing

(indicative) *

2014 0 0 0 0

2015 2 500 000 441 177 2 500 000 441 177

2016 34 724 493 16 214 799 37 224 493 16 655 976

2017 194 576 735 128 693 746 231 801 228 145 349 722

2018 235 210 947 145 024 007 467 012 175 290 373 729

2019 268 990 952 172 937 175 736 003 127 463 310 904

2020 255 214 430 160 991 275 991 217 557 624 302 179

Drawing plan after deducting of the allocation for the national projects

monitored period 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Priority axis 1 0,00% 0,00% 0,94% 14,05% 27,16% 44,00% 59,00% 74,00% 89,00% 100,00% 0,00%

Priority axis 2 0,00% 0,00% 0,94% 14,08% 27,22% 44,00% 59,00% 74,00% 89,00% 100,00% 0,00%

Priority axis 3 0,00% 0,00% 0,94% 14,05% 27,16% 44,00% 59,00% 74,00% 89,00% 100,00% 0,00%

Priority axis 4 0,00% 0,00% 0,94% 14,08% 27,22% 44,00% 59,00% 74,00% 89,00% 100,00% 0,00%

Source: MH SR

%

an

nu

al

dra

win

g f

rom

th

e

tota

l a

llo

ca

tio

n

monitored period

Average drawing intervention trend under the auspices of

MH SR within the OP RaI (only properly completed

projects)

monitored period

Priority axis 1

Priority axis 2

Priority axis 3

Priority axis 4

Source: MH SR

10,92%

drawing 2018

24,67%

19,77%

19,41%

Page 92: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

92

2021 243 729 446 157 614 274 1 234 947 003 781 916 453

2022 223 356 500 150 924 454 1 458 303 503 932 840 907

2023 150 554 621 106 098 802 1 608 858 124 1 038 939 709

2024 42 575 755 17 614 044 1 651 433 879 1 056 553 753

Total 2014-2024 1 651 433 879 1 056 553 753 - -

* National co-financing is related to the ERDF funds only indicative calculated based on the expected

volume contracting by type of recipients

0,00% 0,11% 1,99%

13,93%

27,97%

44,29%

59,66%

74,48%

88,30% 97,78%

100,00%

0,00%

20,00%

40,00%

60,00%

80,00%

100,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 1

(OPVaI) - cumulative

Prioritná os 1Priority axis 1

0,00% 0,11%

1,88%

11,94%

14,04%

16,32%

15,37% 14,82%

13,82%

9,48%

2,22% 0,00%

2,00%

4,00%

6,00%

8,00%

10,00%

12,00%

14,00%

16,00%

18,00%

20,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 1

(OPVaI) - non-cumulative

Prioritná os 1Priority axis 1

Page 93: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

93

In the case of development of the financial progress of Priority Axis 1 is foreseen highest

annual increase spending in the sixth year of the programming period 2014-2020. In 2018,

spending is expected to achieve at the level of the total eligible expenditure of EUR 757 385

904 EUR (of which 467 012 175 EUR and a source of ERDF 290 373 729 EUR is indicative

quantified national co-financing).

Taking into account the performance reserve allocation of Priority Axis 1 can be assumed

that at the end of the fifth year of the programming period, i.e. in 2018 should reach the level

pumping 709 351 762 EUR (of which 437 393 814 EUR presents a source of ERDF and 271 957

948 EUR indicative quantified national co-financing).

Impact of the performance reserve has been calculated by a mathematical algorithm

described above.

11.2.2.2 The expected evolution of the financial progress of Priority Axis 2

Priority axis 2

Non-cumulative data Cumulative data

ERDF

National

co-financing

(indicative)*

ERDF

National

co-financing

(indicative)*

2014 0 0 0 0

2015 0 0 0 0

2016 1 224 411 1 407 726 1 224 411 1 407 726

2017 14 097 846 15 939 212 15 322 257 17 346 938

2018 25 214 993 28 318 076 40 537 250 45 665 014

2019 25 893 727 28 810 395 66 430 977 74 475 409

2020 24 170 758 26 642 272 90 601 735 101 117 681

2021 19 377 185 20 457 185 109 978 920 121 574 866

2022 17 577 185 17 577 185 127 556 105 139 152 051

2023 12 120 014 12 120 014 139 676 119 151 272 065

2024 4 619 530 4 619 530 144 295 649 155 891 595

Total 2014-2024 144 295 649 155 891 595 - -

* National co-financing is related to the ERDF funds only indicative calculated based on the

expected volume contracting by type of recipients

Page 94: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

94

In the case of development of the financial progress of Priority Axis 2 is expected the highest

annual increase spending in the sixth year of the programming period 2014-2020. In 2018,

spending is expected to achieve the level of total eligible costs amounting to € 86,202,264 (of

which 40 537 250 EUROS presents a source of ERDF and EUR 45 665 014 is indicative quantified

national co-financing).

Taking into account the performance reserve allocation of Priority Axis 2 can be assumed

that at the end of the fifth year of the programming period, i.e. in 2018 should reach the level

pumping EUR 80 906 674 (of which 38 046 960 EUROS presents a source of ERDF and 42 859 714

is indicative quantified national co-financing).

Impact of the performance reserve has been calculated by a mathematical algorithm

described above.

0,00% 0,00% 0,88%

10,88%

28,72%

46,94%

63,87%

77,14%

88,85% 96,92%

100,00%

0,00%

20,00%

40,00%

60,00%

80,00%

100,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 2

(OPVaI) - cumulative

Prioritná os 2Priority axis 2

0,00% 0,00%

0,88%

10,01%

17,83% 18,22%

16,93%

13,27% 11,71%

8,07%

3,08% 0,00%

5,00%

10,00%

15,00%

20,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 2

(OPVaI) - non-cumulative

Prioritná os 2Priority axis 2

Page 95: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

95

11.2.2.3 The expected evolution of the financial progress of Priority Axis 3

Priority axis 3

Non-cumulative data Cumulative data

ERDF

National

co-financing

(indicatívne)*

ERDF

National

co-financing

(indicatívne)*

2014 0 0 0 0

2015 0 0 0 0

2016 3 525 424 1 770 271 3 525 424 1 770 271

2017 49 355 936 24 783 796 52 881 360 26 554 067

2018 49 355 936 24 783 796 102 237 296 51 337 863

2019 63 385 304 31 828 561 165 622 600 83 166 424

2020 56 462 250 28 352 190 222 084 850 111 518 614

2021 56 462 250 28 352 189 278 547 100 139 870 803

2022 56 462 250 28 352 190 335 009 350 168 222 993

2023 41 405 650 20 791 606 376 415 000 189 014 599

2024 0 0 376 415 000 189 014 599

Total 2014-2024 376 415 000 189 014 599 - -

* National co-financing is related to the ERDF funds only indicative calculated based on the expected

volume contracting by type of recipients

Page 96: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

96

In the case of development of the financial progress of Priority Axis 3 is expected the highest

annual increase spending in the sixth year of the programming period 2014-2020. In 2018,

spending is expected to achieve at the level of the total eligible expenditure of EUR

153 575 159 (of which 102 237 296 EUR represents a source ERDF and EUR 51 337 863 is

indicative quantified national co-financing).

Taking into account the performance reserve allocation of Priority Axis 3 can be assumed

that at the end of the fifth year of the programming period, i.e. in 2018 should reach the level

pumping 143 835 276 EUR (of which EUR 95 753 309 represents a resource ERDF and EUR 48 081

967 is indicative quantified national co-financing).

Impact of the performance reserve has been calculated by a mathematical algorithm

described above.

0,00% 0,00% 0,94%

14,05%

27,16%

44,00%

59,00%

74,00%

89,00%

100,00% 100,00%

0,00%

20,00%

40,00%

60,00%

80,00%

100,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on Priority Axis 3

(OPVaI) - cumulated

Prioritná os 3Priority axis 3

0,00% 0,00%

0,94%

13,11%

13,11%

16,84%

15,00%

15,00% 15,00%

11,00%

0,00% 0,00%

5,00%

10,00%

15,00%

20,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on Priority Axis 3

(OPVaI) non- cumulated

Prioritná os 3Priority axis 3

Page 97: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

97

11.2.2.4 The expected evolution of the financial progress of Priority Axis 4

Priority axis 4

Non-cumulative data Kumulatívne údaje

ERDF

Národné

spolufinancovanie

(indikatívne)*

ERDF

Národné

spolufinancovanie

(indikatívne)*

2014 0 0 0 0

2015 0 0 0 0

2016 230 698 231 678 230 698 231 678

2017 3 229 775 3 243 492 3 460 473 3 475 170

2018 3 229 775 3 243 492 6 690 248 6 718 662

2019 4 147 837 4 119 422 10 838 085 10 838 084

2020 3 694 801 3 694 801 14 532 886 14 532 885

2021 3 694 801 3 694 801 18 227 687 18 227 686

2022 3 694 801 3 694 801 21 922 488 21 922 487

2023 2 709 521 2 709 522 24 632 009 24 632 009

2024 0 0 24 632 009 24 632 009

Total 2014-2024 24 632 009 24 632 009 - -

* National co-financing is related to the ERDF funds only indicative calculated based on the expected

volume contracting by type of recipients

Page 98: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

98

In the case of development of the financial progress of Priority Axis 4 is expected the highest

annual increase spending in the sixth year of the programming period 2014-2020. In 2018,

spending is expected to achieve the level of total eligible costs amounting to EUR 13 408 910

(of which 6 690 248 EUROS represent a source of ERDF and EUR 6 718 662 is indicative

quantified national co-financing).

Taking into account the performance reserve allocation of Priority Axis 4 can be assumed

that at the end of the fifth year of the programming period, i.e. in 2018 should reach the level

pumping EUR 12 585 172 (of which 6 279 252 EUROS represent a source of ERDF and EUR 6 305

920 is indicative quantified national co-financing).

11.3 Physical (material) Implementation

Estimation of physical progress in 2018, consists of three basic phases:

1. Estimate the implementation curve

2. Determination of the average length of project implementation,

0,00% 0,00% 0,94%

14,08%

27,22%

44,00%

59,00%

74,00%

89,00%

100,00% 100,00%

0,00%

20,00%

40,00%

60,00%

80,00%

100,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 4

(OPVaI) - cumulative

Prioritná os 4Priority axis 4

0,00% 0,00%

0,94%

13,14%

13,14%

16,78%

15,00%

15,00% 15,00%

11,00%

0,00% 0,00%

5,00%

10,00%

15,00%

20,00%

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024

Estimated development of drawing on priority axis 4

(OPVaI) - non-cumulative

Prioritná os 4Priority axis 4

Page 99: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

99

3. The setting of sub-targets by taking into account the allocation of the performance

reserve.

11.3.1 Estimated implementation curve

Of the estimated value of the sub-objectives (milestones) it is important to plan the pace of

binding contractual allocations.

The allocation of the specific objectives of OP RaI under the auspices Ministry of Education,

Science, Research and Sports of the Slovak Republic was based on the cumulative financial

allocation, also used in calculating the key step of implementing “The number of contracted

research institutions” for priority axes 1 and 2. The experience of the implementation of the OP

R&D is the average length of one implementation of the project 2 - 3 years. However, as the

experience with subcontracting OP R&D in the planning of contracting OP RaI from them

cannot be assumed, as the contracted largely to the OP R&D occurred in the last years of

the implementation of OP R&D, being the major infrastructure projects of research and

development - university scientific parks and research centers. With the continuing

respectively with a connection already built infrastructure, research and development

(centers of excellence, competence centers, research and development, university science

parks, research centers, data center for Research and Development, National Centre for

Technology Transfer) also envisages the OP RaI. Those in the preparation, or to achieve

demanding projects which will require a longer time by providing of 3 - 5 years, some (e.g.

intended national projects) even up to 7 years. For this reason, it is assumed that the entire

allocation for Ministry of Education, Science, Research and Sports of the Slovak Republic

should be contracted later in the year 2020th

When estimating the rate of binding contractual allocation under the auspices of the Ministry

of Economy should be considered equally biased experience and trends of the 2007-2013

programming period. For these purposes will be used data from the ITMS to 30. 10. 2013. The

analysis entered only projects which have been successfully completed, since under partial

goals will be monitored as the value of successfully completed projects. Trend will consist of

the value of contracted non-repayable contribution only under Priority 1, measure 1.1 and

1.3.

The table can be seen annual growth of contracting funds to individual projects, in the first

year or contracted no amount of allocation, then to a greater shift occurred in 2009. This year

was contracted approximately 13% of

the allocation of Priority Axis 1,

Measure 1.1 and 1.3 In 2010, this rate

accelerated significantly to 22% from

contracting allocation. In 2011 it was

recorded decline in contracted at a

level only slightly more than 5% of the

allocation. In 2012 it was made

transfers into the OP Competitiveness

and Growth in the intentions Barroso

initiative promoting youth

employment. This step has slowed

somewhat as the financial and

physical implementation of the

2007 2008 2009 2010 2011 2012 2013

contractually bound NFC 0 169 66 041 109 238 24 793 16 680 41 682

cumulative 0 169 66 210 175 448 200 241 216 921 258 603

ratio of the total allocation - cumulative - 0,03% 13% 35% 40% 43% 51%

annual increase 0% 0,03% 13% 22% 5% 3% 8%

Source: ITMS

ERDF sources in thousands Euros / %

co

ntr

ac

tua

lly

bo

un

d N

FC

in

tho

us

an

d E

UR

monitored period

contractually bound NFC cumulative

Trend of the contracting within the

OP KaHR priority axis 1

polynomial (cumulative)

Page 100: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

100

operational programme and in 2012 it contracted more than 17% of the total allocation

measures 1.2 This measure was implemented through demand driven projects under the two

calls in 2008, two calls in early 2009, a single call in 2013.

The chart shows seasonality in the implementation which has caused serious harm to the

operational programme. This phenomenon is not common and is not suitable such

information to plan at that scale because seriously disrupt and slow down implementation.

MA and IB should be implemented smoothly interventions in the programming period 2014-

2020 if only because it is a second types full programming period. On the one hand, the initial

insult implementation can affect the pressure in the market and create space for

deformation of normal market conditions and intensify the fight in the market. In contrast, the

delayed impact of the implementation may put pressure on financial and project managers

in control and upon payment of payment requests. Any discrepancies cause significant shifts

that are likely to result in non-exhaustion of the entire allocation by the end of the eligibility

period.

Accordingly, it is appropriate within the trend curve adjusted to the needs and requirements

for smooth implementation.

Planned contracting specified

proportion of funds contracted

within the priority axis to the total

allocation of Priority Axis. Values are

given for projects in implementation

and not successful completed

projects, so it is necessary to

calculate an average time of

implementation.

11.3.2 Determination of the average length of project implementation

Within interventions at the thematic objective 1 OP RaI foreseen with specific targets in the

responsibility of the Ministry of Education, Science, Research and Sports of the Slovak

Republic the average length of project implementation 3-5 years, since it is a major

infrastructure projects or research and development. connecting them, as well as national

projects (centers of excellence, competence centers, research and development, university

science parks, research centers, data center for Research and Development, National

Centre for Technology Transfer), which are difficult not only to thorough preparation, but and

implementation.

For specific objectives of the Thematic Objective 1 OP RaI under the auspices of the Ministry

of Economy, the expert estimates suggest the average duration of implementation of grant

projects about 12 months. Respect of new types of projects that have been supported under

OP Competitiveness and Growth, therefore this value based on an expert estimate in

cooperation with the SBA.

Within interventions OP 3 thematic objective RaI is necessary to make an estimate of the OP

Competitiveness projects. Altogether, it evaluated 864 projects supported under measures 1.1

and 1.3 OP Competitiveness. Status values of individual measurements have similarities with a

normal distribution. Individual mean values of statistical series are 14 to 24 months. The

median diameter and are built in a row. The histogram shows the distribution of projects

measured the incidence of individual events in the left-hand parabolic shape functions. In

the division there is only one measurement significantly away from the cluster of other

measurements. This project was excluded from statistical files because of the uniqueness of

extreme value measurement ie THE PROJECT.

2014 2015 2016 2017 2018 2019 2020 2021 2022 2023

annual increase 0% 9% 11% 11% 13% 13% 10% 11% 12% 11%

cumulative plan 0% 9% 19% 30% 43% 57% 67% 78% 89% 100%

Source: RO OP KaHR

% c

on

tra

cti

ng

monitored period

Estimate of the allocation contracting within the

OP RaI priority axis under the auspices of MH SR

Page 101: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

101

From the histogram also shows that a large set of statistical

variability that is appropriate to remove the sample

distribution for measures 1.1 and 1.3 OP Competitiveness.

In view of the nature of the intervention logic of the length of

the implementation of projects under Measure 1.1 OP

Competitiveness especially relevant activities within the

thematic objective 1 OP RaI • Specific Objective 1.2.2: Support for research,

development and innovation activities ... • Specific Objective 2.2.2: Increasing innovation

potential of enterprises within the BK

Within these interventions should take place in

particular on innovation transfer and filling the

technological gap. The table shows the mean

values of 755 projects whose median captures

50% of all projects analyzed and given the

variability of the sample selected appropriate

mean value. It can therefore be concluded

that the above interventions would be the

average length of project implementation at

the level of 12 months, i.e. one calendar year.

Among the other OP interventions RaI

thematic Objective 1 i.e. Priority 1 and 2 of the OP RaI support should reflect in an increasing

measure the duration of the implementation of projects of the measure 1.3 OP

Competitiveness. Again, a significant variability of the sample,

therefore, it is appropriate to

abstract from extremes, that are

sensitive to the geometric

means. It is appropriate to take

into account some of the peace

of the mean value, in our case

the median, which captures 50%

of the population. In the case of

the upper quartile by the

average length of project

implementation 35 months, as a

result of extremely high values.

Median estimated mean value

for 24 months, which is the

recommended time.

11.3.3 Determination of the intermediate target on the basis of consideration of the

allocation of the performance reserve

Due to the information given in justification of the choice of indicators of physical progress in

the performance framework for priority axes 1 and 2, as well as in estimating the

implementation curve and determining the average length of project implementation where

for specific targets TC 1 under the auspices of the Ministry of Education, Science, Research

and Sports of the Slovak Republic counts upon an average length of project implementation

3 - 5 years, or zero is assumed. only filling minimum values of output OP R&D since it is a major

infrastructure projects or research and development. connecting them, as well as national

projects (centers of excellence, competence centers, research and development, university

science parks, research centers, data center for Research and Development, National

Centre for Technology Transfer), which are difficult not only to thorough preparation, but and

subsequent implementation.

indicator value

mean 15,6759

standard error 0,289976

median 14

mode 24

standard deviation 8,523518

sample variance 72,65036

kurtosis -0,2426

skewness 0,577246

range 45

minimum 1

maximum 46

sum 13544

count 864

confidence level (95%) 0,569141

Nu

mb

er

of

the

pro

jec

ts

lenght of the realization in weeks

Distribution of the projects realization

period of the OP RaI priority axis 1

indicator value

mean 13,8212

standard error 0,254152

median 12

mode 24

standard deviation 6,983389

sample variance 48,76772

kurtosis -0,93105

skewness 0,329084

range 38

minimum 1

maximum 39

sum 10435

count 755

confidence level (95%) 0,498929

Statistics of the measure 1.1

indicator value

mean 28,5229

standard error 0,673461

median 24

mode 24

standard deviation 7,031143

sample variance 49,436969

kurtosis -0,58536

skewness -0,10829

range 39

minimum 7

maximum 46

sum 3109

count 109

confidence level (95%) 1,334917

Statistics of the measure 1.3

Page 102: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

102

Assuming that projects under the auspices of the Ministry of Economy will be implemented

with an average implementation period of 12 months TC 1 and TC 3, only two cases within TC

1 should be the duration of implementation, about 24 months; we can expect the first spoke

after the project it is appropriate to calculate the most likely that by the end of 2018 reached

the value of projects contracted 12/24 months preceding the year of 2018.

This means that according to the above

schedule of contracting should be

contracted about 43% of the total

allocation for the priority axis. For

comparison, during the same period after

the beginning of the programming period

it was contractually bound 40% of the total

allocation of Priority Axis 1 of the OP

Competitiveness and Growth. Logically, it

can be assumed that the focus will be

mainly on the physical implementation

within the investment priorities that will

have measurable indicators included in

the performance reserve. In 2017 it was

estimated to bind approximately 30% of

the total allocation of Priority Axis.

Estimated value at the end of 2018 should

be adjusted on the performance reserve,

which should not be counted when determining the targets. The percentage of fulfillment of

output indicator as well as key implementing step was calculated based on the same

principle as it was when estimating% drawdown financial indicator.

[

(

)]

The table shows the percentage values of the fulfillment of measurable indicators for each

priority axis and types of intervention adjusted for the impact of the performance reserve

referred to in the equation below the text.

thematic objective

estimated plan of performance of

measurable indicator after taking

into account the average period of

realization of the project

TC 1 30,00%

TC 1 (technological gap) 19,33%

TC3 30,00%

Source: MH SR

1,2

1,2

(technological

gap)

3,4

allocation 794 499 032 794 499 032 40 189 069

performance reserve 50 387 892 50 387 892 2 468 901

physical milestone after

taking into account the

effect of omitting of the

performance reserve

28,10% 18,11% 28,16%

OP RaI Priority axis under the auspices of MH SR

indicator

Page 103: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

103

12 Basic information about the principles of evaluation of OP Research and

Innovation

12.1 Tasks and objectives of assessment

Based on the guidelines for monitoring and evaluation (“the Guidelines”) in the new

programming period 2014-2020 devotes much more attention to evaluation. European

Commission (EC) plans to establish a repository of documents (including reviews) to create

policies that will provide all Member States and will perform meta-analysis assessment. The

Guidelines also resulted in requirement to develop later than one year from the approval of

the operational programme called the evaluation plan. It is expected that this plan will: • promote quality assessment, and effective use of their governing bodies; • facilitate the sharing of knowledge on what and how it works in different sectors;

• contribute to the planning and implementation of programs and policies based on

evidence.

The task of simultaneously will provide relevant information for the preparation of various

reports on the results of which will be from 2016 preparatory bodies of the Member States. It

will be particularly annual reports, progress reports and the summary report which will be

submitted to the European Commission to the European Parliament, the European Economic

and Social Committee and the Committee of the Regions.

Evaluation should be an integral part of the life cycle of the program. Evaluation is usually

carried out in order to: • confirmed the reasons for intervention, i.e. whether the intervention actually focused

on the actual needs / problems; • improve the quality of interventions and economical use of resources. Guest analyzes

the success and failure factors shows what works and what does not and adjust

accordingly proposed the intervention; • documented the effectiveness and efficiency of interventions and assess their effects,

as in the use of public finances, it is necessary to say where/why is spent public funds,

and which effects brought.

The main objective of evaluations is to obtain relevant, validated and reliable information

regarding the implementation of the OP RaI which will serve to improve implementation of

interventions at the level of processes, management, results, and their focus, both at the

stage of their planning as well as implementation. The aim of evaluations is mainly assess the

fulfillment of specific objectives of each OP RaI. At least once during the programming period

should be assessed to what extent have implemented interventions to fulfill the objectives of

each priority axis within the OP evaluation of the performance of RaI in accordance with the

system of ESIF.

12.2 Scoping

Scope of the assessment may cover the entire operational programme (hereinafter referred

to as “IP”), its priorities or specific themes. In the initial phase of implementation of the new IP,

the evaluation will focus on the management and implementation processes of the

individual components of the new OP, later focusing on the analysis of physical progress, the

outcomes achieved and the estimate of the contributions to each specific objective, and

the impact of disclosure.

The scope of evaluations is determined challenges, respectively belonging to a specific

objective when individual activities OP RaI so that their fulfillment could be assessed on the

basis of projects aimed at the same objective while ensuring homogeneity interventions.

While the main factors affecting the homogeneity of the conditions are evaluated

interventions challenges cyclical economic changes or substantial changes in the market or

in the demographic structure.

The operational programs of the 2007-2013 programming period expiring provide space for

evaluation of results and impacts mainly those interventions that were key in the IP and are

continuing in the new programming period. Part of the evaluations will thus also apply to the

OP Research and Development and OP Competitiveness and Economic Growth

Page 104: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

104

implemented in the programming period 2007-2013, as the interventions planned in the

current programming period related to already completed projects. Ex-post evaluation of

these interventions should therefore information that will improve the implementation of new

interventions. At the same time as a good source of information can serve all relevant

evaluations carried out in the previous period (in other Member States), ex post evaluation

carried out by the European Commission in several Member States, various analyzes, studies

and other literary sources.

Planning, management and implementation of evaluation is the role of RO. If necessary, the

Managing Authority will cooperate on evaluations made by the Central Coordinating

Authority (hereinafter referred to as “CCA”), or the European Commission, and also such

evaluations are part of the Plan. The evaluation plan drawn up by RO to the demands of the

members of the Monitoring Committee (hereinafter "MC"). MV approving the plan for the

assessment and evaluation of all the MV will be presented. MV competence to include the

monitoring of the measures adopted on the basis of evaluation recommendations.

12.3 Coordinating evaluation

Coordinating the process of the evaluation is one of the key needs in ensuring quality

evaluation by consensus entrained plurality of views of the various interest groups.

12.3.1 Managing authority/intermediate bodies

The evaluation within the MA OP RaI umbrella branch OP preparation RaI Structural Funds

Section of the Ministry of Education, Science, Research and Sports (hereinafter referred to as

"Ministry of Education, Science, Research and Sports of the Slovak Republic") in close

association with the monitoring, evaluation and publicity of the Structural Funds section of the

support programs of the Ministry of Economy SR (hereinafter "MoE") as the intermediate body

(hereinafter “SO”). Implementation evaluation is carried out by the Evaluation Plan and each

award must be drawn up terms of reference.

The Managing Authority will ensure quality control of the evaluation process and emphasis on

quality preparation of specifications, the transparency of the procurement process and

setting fair contractual arrangements with external service providers. The role of the

Evaluation Committee, in cooperation with the evaluation managers and SO preparation of

requirements, including evaluation questions, if necessary. requirements for methodological

approach and final outcome evaluations (e.g. in the form of evaluation reports,

presentations, etc.) as well as to ensure the implementation of agreed recommendations.

Manager evaluations SO/RO ensuring communication between the evaluation team and

SO/RO, conveys information about the evaluation and its objectives of all stakeholders and

ensure their interoperability and cooperation in providing information and data needed for

evaluation.

All assessment conducted by a summary evaluation report in Slovak, eventually in English will

be posted on the website of IB/RO. Summary of evaluation results is included in the Annual

Report of the OP.

12.3.2 Working Group on evaluation of the OP RaI

Regarding the fulfillment of the tasks set out in the framework of the evaluation plan of the OP

MA RaI an informal working group for evaluation, which consists of representatives from at

least RO, SO, professional partner for evaluation. Working Group members may supplement

the CCA, sponsors of horizontal principles, and academia (Slovak Academy of Sciences,

universities, etc.). The Working Party as necessary, but at least once a year in preparation for

the annual plans for evaluation of the OP RaI. Expert partner for the assessment is

representative of Slovak Evaluation Society, which acts as a mainly advisory group member.

12.3.3 Monitoring Committee

Approval and revision of the Plan is the responsibility of the Monitoring Committee for OP RaI.

The Monitoring Committee for OP RaI will monitor implementation of the evaluation plan at

least once a year and must approve any changes. Implementation of measures from the

results / recommendations of the evaluation must be at least a year frequency controlled

Page 105: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

105

and reported in the annual report OP. The Monitoring Committee for OP RaI may also

establish specific working groups, and partners in the assessment.

European Commission

The main role of the EC in the framework of the evaluation is to enter and management of ex

post assessments. EK evaluation of programs may take place on its own initiative. It informs

the RO and RO will send results and provide for the MV. At present the European Commission

in evaluating proactive in order to obtain better input for its future assessments. Regulations

governing regional policy requires the European Commission on the implementation of

programs to provide regular summary information at European level, for example through the

Progress Reports (General Regulation Art. 53). Likewise, this obligation applies to the

evaluation controlled by the EC (General Regulation Art. 56 paragraph. 4). In addition to

meeting these obligations has the European Commission wishes to monitor evaluations with

Member States and, if necessary, provide them with necessary assistance.

12.3.4 Central Coordinating Authority

The evaluation process OP RaI nationally coordinated central coordinating body. CCA within

that jurisdiction shall undertake the following tasks: • coordinate and ensure the evaluation processes through the evaluation managers in

cooperation with the relevant other units CCA/RO/guarantors horizontal principles

(hereinafter referred to as "HP"), • draws up and updates during the program period methodological guidelines for

evaluation processes at the national level that are necessary for carrying out the

quality evaluation under the relevant EC guidelines, • Ensuring data sources, data collection and processing necessary for evaluating ESI +

in cooperation with the Statistical Office of the SR, the Social Insurance Agency and

other relevant institutions, • prepare a comprehensive evaluation report on the activities and results of

evaluations ESI + for the preceding calendar year in the period to May 31 of the

calendar year by a member of the National Monitoring Committee and partners as

descriptive document, • Preparation, in accordance with Art. 114 para. 2 of the General Regulation, a

comprehensive report on the implementation of evaluation in the programming

period 2014-2020, summarizing all the findings of evaluations carried out during the

whole programming period and submit it to the European Commission by 31

December 2022, • establishes, defines the substantive scope of activities and organizing the functioning

of the Working Group on evaluation whose members and observers are

representatives of the CCA, MA OP Sponsors of HP partners, invite representatives of

other relevant institutions, respectively experts in different areas and themes,

• cooperates with relevant departments of the Directorates-General of the European

Commission aimed at evaluating and regularly participates in working groups on

evaluation organized by the European Commission Directorates-General, • ensuring the consistent improvement of qualification evaluation

managers/coordinators of HP through continuous training.

12.3.5 RIS 3

OP RaI is a key implementation tool strategy “knowledge to prosperity - research and

innovation strategy for smart specialization of the Slovak Republic” (hereinafter “RIS 3”). Due

to this fact, OP RaI evaluation should take into account the priorities and objectives of the RIS

3. Despite the fact that the Action Plan implementing the research and innovation strategy

for smart specialization SR for the years 2014-2016 defines independent evaluation plan

cannot be ruled link up OP RaI to RIS3 especially in relation to the development of thematic

evaluations.

Page 106: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

106

12.3.6 Public

In particular, recipients of information on the effectiveness and efficiency of OP RaI as well as

contributions to the goals of collection of related strategies and horizontal principles.

The public acts as Respondents in the realization of a poll OP RaI.

12.4 Process within the evaluation

Scheme under the text interprets the chronological sequence of elementary processes within

the internal and external evaluation, and the basic tasks of performance evaluation plan OP

RaI.

The feasibility study should in general terms cover the following activities: • identification of the initial documentation, • definition the time, spatial, factual framework for evaluation,

• representativeness: samples available, minimum representative sample of the 95%

significance level, • outline of the intervention logic - theory of change, • identification of data sources, • setting the framework of assessment methods,

• definition of the issues, tasks, • definition of the time, space.

12.5 Types of evaluation

In terms of the period of the program cycle we distinguish the following types of ratings

• preliminary (ex-ante) evaluation, • continuous (on-going) evaluation and, • Subsequent (ex post) evaluation.

12.5.1 Continuous assessment

The main purpose of continuous assessment is to verify progress in the implementation of the

program and proposals for changes to improve its quality. It is implemented in accordance

with the Evaluation Plan for the programming period 2014 - 2020 and updating of the

evaluations undertaken by the relevant calendar year. The evaluation, which is not included

in the evaluation plan can be performed as an ad hoc review.

Continuous assessment is carried out during the program period, as the focus of evaluation

implementation; evaluation of the relevance, efficiency and effectiveness of OP or impact

assessment.

12.5.2 Impact Assessment

Is the subject of an impact assessment support of the ESI + in response to the objectives of the

EU security smart, sustainable and inclusive growth and increased employment, productivity

and social cohesion with national priorities; evaluate the impact of implementation of the OP

in the field of economic, social, regional and environmental areas. In carrying out impact

assessments have been considered strategic aspects, for example as cohesion policy has

helped to achieve the Europe 2020 goals; the macroeconomic impact of aid from ESI.

Impact assessment can be focused on specific topics that are of strategic importance for

achieving the OP (e.g. Innovation and smart specialization, youth employment, etc.) or HP.

Impact assessment with rules requires data from other sources, such as monitoring systems

(e.g. Social security, record unemployment, or tax records). When planning such assessments

into account data protection, especially in relation to sensitive data on participants.

Evaluation of the OP contribution to the objectives set, at the level of each priority axis

through impact assessment, carried out at least once during the programming period.

12.6 Organizational arrangements for the evaluation

12.6.1 Internal evaluation

In the evaluation plan will predetermined the award, which will be implemented through

internal evaluation. Internal evaluations can be carried out evaluation managers only if their

Page 107: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

107

separation is at the same time the department which is responsible for the planning and

implementation of the OP.

12.6.2 External Evaluation

In the case of external evaluation assessment will manage the evaluation managers in

cooperation with the evaluation committee and, if necessary, with other relevant

stakeholders (partners, working groups, ...). All evaluators must be independent. Independent

external evaluators, however, at the same time should have a good overview of the

evaluated intervention.

The basic rules of public procurement evaluations are determined by applicable law. The

Terms of Reference should provide the balance pertaining to the criteria under which it will

pick the best deal. Decision-making by price While it is an important criterion, but in light of

the recommendations the European Commission should not exceed 20 to 25% by weight of

the total evaluation.

12.7 Capacity Building

RO/SO, in accordance with Art. 56, para. 2 of the Regulation provide for the implementation

of the evaluation appropriate evaluation capacity. Administrative capacity building for

evaluation includes ensuring sufficient numbers of evaluation managers, given the scale of

the planned activities.

Within the qualitative strengthening of evaluation capacities RO/SO will be higher

qualification and competence evaluation managers ensured through their continuing

vocational training. Deepening of qualification evaluation capacities RO/SO shall take place

mainly through: • Centralized education system CCA, • enhancing participation in vocational training, seminars, conferences and other

information and training activities aimed at field appraisal organized by others (EK, ...), • exchange of experience in the evaluation of other staff of MA OP performing

evaluations in Slovakia (e.g., through the Working Group on Evaluation established

CCA) and other EU Member States as well as representatives of the EC, • co-operation with external evaluators and the sharing of experience.

12.8 Principles of ratings

To ensure the quality of assessment activities EK recommends that Member States in their

work based on clearly identified standards that have created, or to apply EC standards if the

standards national evaluation societies, OECD and other organizations.

Basic and generally respected principles for evaluation include the following principles: • Evaluation activities must be organizationally and financially secure, to fulfill its

purpose:

- programs should have evaluation manager with clearly defined responsibilities

for the coordination of evaluation activities, - human and financial resources to manage the evaluation must be clearly

identified and allocated, - each program must be clearly defined procedures and the role of

stakeholders in evaluation activities; • The evaluation must be transparent scheduled so that its results are available in time:

- evaluation Manager preparation of the brief assessment in consultation with

stakeholders, - all activities must be regularly evaluated, to the extent appropriate allocated

resources and the expected impact,

- assessment must be carried out in time to be able to use the results of

evaluations in the planning or review of the program; • Entering the evaluation must include targets, appropriate methods, as well as tools for

managing the evaluation and exploitation of its results:

Page 108: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

108

- for each evaluation should be established control/review team, which will

make recommendations concerning the terms of reference to assist in the

evaluation activities and participate in assessing the quality of evaluation; • Evaluations shall provide reliable results and conclusions:

- assessment must be carried out so that its results were supported by the facts,

evidence and based on clear analysis, - none of the persons participating in the evaluation should not be a conflict of

interest, - evaluators should be able to submit the results of its assessment without

compromising or other interventions, - final assessment report must state the purpose, context, evaluation questions,

information sources, methods used, evidence and conclusions, - the quality of assessment must be assessed on the basis of predetermined

criteria.

12.9 Usage ratings

The purpose of the evaluation is to assess the impact of ESI + for achieving the Europe 2020

objectives, particularly in relation to national priorities and the EU.

The main objective evaluation RaI OP is to improve the quality of programming and

implementation of the program and evaluate its relevancy, efficiency, effectiveness and

impact.

Assessment information will be included in the annual reports on the implementation of the

program. These reports will indicate, inter alia, progress made in the implementation of the

evaluation plan of the OP RaI and provide a summary of the measures taken with regard to

the assessment findings.

12.10 Budget ratings

The indicative budget for each evaluation will be associated with the selected methods,

anticipated capacity and duration of the contract and covers the costs of evaluation, data

collection, training, etc. The duration and timing of the evaluation will be related to the

purpose, scope and methods, for example. impact assessment be carried out only with a

certain delay after the end of intervention. Evaluation methods may only be set wider, i .e. it

sets the example. Only use evaluation based on theory (theory based evaluation), or net

impact evaluation (counterfactual impact evaluation), if necessary. Submitter requests the

use of specific tools (questionnaire surveys, case studies). More detailed specification of

specific evaluation tools must be part of the tender and its quality is decisive in the evaluation

of tenders.

12.11 Awareness Awareness and Communication Publicity

A final evaluation report of all evaluations will be made available to the public and will be

published on the web site of MA's RaI in Slovak possibly also in English.

Page 109: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

109

13 Taking into account the negative experience from the programming

period 2007 to 2013

RO/SO OP RaI seen as a priority document to reflect the proposed monitoring and evaluation

system to negative experience from the previous period , it would be possible for the

programming period 2014-2020 may be flexible , accurate and meaningful report on physical

and financial progress in monitoring and through the monitoring process of preparing the

basis for evaluation. Monitoring system should meet the quality requirements of other external

sources of information to be monitored are the bodies which were not included in the OP

interventions RaI. These secondary sources of information need to act in complementary

relation to internal monitoring system. To then be able to estimate the net effects of selected

interventions OP RaI.

13.1 Streamlined setup process monitoring and measurable indicators

Experience with reporting the effectiveness of interventions in the programming period 2007 -

2013 showed the need for a more appropriate set of measurable indicators for the

programming period 2014 - 2020 and their clear link from the project level to the program

level, particularly with regard to its consistency with the specific objectives of individual

measures a priority axes, their relevance to supported activities, the effectiveness of their

measurement and reporting, understandable and ultimately their relevance to the recipient.

An equally important factor is the need to clarify the definition and measurement of each

logic core/main measurable indicator of the central level so that it can be aggregated from

the project level to the highest required level.

Reflection experience in the new monitoring system: Proposed dial, which is an integral part

of the monitoring system, the aggregation map contains measurable indicators which make

a targeted connectivity with the elaboration of the various levels of OP RaI (in activity,

specific objectives, investment priorities, thematic objectives). Furthermore RO/SO define its

individual measurable indicators for each activity as well as their respective monitoring

period.

An essential lesson records are missing from the process of setting quantified targets of the

OP, which in many cases brought rationale for deviations of actual values from the set plans.

Reflection experience in the new monitoring system: the lack of records set quantifiable

achieved within the program period 2007 - 2013 should be eliminated by setting up a

description of the monitoring and evaluation of the OP RaI wherein said assumptions in the

calculations and methodology used.

Within the programming period 2007 - 2013 has become increasingly reliant on the name of

the measurable indicators should clearly indicate its essence.

Reflection experience in the new monitoring system: Within this period was not introduced

from the beginning of the programming period, a clear definition term framework of

measurable indicators that would contribute to increasing the internal validity of the reported

and analyzed values.

13.2 More efficient evaluation system

Given the history and current status can be noted that in drafting the OP Competitiveness

and Growth insufficiently established data base and methodology for the estimation of socio-

economic benefits of interventions. Specifically, by the discovery of causal relationships, the

effect of interventions should contribute and impact assessment, as one of the key tools for

estimating qualitative changes OP. Since monitoring is a tool particularly describing

particular, the quantitative results of interventions in the programming period 2014 - 2020

should be paid more attention to both systems.

Reflection experience in the new system of evaluation: these shortcomings the previous

programming period was decided RO/SO OP RaI solved by using a complex system of

indicators, especially financial indicators that are compatible to external data sources that

provide information about the financial condition of the beneficiaries and control groups,

and in order to assess the impact of implemented interventions. It was also crucial to think of

Page 110: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

110

monitorable factors that may eliminate bias selection (selection bias), which could cause

distortion, for example demographic changes in the area of permanent residence - a

change of population, population density, distance from the site of economic and residential

settlements (e.g. district). There were also identified basic circuits and methods suitable for

assessment, the foundation should be prepared by the monitoring system.

Page 111: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

111

14 The Coherence of Monitoring System for RIS3

Supported projects under OP RaI should undeniably significant contribution to the EU's

research and innovation for smart specialization SR.

RO/SO OP RaI must ensure the Convention between potential contributors that

unambiguously define the system of interconnection lowest levels (projects) to implement

strategies so as to be fully informed about the financial and physical progress within individual

measures RIS3.

RO/SO OP RaI perceived need for clear identification of individual projects to concrete

actions RIS3, it is therefore necessary to establish clear key under which individual projects are

allocated to contribution to the individual measures RIS3.

Page 112: THE SYSTEM OF MONITORING AND EVALUATION OF THE … · 2015-12-29 · 3.6 Financial effects ... 10.5.15 Number involvement of SMEs in EU programs (O0082) ... 10.5.22 The number of

112

15 Earlier Documents

(1) The communication strategy of the Operational Programme Research and Innovation

for the programming period 2014 to 2020

(2) Guideline CCA to dial measurable indicators (January 2015)

(3) research and innovation strategy for smart specialization SR (RIS3)

(4) Regulation (the “EP”) and Council Regulation (EU) No. 1303/2013 of 17 December

2013 laying down common provisions on the European Regional Development Fund,

the European Social Fund, the Cohesion Fund, the European Agricultural Fund for

Rural Development and the European Maritime and Fisheries Fund and laying down

general provisions on the European Regional Development Fund , the European

Social Fund, the Cohesion Fund and the European Maritime and Fisheries Fund and

repealing Regulation (EC) No. 1083/2006 (hereinafter "the General Regulation");

(5) EP and Council Regulation (EU) No. 1304/2013 of 17 December 2013 on the European

Social Fund and repealing Council Regulation (EC) No. 1081/2006 (hereinafter “the

ESF regulation”);

(6) the EP and Council Regulation (EU) No. 1300/2013 of 17 December 2013 on the

Cohesion Fund and repealing Regulation (EC) No. 1084/2006 (the “KF Regulation”);

(7) EP and Council Regulation (EU) No. 1299/2013 of 17 December 2013 on specific

provisions for the support of the European territorial cooperation of the European

Regional Development Fund (hereinafter referred to as “ETC Regulation”);

(8) Guidance document - Programming Period 2014-2020 - Monitoring and Evaluation of

European Cohesion Policy - European Social Fund, September 2014;

(9) Programming Period 2014-2020 - Guidance Document on Monitoring and Evaluation -

ERDF and Cohesion Fund, 2014;

(10) Implementation Guidance 2014-2020 e-cohesion;

(11) The management of the European structural and investment funds. Programming

period 2014 - 2020 (hereinafter referred to as “SR ESI”);

(12) Act. 292/2014 Coll. the contribution from the European Structural Funds and

investment and on amendments to certain laws.

(13) Dagmar Gombitová: Introduction to Monitoring and Evaluation. In Bratislava, 2007

ISBN978-80-96960-9-5.

(14) The communication strategy OP RaI programming period 2014-2020

(15) Partnership Agreement the Slovak Republic for 2014-2020 (hereinafter referred to as

"PD SR 2014-2020");

(16) Commission Implementing Regulation (EU) No. 1242/2014 of 11.20.2014, laying down

the rules according to the EP and Council Regulation (EU) No. 508/2014 on the

European Maritime and Fisheries Fund;

(17) Operational Programme Research and Innovation, ver. 1.2