Report on Service Improvements and Platform Expansion ...€¦ · D5.2.1 Report on Service...

D5.2.1 Report on Service Improvements and Platform Expansion Capabilities

CIP Competitiveness and Innovation Framework Programme

CIP-Pilot Actions, 2007-2013

CIP-ICT-PSP-2012-6

Project CIP-Pilot 325101 / OpenScienceLink

Deliverable D5.2.1

Distribution Public

http://www.opensciencelink.eu/

Report on Service Improvements and

Platform Expansion Capabilities

Authors: Vassiliki Andronikou, Alicija Juskiene, Matthias Zschunke, Julian

Mendez, Daniel Eisinger, Alina Petrova, George Tsatsaronis, Daniel Eisinger,

Liliana Barrio-Alvers, Michael R. Alvers

Status: Final (Version 1.0)


of 15


July 2014

Project

Project ref.no. CIP-Pilot 325101

Project acronym OpenScienceLink

Project full title Open Semantically-enabled, Social-aware Access to

Scientific Data

Project site http://www.opensciencelink.eu/

Project start February 2013

Project duration 3 years

EC Project Officer David Guedj

Deliverable

Deliverable type Report

Distribution level Public

Deliverable Number D5.2.1

Deliverable title Report on Service Improvements and Platform Expansion

Capabilities

Contractual date of delivery M15 (April 2014)

Actual date of delivery July 2014

Relevant Task(s) WP5/Task 5.4

Partner Responsible NTUA

Other contributors TUD, TI

Number of pages 15

Author(s) Vassiliki Andronikou, Alicija Juskiene, Matthias Zschunke,

Julian Mendez, Daniel Eisinger, Alina Petrova, George

Tsatsaronis, Daniel Eisinger, Liliana Barrio-Alvers, Michael

R. Alvers

Internal Reviewers Efstathios Karanastasis

Status & version Final (Version 1.0)

Keywords Platform improvements, fine-tuning


of 15


Executive Summary

This report comprises the output of Task 5.4 and presents the results from the services testing and deployment process towards the enhancement and fine tuning of the platform. It should be noted that its purpose is not to evaluate the platform (as this constitutes part of the WP8 activities) nor to detect new requirements (as this is part of WP2 activities) but rather indicate the fine tuning that both took and should take place for improving the platform in overall.

of 15


Contents

Executive Summary .......................................................................................................................................................... 3

Contents ................................................................................................................................................................................. 4

List of Tables ........................................................................................................................................................................ 5

1 Introduction ................................................................................................................................................................ 6

2 Platform Improvements and Fine-tuning activities ................................................................................... 7

2.1 Pilot 1: Research dynamics-aware open access data journals development ......................... 7

2.1.1 Overview ................................................................................................................................................... 7

2.1.2 Platform Improvements ..................................................................................................................... 7

2.2 Pilot 2: Novel open, semantically-assisted peer review process ................................................ 8

2.2.1 Overview ................................................................................................................................................... 8


2.3 Pilot 3: Data mining for biomedical and clinical research trends detection and analysis 9

2.3.1 Overview ................................................................................................................................................... 9


2.4 Pilot 4: Data mining for proactive formulation of scientific collaborations ........................ 10

2.4.1 Overview ................................................................................................................................................ 10

2.4.2 Platform Improvements .................................................................................................................. 10

2.5 Pilot 5: Scientific field-aware, productivity- and impact-oriented enhanced research evaluation services .................................................................................................................................................... 11

2.5.1 Overview ................................................................................................................................................ 11


2.6 Common Functionalities across Pilots ................................................................................................ 12

2.6.1 Overview ................................................................................................................................................ 12


3 Conclusion ................................................................................................................................................................ 14

4 References ................................................................................................................................................................ 15

of 15


List of Tables

Table 1: Pilot 1 Improvements based on 1st release of platform.................................................................... 7



Table 4: Pilot 4 Improvements based on 1st release of platform................................................................. 10

Table 5: Pilot 5 Improvements based on 1st release of platform................................................................. 11

of 15


1 Introduction

This report constitutes the analysis of the platform testing and deployment activities with a clear focus towards the identification of the improvements which should be considered in the next iterations of the platform development. This analysis will be fed to the requirements analysis to be performed in WP2 as well as the technical developments for the next platform release.

of 15


2 Platform Improvements and Fine-tuning activities

2.1 Pilot 1: Research dynamics-aware open access data journals

development

2.1.1 Overview

This Pilot aims at providing the means for developing, publishing and managing data journals including a multitude of openly accessible data about experiments, trials and validation processes. The functionality of the platform is intended to cover the complete lifecycle of a data journal: the suggestion of new journal issues, the submission of datasets and the organization of the peer review process, the publication of accepted datasets and the assessment and evaluation of datasets and journal issues. In order to fulfill this diverse set of requirements, Pilot 1 strongly relies on functionality from Pilots 2, 3, and 5. As an example, the retrieval of related bibliography and datasets is an important element of the review support offered by Pilot 2. The corresponding platform improvements are detailed in Sections Error! Reference source not found., Error! Reference source not found., and Error! Reference source not found..

2.1.2 Platform Improvements

Improvement ID

Platform Improvement Description

Related Functionality ID

Related Component

I1.1

The Comment/Discussion functionality for published reviews of research works or datasets should be included in future releases of the platform.

F2.8, F2.9 Datasets

Management

I1.2 Relevant datasets detection should be included in future releases of the platform.

F1.1 Datasets

Management

I1.3

Datasets selection and publication should be included in future releases of the platform.

F1.3, F1.4 Datasets

Management

I1.4

The functionality for specifying the papers in which the dataset to be uploaded has been used, could be improved so that the user selects the datasets rather than having to type manually their identification number.

F1.2 Datasets

Management

Table 1: Pilot 1 Improvements based on 1st release of platform

of 15


2.2 Pilot 2: Novel open, semantically-assisted peer review process

2.2.1 Overview

This pilot aims at offering a novel peer-review process methodology, which consists of the following four steps: Automated search for and suggestion of appropriate reviewers, support in carrying out the review process, organization of review form submission and post-review discussion.


Improvement ID



Related Component

I2.1 Conflict of interest detection should be included in future releases of the platform.

F2.3

Groups management (affiliations),

Users Management,

Reviews Management

I2.2

Use of author networks for reviewer identification should be included in future releases of the platform.

F2.1

Authors Management,

Reviews Management

I2.3

Retrieval of related information for the uploaded article should be included in future releases of the platform.

F0.3, F2.6

Reviews Management,

Articles Management

I2.4

Automated suggestion of missing references should be included in future releases of the platform.

F2.7 Reviews

Management

I2.5

Automated retrieval of cited bibliography should be included in future releases of the platform.

F2.6

Reviews Management,

Articles Management

I2.6

Automated retrieval of related datasets to suggest comparisons should be included in future releases of the platform.

F0.4

Reviews Management,

Articles Management

I2.7 Reviews of other evaluators should be made available in future releases of the platform.

F2.9 Reviews

Management

I2.8

Open discussion of reviews and review results should be made available in future releases of the platform.

F2.9, F2.10, F2.11 Reviews

Management


of 15


2.3 Pilot 3: Data mining for biomedical and clinical research trends

detection and analysis

2.3.1 Overview

This pilot emphasizes the ability of the OpenScienceLink Platform to discover and analyze research trends. The identification and analysis of such trends is essential for the allocation of research funding (by private sponsors and governmental agencies), as well as for the overall planning of research strategies. The pilot is primarily empowered by the advanced data mining capabilities of the Platform, on the basis of data for the biomedical and clinical research field.

Stakeholders will view current research trends in the biomedical domain, including topical research areas and areas with the highest growth. The users can see per community, research field and subfields thereof, the measured trendiness over a pre-specified timeslot. The users are also able to view in a ranked list and respective graphs the highest trends, e.g., the scientific subfields that have accumulated the largest mass of scientific interest based on publications of papers and datasets in the field. Alternatively, the user enters a specific topic, requests for and is presented with its trend analysis over the pre-specified timeslot. The timeslots can be user defined, among a list of options including year analysis, and 5-year analysis.


Improvement ID



Related Component

I3.1 Sorting of topics by trendness should be made available in future releases of the platform.

F3.2

Data mining Processes,

Articles Management

I3.2

A suggestion of topics by trendness (increasing or declining fields) with regard to a given set of topics should be made available in future releases of the platform.

F3.2

Data mining Processes,

Articles Management

I3.3

A justification of the level of trendness (along with the relevant data) should be presented to the users in future releases of the platform.

F3.2 Web Interface


of 15


2.4 Pilot 4: Data mining for proactive formulation of scientific

collaborations

2.4.1 Overview

This Pilot aims at enabling the networking and collaboration of researchers and scholars working on similar fields and sharing similar interests. It facilitates the creation and tracking of networks of researchers, in a way similar to social networks. However, a key distinguishing characteristic of this Pilot from conventional research information systems is the ability to infer relationships between researchers and research groups, including (in several cases) non-obvious, non-declared relationships. The Pilot is therefore expected to open new horizons in the collaboration of researchers, scholars, research groups and research organizations. The Pilot will be primarily empowered by the advanced social networking and data mining capabilities of the OpenScienceLink Platform.


Improvement ID



Related Component

I4.1

Researchers’ connections identification through social networks should be provided in future releases of the platform.

F4.1 Authors

Management

I4.2

Researchers’ connections identification through literature could possibly be improved by presenting detailed connections information to the end users, and enabling them to fine tune the connections identification parameters.

F4.2

Articles Management

Authors Management

I4.3

Researchers’ collaboration filtering and proposition should be implemented in future releases of the platform.

F4.3 Authors

Management

I4.4

Research groups identification through both social networks and literature should be supported by future releases of the platform.

F4.4 Groups

Management

I4.5

Research groups collaboration filtering and proposition should be supported by future releases of the platform.

F4.5 Groups

Management


of 15


2.5 Pilot 5: Scientific field-aware, productivity- and impact-oriented

enhanced research evaluation services

2.5.1 Overview

The main objective of this Pilot is to introduce, produce and track new objective metrics of research and scientific performance, beyond conventional metrics, associated with conventional indices and impact factors. This new type of sciento-metrics enables research sponsors, funding authorities and governmental agencies to shape their research strategies, researchers to be evaluated based on a multitude of factors representative of their productivity, impact and domain rather than through simplified means such as the number of citations within a time period, important research work, in terms of potential, to be brought forward, among others. The Pilot specifically focuses on the evaluation of research work, researchers, research groups or communities, journals, institutions, and countries.

The Pilot uses mechanisms and Services that exploit the different metadata from the research data sources and the social networks in order to provide representative and complete evaluation of research outputs (articles, data sets, etc), researchers, institution and communities.


Improvement ID



Related Component

I5.1

More metrics should be made available for the evaluation of research work in future releases of the platform.

F5.1, F5.2, F5.3, F5.4, F5.5, F5.6

Articles Management

I5.2

More metrics should be made available for the evaluation of journals in future releases of the platform.

F5.10 Articles

Management

I5.3

More metrics should be made available for the evaluation of researchers in future releases of the platform.

F5.7 Authors

Management

I5.4

More metrics should be made available for the evaluation of research groups or communities in future releases of the platform.

F5.8, F5.9 Groups

Management

I5.5

More metrics should be made available for the evaluation of institutions in future releases of the platform.

F5.11, F5.12 Groups

Management


of 15


2.6 Common Functionalities across Pilots

2.6.1 Overview

This section covers the common functionality related to all of the aforementioned Pilots, such as user registration and login, including functionality that has to do with the common parts of the OpenScienceLink Platform Web Interface.


Improvement ID



Related Component

I0.1

Linking of the OpenScienceLink Platform users’ accounts with their accounts in social networking sites should be provided in future releases of the platform.

F0.1 Users

Management

I0.2

The research interests section for a OpenScienceLink platform user is partially covered (a user can select the desired topics of interest from a few “main categories”). In future releases of the platform, the users should be able to specify their research interests in more detail based on the whole set of the OpenScienceLink ontologies.

F0.1 Users

Management

I0.3

The functionality for the specification of papers authorship by an OpenScienceLink Platform user should be included in future releases of the platform.

F0.3 Users

Management

I0.4

Consistency checks for the information that the users enter during registration should be provided. In the current version, for example, the user can provide an email of any type (not following the [email protected] pattern) and the system accepts it.

F0.1 Users

Management, Web Interface

I0.5 The design of Login Form/Page can be improved (e.g. Login Button).

F0.2 Web Interface

I0.6

Clicking on the OpenScienceLink text and logo leads to the opensciencelink.eu website. On the contrary, they should lead to the starting page of the OpenScienceLink Platform.

F0.2 Web Interface

of 15


I0.7

The presentation of the semantic terms on the OpenScienceLink Platform user interface could follow a tree-based approach. More precisely, the concept terms should be presented on a tree at the left side of the screen. The search box provided on the top part of the screen should be connected with the terms tree. Selections made on the tree should immediately be reflected on the content of the searchbox and vise versa, as well as the content presented on the screen.

F0.4 Web Interface

I0.8 It does not seem necessary to have the login functionality placed inside a “Login” Tab.

F0.2 Web Interface

I0.9

The logout functionality could be placed preferably on a different position, and not in the form of a Tab. E.g., it could be a button, on the top right corner of the user interface.

F0.2 Web Interface

I0.10

Web Interface behaviour when the user uses the back button on the browser should be corrected or measures should be taken so that the back button does not have an effect on the web page contents.

ALL Web Interface

I0.11

Instructions regarding the correct usage of the platform and the functionality of each button should be provided to the end users of the platform, in a comprehensible manner. E.g., the instructions could be presented when holding the mouse cursor over a link or button, or presented jointly in a specifically allocated space at the bottom of each page.

ALL Web Interface

I0.12

Appropriate error messages should be presented to the end user whenever a malfunction occurs in the underlying components. (e.g., database connection error, data source offline, etc.)

ALL Web Interface

Table 6: Improvements on Common Pilot Functionalities based on 1st release of platform

of 15


3 Conclusion

This report presented the enhancements and fine tuning activities that both took and should take place in each pilot following the first iteration of the project’s work. It is expected to feed the work to be performed within WP2, 3, 4 and 5 during the second iteration of the project. Its analysis was on a pilot basis and indicated that most of the functional and non-functional requirements (as captured and analysed within WP2, 3 and 4) have been covered in the first release of the platform and the enhancements proposed aim at further improving the platform towards usability, performance and user satisfaction.

of 15


4 References

[1] OpenScienceLink D2.1 “Report on Stakeholders, Main Use Cases, KPIs and Data Sources Assessment”

[2] OpenScienceLink D3.1 “Detailed Specification of OpenScienceLink Pilot Scenarios and Services”

[3] OpenScienceLink D4.1 “OpenScienceLink Platform Architecture and Background Platform Specification”

[4] OpenScienceLink D5.1.1 “Integrated OpenScienceLink Platform”

Report on Service Improvements and Platform Expansion ...€¦ · D5.2.1 Report on Service...

Documents

Transcript of Report on Service Improvements and Platform Expansion ...€¦ · D5.2.1 Report on Service...