IMAILE Collected Results – Procurers and Policy Level

The IMAILE PCP results at a glance – collecting a four-year innovative process

Showcase of Project Experiences

IMAILE challenges from a procur-er perspective

We are proud to announce that EU:s first Pre-Commercial Procurement (PCP) project in the Education sector, IMAILE (www.imaile.eu) has been successfully completed, providing hard evidence on PCP as an efficient tool to strengthen the Euro-pean Education sector. IMAILE results con-firm that the PCP has provided pedagogical, financial and technological benefits, as well as important lessons learned for all stake-holders, beyond the expectations. IMAILE PCP was initiated by four procurers of learning technology from Sweden, Spain, Germany and Finland in order to, through the PCP tool, challenge the market to devel-op innovative technology supporting identi-fied pedagogical, technical and financial needs which are related to personalized learning in the European schools. In 2015, the four procurers launched a Pre-Commercial Procurement (PCP) call for ten-der of research and development services of such innovations. In the first project phase 7 suppliers, from all over EU, were awarded Europe’s first PCP framework con-tracts within the Education sector for solu-tion design exploration. In the second phase of the PCP project, 4 suppliers were

selected to renew their contracts to further develop their concept into prototypes. The two most promising solutions were select-ed to PCP phase 3 for tests in real class-rooms with teachers and students. The research and development during the project, together with the tests conducted in real end-user environments with over 600 students and 45 teachers participating, has resulted in two smart and innovative Personal Learning Environments (PLE) offer-ing Learning Analytics provided by intelli-gent tutoring systems to primary and sec-ondary schools that no other solutions available on the market offer. The perfor-mance improvement indicators hypotheses are: Hypothesis - Save teacher’s time con-firmed. All test teachers confirm that both PLE solutions demonstrate potential to re-duce their lesson planning time by features to reuse and share lesson creation tools as well as automatic evaluation, quick assess-ment tools and alerts. Hypothesis - Full scale personalized learning approach in Primary and Second-ary Education confirmed. 60-80 % of the test group’s students experienced satisfac-tion of more personalized learning paths with content and learning methods suitable especially for them. The Learning stories creation tools demonstrates a constant use in the tests, which indicates the increased reflection upon the personal STEM learning by all students involved in the tests. Addi-tionally, the PLEs demonstrated to support students with special needs like Downs syn-drome and concentration disorders.

Hypothesis - Increase STEM motiva-tion and STEM careers confirmed. Both PLE:s provide visible personalized STEM motivation features for teachers and stu-dents. 55-75 % of the test students in the four countries experienced increased STEM motivation using IMAILE PLEs thanks to creative content creation and learning re-flection tools, badges and leader boards, gamification and virtual tutor providing recommendations on STEM learning and careers. Hypothesis - Reduce early dropouts by 15% confirmed. Both PLEs are provided with alerts to detect possible early drop-outs at an early stage, with the potential for teachers and parents to identify them with anticipation compared to other traditional methods. No other systems on the market currently provide reports and alerts to par-ents. Due to this feature the estimation, as result of the test, provides a possible reduc-tion to reduce the number by 20%. Requirement on Interoperability and Open standards confirmed. Both PLEs are applicate to BYOD (Bring your own device) and can be used on all devices applying Open standards. Both of the IMAILE PCP solutions are also investigating the Block-chain technology, as a promising solution to secure the learning data of European Schools. Impact on Schools’ savings. In an IMAILE example, a secondary school where the costs on software per student were 92.6 € per year, using the IMAILE PLEs the savings over the 9 years of education for 900 students would equal to 588 060 €.

https://www.almerin.com/yiptree/

Innovative feature - Virtual Tutor Innovative feature - Personal learning paths Innovative feature - Progress tool for learning Innovative feature - Quick assessment tool Innovation feature - Notification centre Innovation feature - Gamifications (badges and leader boards) Innovation feature - K12 compatible user face Innovation feature – STEM career recommender

http://www.amigostem.com/login/?next=/

Innovative feature - Analytics dashboard Innovative feature - Intelligent tutoring system (ITS) Innovative feature – Gamifications Innovative feature- Lifelong learning e Portfolio Innovative feature - Portabily Authoring tool Innovative feature – Learning Story tool

IMAILE user-led innovations

Both PLEs are considered to be at Technology Readiness Level (TRL) 7, with an estimation to reach the market within one to two years. Due to the experienced success during IMAILE PCP project from both the demand and the supply side, deployment and a Pub-lic Procurement of Innovative solutions (PPI) is planned in 2018 within the up-coming H2020 project Learntech Accelerator (LEA).

IMAILE Collected Results – Procurers and Policy Level

IMAILE is proud to present the following two PLE:s, for both primary and secondary school, to the European learning technology market, available for purchase shortly.

#1 Hard evidence on PCP as effective tool to reform learning technology IMAILE STEM PLEs bring four user-led innovations to the market which is hard evidence on PCP as effective tool to reform learning tech-nology. A PCP speeds up the technical development process and steers the innovation based upon the customer needs and allows early interaction of end-users to give feedback on developed features.

#2 Strengthened dialogue in learning technology between demand and supply side on EU level The supply and demand interaction, understanding and dialogue are fundamental concepts to create a sustainable, inclusive and knowledge-based growth within Learning Technology 2030 and beyond. IMAILE provides evidence that the dialogue is what both the de-mand and supply sides value as the greatest advantage of the PCP. Recommended tools for successful and strengthened dialogue, apart from the formal assessment of each PCP phase, is a transparent Questions & Answers Google Tool, Confidence Criteria Table, Success Cri-teria Table, formal and informal meetings and, last but not least for a common understanding in a complex process, the Technology Readi-ness Level (TRL) table that shall be used for visualization of the progress.

#3 Improved and customized PCP methods and templates for learning technology IMAILE PCP is a pilot project and thus development, implementation, assessment lessons learned, recommendations and results need to be highlighted and disseminated to make future learning technology innovation procurement efficient and qualitative.

Quality indicators from procurers on PCP

Apart from the innovations developed, the IMAILE PCP has achieved several lessons learned for European procurers compiled in several statements.

By project start 1st of February 2014 only stand-ard PCP documentation, contracts, recommen-dations and templates existed on EU level. Through IMAILE project specific PCP Learning technology strategies / methodologies have been developed, implemented and assessed in order to create future recommendations, in-cluding progress based upon the gathered and analysed results from relevant stakeholders in 2018. As stated in the graph IMAILE, and up-coming LEA, are creating giant and unique leaps forward with innovation procurement in learn-ing technology.

Showcase of Project Experiences

There are several common benefits identi-fied by the four procurers after the almost five-year long learning process of PCP on EU level. The main profit is of course the fu-ture pedagogical and financial benefits of the developed STEM PLEs, that enables teachers to save time by using automated assessment, and recommendation on per-sonalized courses and material, which allow the classes to get bigger remaining the same quality and still providing one-to-one interaction between the teacher and the students. The PLE:s also enables reduction on paper book costs, replaced by e-books, and contribute to reduced costs on early drop-outs for the future. One additional, possible gain in the future is the potential of an increased growth and tax income for the regions due to the STEM motivation that arises from using the IMAILE PLEs. The procurers also identify the PCP as a tool to change, improve and influence learning technology as a whole in the future and bring industry and the European classroom closer to each other with the procurers in the drivers’ seat of learning technology innovations.

By participating in a PCP all the procurers experienced that their organizations gained an increased understanding of the Europe-an learning technology market, but also that they found a useful tool for dialogue to increase quality of developed innovations according to users need. One additional statement is that tests with end-users in real classrooms brings learning technology industry and the technology of the future straight into our classrooms which provides learning and education progress on levels beyond the foresight. PCP has also proven to be an effective tool to manage the digital transformation and innovations in public administrations and IMAILE was awarded "most innovative European project" at the VII National Congress on Public Services and Innovation in Spain in 2016.

IMAILE Collected Results – Procurers and Policy Level

PCP benefits identified by IMAILE Procurers

PCP recommendations from procurers to other procurers #1 In order to create consistency from the user and demand perspective needs assessment groups shall be identified and involved on local, regional and EU level, whom will be able to contribute to feedback and tests further on in the PCP process. #2 In the IPR section of the ITT a clause of granted User rights shall be included for future deployment by the procurers, while Open stand-ards as minimum requirements shall be included to avoid national legislations and requirements for deployment and purchase. #3 PCP needs to be monitored on both contract compliance and content level. The Contract manager shall monitor the fulfilment of con-tracts and Service offers, while the procurers and the Technical manager shall monitor the content of the PCP based upon the Challenge Brief. #4 Dialogue shall be included from Phase 1 using tools like Success Criteria Table (SCT) and Confidence Criteria Table (CCT). #5 Teachers and students shall be motivated with certificates, study visits, peer support and, if possible, additional budget shall be provid-ed for schools.

Some recommendations from IMAILE procurers to other future PCP procurers

Showcase of Project Experiences

Consortium

IMAILE streamlined PCP guidelines to learn more

Thank you and how to follow up!

IMAILE has gathered data, analysis and results into one joint docu-ment, with the purpose to provide a simplified, streamlined and user-friendly guideline that should be used for future PCPs of learn-ing technology including: Templates and methodologies for each phase of the PCP pro-

ject. PCP specific recommendations for learning technology. Evidence based advantages of R&D procurement for learning

technology using PCP. Key performance indicators (KPI) adopted for PCP in learning

technology. Thank you for following our project during these years. Welcome to join the Learntech Accelerator LEA) project as observer organization, from 2018 onwards, and learn more about innovation procurement of learning technology. Contact Ms Ellinor Wallin ellinor@euprojektonsult.se or Ms Kati Clements kati.clements@jyu.fi for more information. Regards from the IMAILE and future LEA team

From the 15th of February 2018 the IMAILE Streamlined PCP guide-lines can be downloaded http://www.imaile.eu/about/imaile-results/ where you also can find all the final information on the IMAILE legacy, including Key performance indicators on our results, user friendly templates, methodologies and recommendations.

IMAILE Collected Results – Procurers and Policy Level

Showcase of Project Experiences