and assessing users’ needs · Type of engagement/ collaboration (ongoing or one-off engagement);...
35
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 776467. Co-producing climate services and assessing users’ needs Marta Bruno Soares University of Leeds, UK [email protected]
Transcript of and assessing users’ needs · Type of engagement/ collaboration (ongoing or one-off engagement);...
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Co-producing climate services and assessing users’ needs
Marta Bruno SoaresUniversity of Leeds, UK
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Contents
1. Climate services
2. Why the need for climate services?
3. Co-producing climate services
4. What can go wrong?
5. Assessing users’ needs
6. Final remarks
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Q. What are climate services?
(Based on GFCS, IPCC AR5, and CSP definitions)
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
• Climate services - development and/or provision of climate information and knowledge to support users’ decision-making through tools, websites, and tailored products (see e.g. Vaughan and Dessai, 2014).
• Central aspects to this concept include (Bruno Soares et al., 2018):
• The ‘users’ of the service,
• The climate information/knowledge required by the user;
• The provision of the climate service.
1. Climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
End-users
OrganisationsNMHS
ConsultanciesIndividuals
…
1. Climate services
Climate information &
knowledge
Producers
NMHSECMWF
Consultancies…
ConsultanciesNMHS
Organisations…
Intermediaryorganisations
The ‘users’ – a fluid and relative concept
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
The climate information/knowledge:
• Raw model data – tailored products• Simple climate variables – complex indices aggregating climate and other types of information…
Bruno Soares et al. (2018)
1. Climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
The provision of climate services:
End-users
OrganisationsNMHS
ConsultanciesIndividuals
…
Producers
NMHSECMWF
Consultancies…
ConsultanciesNMHS
Organisations…
Intermediary organisations
Different contexts/types of provision:• Research vs operational
setting;• Commercial vs freely
available products and tools;
• Climate information vs tailored products.
1. Climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
2. Why the need for CS?
• Non-linearity between the production of climate science and the use of that information on the ground;
• Integration of users’ knowledge in science - increase credibility, legitimacy, saliency and enhance usability of science developed (McNie, 2007, Lemos et al., 2012);
• Processes of co-production allow collaboration and ongoing interactions between actors (cf. Bremer & Meisch, 2017);
• Climate services as applied multidisciplinary science rather than basic research.
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
A complex landscape of users and needs:
• Different types of users and organisations (public, private, NGOs, etc) = concerns, expectations, resources, organisational, decision frameworks and different demands from science!
• Different level expertise and technical knowledge in relation to climate and information;
• Relative importance of climate in the organisation’s activities, routines and processes.
• No virtual separation between weather and climate
information (Bokoye et al., 2014);
2. Why the need for CS?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
A complex landscape of users and needs:
• Users require information/knowledge that fit their specific needs (Lemos et al., 2012):
• Usable information
• Timeliness of information
• Relevant and accessible
• Accurate and reliable
• Credible and salient.
• User information information needs differ in space and time and within/across organisations and sectors.
2. Why the need for CS?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Bruno Soares et al. (2018)
2. Why the need for CS?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Questions?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
3. Co-producing climate services• Co-production – methodological approach that brings
together producers/providers of weather and climate information with those who use the information knowledge to make decisions (as well as others in between) to solve a problem where weather and climate information/knowledge is relevant (cf. Carter et al., 2019).
• But not always an easy process to pursue effectively! (Bruno Soares & Buontempo, 2019).
• For more on co-production see Bremer and Meisch (2017).
From Carter et al. (2019)
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Why co-produce climate services
with users?
Users’ involvementand influence
Include users’ knowledge and
expertise
Understand users’ climate
information needs
Improve usability of the service by
the users
Gather Information to
feed service development
Forge/develop (new)
collaborations
Test and co-evaluate CS
(feedback loops)
Critically reflect on the process of co-
production
3. Co-producing climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
How to co-produce climate services with
users?
Inclusiveness (between and across actors
involved)
Time required to effectively co-
generate!
Work towards a well co-defined
and specific goal
Disciplinary and personal flexibility and adaptability
(Ongoing) involvement of
relevant actors & expertise
Financial and human resources
and expertise
Co-identify entry-points for
development
Effective feedback loops
(both ways!)
3. Co-producing climate services
Scoping stage regarding main
decisions
Determining initial focus in
technical terms
Adjustments given technical
limitations
Monthly provision of SCF
Review of forecasts based
on feedback from farmers
Understanding decisions at hand and potential to
use SCF
Falloon, Bruno Soares et al. (2018)
Refinement of technical and
graphic aspects of the forecasts
Further identify
opportunities to use the
LMTool
Understand the
usability of the tool
3. Co-producing climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Questions?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Q. What can go wrong?(when co-producing CS)
CommunicationLanguage and terminologyComplex (scientific) languageAssumptions!Uncertainty of information
Knowledge, capacity and expertise
Internal capacity/resourcesKnowledge of what’s required
Knowledge brokering/ translation
Managing expectations Scientific rigour vs usability of informationDifferent cultural backgrounds and experiencesDisagreements
Ethics and values Collaboration
IntegrityTransparency
Humility
Potential pitfalls whenco-producing climate services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
5. Assessing users’ needs
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
5. Assessing users’ needs
From Charron (2014)
• Effective CS require a clear understanding of the context within which the climate information will be used. For example:• Where will the information be used and by whom?• What type of information is required, when and how?• Will the information be used to support decision-making? If so,
what decisions? How are they made? When and how? • Will the information be used together with other information?
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Surveys Interviews Workshops
Pros Lower costs, bigger sample size, lower
expertise
Access to in-depth information, creating a rapport, response rate,
reliability
Group discussion, testing/ evaluating
ideas
ConsRate of response , bias of data and reliability
Higher costs, time, some expertise required to
avoid bias
Higher costs, expertise required
ModesOnline, face-to-face,
postal, mixedFace-to-face, telephone,
online, mixedFace-to-face (online)
Deciding on type/mode
Type of engagement/ collaboration (ongoing or one-off engagement); type of information/knowledge required; time and budget; contacts available;
expertise available to pursue these modes
Examples of methods for engaging with users , and assessinginformation needs:
5. Assessing users’ needs
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
• Co-producing climate services can be an effective process of making climate information usable to users;
• It can also bring other benefits e.g. collaborations, building trust,..
• It requires a multidisciplinary team, resources, Iteration, flexibility, adaptability to make the service usable and of value to the user;
• Intermediary organisations can help bridge existing gaps;
• Level of co-production with users and their engagement dependent of available resources, interest & added value to user, trust, credibility, etc;
• Attention to pitfalls! e.g. standards vs needs; managing expectations; terminology; clear communication…
• Users are busy – engage with them according to their practices.
6. Final remarks
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
References• Bremer, S., & Meisch, S. (2017). Co‐production in climate change research: reviewing different
perspectives. Wiley Interdisciplinary Reviews: Climate Change, 8(6), e482.• Bruno Soares, M. and Buontempo, C. (2019). Challenges to the sustainability of climate services
in Europe. Wiley Interdisciplinary Reviews: Climate Change. DOI: 10.1002/wcc.587• Bruno Soares, M., Alexander, M., Dessai, S. (2018). Sectoral use of climate information in
Europe: a synoptic overview. Climate Services. https://doi.org/10.1016/j.cliser.2017.06.001• Carter, S., Steynor, A., Vincent, K., Visman, E., and Waagsaether, K. (2019) ‘Co-production of
African weather and climate services’. Manual, Cape Town: Future Climate for Africa and Weather and Climate Information Services for Africa (https://futureclimateafrica.org/coproduction-manual)
• Charron, I. (2014). A Guidebook on Climate Scenarios: Using Climate Information to Guide Adaptation Research and Decisions. Ouranos, 86 p.
• Falloon, P., Bruno Soares, M., Manzanas, R. et al. (2018). The LMTool: The EUPORIAS Climate Service for Land Management in Southwest UK. Climate Services. https://doi.org/10.1016/j.cliser.2017.08.002
• Lemos, M.C. et al. (2012). Narrowing the climate information usability gap. Nature Climate Change, 2(11), 789-794.
• McNie, E. C. (2007). Reconciling the supply of scientific information with user demands: an analysis of the problem & review of the literature. Env. Science & Policy, 10(1), 17-38.
• Vaughan, C., & Dessai, S. (2014). Climate services for society: origins, institutional arrangements, and design elements for an evaluation framework. Wiley Interdisciplinary Reviews: Climate Change, 5(5), 587-603.
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Co-producing & assessing needsin the Med-Gold pilot services
Marta Bruno SoaresUniversity of Leeds, UK
This project has received funding fromthe European Union’s Horizon 2020research and innovation programmeunder grant agreement No 776467.
Co-producing the MED-GOLD pilot services
Olive/olive oil
User: DCOOP
Grape/wine
User: SOGRAPE
Durum wheat
User: Barilla
• Each pilot services is co-produced with specific users and with a specific technical team in MED-GOLD;
• Common methodological approach across the three climate services pilots.
Assessing user needs
Developing the services
Testing the services
Assessing the value of
services
Test services with users
Adjust services
Develop Beta
services
Users’ feedback
Final services
Assess value to
users
Assess user
needs
Assessing user
needs
Developing the services
Testing the services
Assessing value of services
But in reality it looks more like this…
Test services with users
Adjust services
Develop Beta
services
Users’ feedback
Final services
Assess value to
users
Assess user
needs
Assessing user
needs
Developing the services
Testing the services
Assessing value of services
But in reality it looks more like this…
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Common areas of enquiry across the pilots with thedifferent user organisations, including:
• Key vulnerabilities of the activities/operations of theorganisations in relation to weather and climate;
• Key decision-making processes in the organisations;
• Their current use of weather and climate information;
• How can climate information be improved (or created) to betterfit/support the decisions at hand;
• Current and future information needs and existing climateinformation gaps.
Assess user needs
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Pilot service
MethodPartners involved
Participants Aim
Olive/olive oil
1 workshop
DCOOPBSC
GMVEC2C
20-25 agronomists/
field technicians working in
DCOOP
Discussions around the productivity, quality and pests and how agronomists operate
and inform farmers
Grape/Wine
4 Focus groups
SOGRAPEUNI
LEEDS
7 or 8 process
managers at SOGRAPE
Further understand the vulnerabilities of the different processes already identified, critical decisions and how the pilot service can help improve
activities and outputs.
Durum wheat
2 workshops
BARILLAJRC
HORTA
20-30 ‘elevators’
(i.e. cooperative of farmers) and farmers
Understand their activity and experiences. It was agreed to leave the discussion as open
as possible
Assess user needs
Underpinned by common methodological approaches…
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
7 days 14 days 1 month 3 months 6 months 10-30 years
Olive/olive oil
Field activities Harvest planningSettling new olive
plantation
Grape/wine
Stock (consumables) managementChoice of rootstock/clone
Definition of training/pruning systemPest/diseases management
Harvest timing/maturation control
New vineyard settlingChoice of variety
Durum wheat
Pests/disease/weed managementSelection of sowing density
FertilizationHarvest timing
Choice of varietyMonitoring new
pest/disease/weedEquipment purchase
Assess user needs Mapping key operations and decisions against weather and
climate timescales
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Assess user needs
This stage was also complemented with:• Review of the literature to assess sectors’ vulnerabilities,
critical decisions, and information needs (see Mihailescuand Bruno Soares, 2020);
• Regulatory and institutional mapping & market analysis;• Mapping uncertainty and skill in climate data from range
of datasets and initiatives across Europe;• Development of a common ICT infrastructure and data
management platform.
Informed the development of the beta versions of the MED-GOLD pilot services
This
pro
ject
has
rece
ived
fun
din
gfr
om
the
Euro
pea
nU
nio
n’s
Ho
rizo
n2
02
0re
sear
chan
din
no
vati
on
pro
gram
me
un
der
gran
tag
reem
ent
No
77
64
67.
Thank you!
Questions?
