The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

23
The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell

Transcript of The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Page 1: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

The Creative Speech Technology (CreST) Network

Alistair Edwards & Chris Newell

Page 2: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

A research network

Engineering and Physical Science Research Council (EPSRC)Networks are a way to bring together people of related interests to foster new research partnershipsLater additional funding from the Arts Council for England

Is this a first?Not a focussed research project

Page 3: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Our networkDeliberately diverse

From• John Wedgwood Clarke

– poet

To• Roger Moore

– Professor of Spoken Language Processing

From• Alan Martin

– Accessible creative dance, music making, and Light Painting with dance

To• David Mason

– Toby Churchill Ltd

Page 4: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Diversity

Bring together artists, users, technologists and researchers…and see what they can make the technology do

Page 5: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

AAC

Is not the only focus…but most of our work has potential application to AAC

Page 6: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Roadshow

Focus of our work3 December 2012 (UN International Day of Persons with Disabilities)

York, City Screen

4 DecemberSheffield, Winter Gardens

5 DecemberHull, Hull Truck Theatre

Page 7: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Roadshow dress rehearsal

September 2012University of York

Page 8: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

My Voice is Me

Lee Ridley videoVisitors invited to complete: My voice is…

Page 9: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Can’t Sing, Will sing

Four-part choral harmonyUser controls one of the voices through a games controller

Page 10: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Controllable, Expressive Speech Synthesis

Control the speech of cartoon characters

Select voice• male, female, robot, child

Select mood• angry, happy, sarcastic,…

- using two big silver balls

Page 11: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Voice by Choice

Comedy sketch by Lee RidleyBased on a speed-dating event

at which 3 people all have the same voice

Page 12: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

It ain’t what you say, it’s the way that you say it

Hand gestures control voicepitchrate

Page 13: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

AnTon, the animatronic tongue

Visitors can play with the tongue muscles

Page 14: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Conversational Kiosk

Engage in a spoken dialogue with a machine

Page 15: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Bespoke

Poems by John Wedgwood ClarkeSpoken by speech synthesizerPerformed by an actor

who cannot speak

Page 16: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Professor Moore’s Digital Voice Factory

Record your own voiceHear it

backwardssdrawkcab

like a dalek and really messed about

Page 17: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

My Voice and Me

A melodrama

Page 18: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Frank

Experiments in sympathetic engagement elicited through

Silence in Synthetic Speech

Page 19: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Beyond Speech

Speech becomes something more

controlled by gesture

Page 20: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

The CreST Documentary

Page 21: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Where next?

Context awarenessAnnual conferenceWebsite

Page 22: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Thank you

The CreST Networkhttp://crestnetwork.org.uk

Page 23: The Creative Speech Technology (CreST) Network Alistair Edwards & Chris Newell.

Alistair EdwardsUniversity of York

Christopher NewellUniversity of Hull

Debbie HaverstockUniversity of York

Emma-Jane AlexanderUniversity of Hull

Maria AretoulakiDialogCONNECTION Ltd

Matthew AylettBruce Balentine

EIG Labs

James BalentineUniversity of Texas at San Antonio

Paul BarkerCentral School of Speech & Drama, University of London

Art BloklandToshiba Research Europe Limited

Mark BlytheNorthumbria University

Leonardo BottaciUniversity of Hull

Jude BreretonUniversity of York

Rob ClarkUniversity of Edinburgh

John Wedgwood ClarkeUniversity of Hull

Caroline CollinsEnterprise Integration Group

Daniel DoughtyUniversity of Hull

Paul ElsamUniversity of Teesside / Academy of Live and Recorded Arts

Paul FoulkesUniversity of York

James GilbertUniversity of Hull

Mark HildredApollo Creative

David HorowitzHorowitz Immersive Worlds Ltd

David HowardUniversity of York

Ben JohnsonApollo Creative

Kevin JonesComposer, writer, sound artist

Simon KingUniversity of Edinburgh

Pierre LanchantinUniversity of Cambridge

Javier LatorreToshiba Research Europe Limited

Ann LightNorthumbria University

Lucy LowsonGLOSSA

Robert MackayUniversity of Hull

Gill MainUniversity of Plymouth

Alan MartinMouse on the Move Workshops

David MasonToby Churchill Limited

Roger MooreUniversity of Sheffield

Darren MundyUniversity of Hull

George NewellAlan Newell

Dundee University

Rowan OliverUniversity of Hull

Sandra PaulettoUniversity of York

Barry PerksInternational Service

Chris PidcockCereProc Limited

Graham PullinUniversity of Dundee

Darren ReedUniversity of York

Hannah RolfeNeel Shearer

Toby Churchill Limited

Robert StewartPatrick Titley

University of York

Christophe VeauxUniversity of Edinburgh

Vincent WanToshiba Research Europe Limited

Jez WellsUniversity of York

P C WrightUniversity of Newcastle