TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

117
SPECTRAL SENSORIUM ArtScience creative investigations

Transcript of TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Page 1: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

SPECTRAL SENSORIUM

ArtSciencecreative investigations

Page 2: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

• audiovisual performances and installations • generative / procedural composition• experimental media and net (art) ...

• synesthetic media• sound spatialization

• immersive environments / sensorium• art-science / spectral research & creation

Media

Post Media

New Media

focus on technology and (new) media

focus on sensory modes and vibratory phenomena

focus on perception and space

1992 > 2004

2005 > 2008

2009 > 2015

late 80’s ++ computer - electronic music / informatics

Art-Sciencecurrent collaborations with: - Baltan Labs (NL)- HEXAGRAM / CONCORDIA University / Montreal (CA)- USF / South Florida / Tampa (USA)- FLinT / USD / Odense (DK)- Medical Museum MUSEION / Copenhagen (DK)- National University of Singapore (NUS) / Technical University of Singapore (NTU)- ArtScience Museum Singapore (SG)- Hackteria (CH / INT) …AMONG OTHERS

Page 3: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

New-Media-Art

Post-Media-Art

modal phenomena perceptionvibrations sensorium

Art-Science

psychophysics, neuro-cognitive science, anthropology, sociology

acoustics, optics, fluid dynamicselectrodynamics, (synthetic) biology

&

Page 4: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

New-Media-Art

Post-Media-Art

modal phenomena perceptionvibrations sensorium

Art-Science

psychophysics, neuro-cognitive science, anthropology, sociology

objective and subjective qualities of experience

energy consciousness

&

SPECTRAL SENSORIUM

acoustics, optics, fluid dynamicselectrodynamics, (synthetic) biology

Page 5: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

SPECTRAL SENSORIUM

SPECTRAL / VIBRATORYmechanical - chemical

anything physically oscillating within or outside the envelope of conscious perception

energy

Page 6: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 7: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

10 104.3SOUND

VISIBLELIGHT

Page 8: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

SPECTRAL SENSORIUM

SENSORIUMthe sum of an organism’s perception,

the “seat of sensation” where it experiences and interprets the

environment within which it livesconsciousness

different degrees of sensibility and domains of action

Page 9: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 10: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ArtScience

knowledge

Page 11: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ArtScience

knowledge

play

makeexperiment

discover

Page 12: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ArtScience

knowledge

play

makeexperiment

discover

CREATIVITY PROCESS

Page 13: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

OPTOFONICA CAPSULE

The Optofonica Capsule is a futuristic design/architectural object, featuring a mechanized structure whose parts form an autonomous immersive audiovisual environment.

The shell-like shape of the capsule envelopes the body of the visitor to optimize the experience of Surround and Tactile Sound.

Low frequencies are fed through a specially constructed floor, directly into the bone system of the human body, thereby converting the sound into hyper-perceivable vibration.

The five panels of the Capsule's helmet are designed with specific material and transducers so to vibrate and reproduce the surround sound field without any use of traditional speakers.

A flat screen is positioned to cover most of the visual field of the spectator to engage sight at a short distance and panoramic vision.

Immersion within the Capsule adds a new sensorial dimension to the fruition of audiovisual art and expands the possibilities of creation by the artists.

2008

Page 14: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 15: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 16: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

• 2h:30’ double layer dvd • 43 artists from 13 different countries • 23 audiovisual artworks with 5.1 surround sound • 50 pages booklet with graphic artworks

DVD + ARTBOOK released on 17 November 2009

LINE label (USA)

Page 17: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

CROSSWIRE EXHIBITION

optofonica

The main goal of this exhibition was to investigate the relationship between sound, space and perception, with a focus on artworks with architectural, sculptural and sensorial elements.

The ‘live acts’ series was conceived to be performed on the actual installations, using them as specific multichannel sound systems.

Page 18: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

1967

exact same sample of waterunder the effect of a different frequency

excitation

Page 19: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

cymatics effects of periodic (sound) vibration on water

the water droplet undergoes a process of morphogenesis completely dependentfrom the frequency and amplitude of the excitation signal (sound)

and the vibrating medium

Page 20: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

RGB laser concave mirror + purified water sonicated by Terfenol-D LF transducer

Page 21: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

Page 22: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

Page 23: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

Page 24: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

Page 25: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 26: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

anharmonium

Page 27: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 28: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

from Planetary Harmonics & Neurobiological Resonances in Light, Sound, & Brain Wave Frequencies,including the translation of sound to color

online essay by Anthony Fiorenza

Page 29: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

SENSITIVE TO PLEASURE

Sonia Cillari

Page 30: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 31: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ambisonics cube

Page 32: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

2011 DISPLACE

Page 33: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 34: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 35: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 36: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 37: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 38: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 39: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 40: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 41: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 42: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 43: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 44: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 45: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 46: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 47: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 48: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Body Area Network (BAN)

Chris Salter

Page 49: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Body

PerceptionEnvironment

Group

individual experience

collective experience

Page 50: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Multi-modal sensing and sense making not just vision and audition but also smell, taste, haptic senses, proprioception, etc.

Explore the experiential shifts occurring in the embodied experience between the self and the dynamic environment.

Play with the tension between individual and collective

Qualitative analysis: ethnographic, first person methods to understand user/participant experience “phenomenal data” Varela and Shear, 1999

Page 51: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ENVIRONMENT

PEOPLE

MEDIA CONTROL

DATA COLLECTION

FEATURE EXTRACTION

DYNAMICALSYSTEM

CLASSIFIER

VISUALIZATION

Page 52: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 53: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 54: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 55: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 56: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 57: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 58: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 59: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 60: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 61: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 62: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 63: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 64: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

How can we define physiological synchrony?

How long does synchrony have to last to consider it a “locking event”?

How can we distinguish between natural and induced synchrony? all physiological signals are cyclical so they will synch-up naturally

Kuramoto model as a possible bridge between the physiology and the stage system.

Page 65: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 66: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

FLinT Center (Fundamental Living Technology), University of Southern Denmark, Odense

Page 67: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Protocells and Biocommunication research project in collaboration with Dr. Martin Hanczyc 2012-13

Dr. Martin Hanczyc

Page 68: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Protocells and Biocommunication research project in collaboration with Dr. Martin Hanczyc 2012-13

FLinT Center (Fundamental Living Technology), University of Southern Denmark, Odense

Page 69: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 70: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 71: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 72: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 73: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Robert C. Beck, 1925-2002 D.Sc., Bioelectrical engineer / researcher

- BLOOD ELECTRIFIER

- MAGNETIC PULSER

- BRAIN TUNER

Page 74: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 75: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

www.tez.it/beck

Page 76: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 77: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Cranial Electrotherapy Stimulation (CES) is a treatment that applies a small, pulsed electric current across a patient's head. Some researchers and doctors claim that CES has beneficial effects in conditions such as anxiety, depression, insomnia and stress. However, its effectiveness is still being studied and is thus an experimental treatment. It is also supposed to activate endorphin stimulation.

BRAIN TUNER

Page 79: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 80: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

RODIN STARSHIP COIL

Page 81: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Resonant inductive coupling or electrodynamic induction is the near field wireless transmission of electrical energy between two coils that are tuned to resonate at the same frequency. The equipment to do this is sometimes called a resonant or resonance transformer. While many transformers employ resonance, this type has a high Q and is often air cored to avoid 'iron' losses. The two coils may exist as a single piece of equipment or comprise two separate pieces of equipment.

WITRICITY - project by M.I.T. 2007

Page 82: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 83: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Page 84: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Page 85: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Permanent Motion Holder

Page 86: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Permanent Motion Holder

Page 87: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Permanent Motion Holder

Page 88: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Permanent Motion Holder

Page 89: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EDWARD LEEDSKALNIN

MAGNETIC CURRENT

Permanent Motion Holder

Page 90: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 91: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

ARTSCIENCE RESIDENCY PROGRAM

ARTSCIENCE MUSEUM - MBS

Page 92: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

Page 93: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 94: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

David Fries

David Fries is Director of the Ecosystems Technology Group at the USF College of Marine Science, President of the non-profit SciFlies, and CTO of Spyglass Biotechnologies. He was an original member of the USF Center for Ocean Technology, and the founder of Intelligent Micro Patterning, Bioplex, Inc., Voda LLC, and Savu, Inc. He was the original creator of the National Forensic Science and Technology Center, holds 34 patents, licensed 12 technologies while at the university, and has over 60 publications in oceanography, analytical chemistry, medical technology, biotechnology, chemistry, microtechnology, electronics, and robotics. He previously held an appointment at Sandia National Laboratories/Lockheed Martin. He received the Bachelor of Science in Chemistry from the University of Pittsburgh and the Master of Science in Chemistry from the University of South Florida.

DAVID FRIES

Page 95: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

Water monitoring:• ph• torbidity• conductivity• temperature• pressure• depth

Optical Spatial Light Modulatorcustom tech developed by David Fries DLP projector engines with modified optics

+ salinity dissolved oxygen and possible chlorophyll

Page 96: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

spatial patterns / waxels

swarming vehicles

emergent behaviors

Page 97: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

Page 98: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

cell tech

ENERGY

solar

propulsion

NAVIGATION

buoyancy

… swarm

OSLM

SENSORS

salinity

oxygen clorophyll

acoustic

COMMUNICATION

radio

… internet

LED

LIGHT

DLP

…OSS

SOUND

Transducers

microcont.

COMPUTING

OS

… protocols

MODULAR SYSTEM

Page 99: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

LED / neopixels

LIGHT

DLP …

OSS

SOUND

Transducers

MODULAR SYSTEM

Page 100: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

Underwater ARTificial Bioluminescent Drifter Swarms

MODULAR SYSTEM

Page 101: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 102: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 103: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 104: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 105: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 106: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

pic 15

Page 107: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015
Page 108: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

PlankTones

Page 109: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 110: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 111: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 112: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 113: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 114: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 115: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Page 116: TeZ - SPECTRAL SENSORIUM - ART/SCIENCE RESEARCH 2010-2015

EXECEXperimental ElectroCulture

Edible Gardens City - Urban Farmers