A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia...

26
A Fully Automated, PC- based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity Technologies Symposium Oxford September 2012

Transcript of A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia...

Page 1: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

A Fully Automated, PC-based, Wildlife Monitoring and Survey

System

Neil J Boucher

SoundID, Australia

Michihiro Jinnai

Nagoya University, Japan

Biodiversity Technologies Symposium

Oxford

September 2012

Page 2: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

What are these Calls?

?

?

?

?

Page 3: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

And they are:

Parrot

Humpback Whale

Humpback Whale

Mydau Bat

Page 4: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Harmonics

• In the real world, harmonics are mostly generated by distortion.

• In engineering we take great pains to avoid them.

• Harmonics have few uses (outside of music) and are mostly undesirable.

Page 5: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Harmonics in Bio-Acoustics

• These are mostly artefacts of the FFT (also known as the Harmonic Transform).

• They are sometimes the result of faulty/poor quality recording equipment.

• Occasionally animals actually produce harmonics.

Page 6: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Harmonics?

Page 7: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Why waste Energy?

• Were the whale to actually generate all those harmonics (with high frequencies and high propagation losses), it would be a very inefficient way to communicate.

• Additionally the sound of the whale would vary noticeably with distance (less high frequencies at distance).

Page 8: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Modulation

Page 9: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Before and After

Page 10: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Spectra of the Modulation Envelope of Whale Call

Page 11: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Recorder for up to 2 Months of Recording

Page 12: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Long-term Recorders

Page 13: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

The Software

Page 14: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

References

• The system works by comparing a library of WAV files (stored as mathematical images of their LPC spectrogram) with the spectrograms of the target sound.

Page 15: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

LPC Transform Image of Kookaburra

Page 16: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

LPC Transform of Rosella

Page 17: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Compare the Patterns as Images

Page 18: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Measure the Similarity using GD (here GD=10.80)

Page 19: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Geometric Distance

• It is an angle between two vectors (measured in degrees).

• For field recordings a distance of 6 degrees or less implies similarity of the sounds.

• Concept was developed by Jinnai.

• It measures the similarity of two sounds!

Page 20: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Determine a Similarity Value (GD)

• Typically we would use GD<=6.00 for similar matching call types.

• GD is “sort of” logarithmic, so calls with a GD of 6.00 are “roughly” 10 x more similar than those with a GD of 7.00.

• A GD of 10. 80 is a VERY dis-similar distance.

Page 21: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Dawn Chorus List• Australian Crow (Corvus spp.)• Pied Currawong (Strepera graculina)• Eastern Whipbird (Psophodes olvaceus)• Grey Shrike-thrush (Colluricincla harmonica)• Guineafowl (Numida spp.)• Kookaburra (Dacelo spp.)• Lewin’s Honeyeater (Meliphaga lewinii)• Magpie (Gymnorhina tibicen)• Noisy Miner (Manorina melanocephala)• Pale-headed Rosella (Platycercus adscitus)• Pied Butcherbird (Cracticus nigrogularis)• Spur-winged Plover (Vanellus spp.)• Rainbow Lorikeet (Trichoglossus haematodus)• Eastern Sedgefrog (Litoria fallax)

Page 22: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Results from 1 Hour and 8 minutes of Dawn Chorus

Page 23: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Capabilities

• >100,000 comparisons per second

• Can analyse a whole HDD in a single run

• Can have any number of different species being searched for at the same time

• Accuracy greater than human expert

• Real-time recognition is possible

• Can handle terabytes of data in batch mode

Page 24: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

PC Specs

• Any Windows PC will run the software

• Ideally one with a fast clock (>2.5 GHz)

• Screen size 1920 x 1080 is best

Page 25: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Time and Frequency Domain Image

Page 26: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity.

Conclusions

• The time of the “better than human” sound identification has come.

• Very large acoustic surveys are now possible.

• The package has lots of new analysis tools.

• The system is available now at www.soundid.net