lllllllllllllllllllllllllllIllllllllllllllllllllllllllllll ... · 506'\ conferencing api 5 10 i‘...
Transcript of lllllllllllllllllllllllllllIllllllllllllllllllllllllllllll ... · 506'\ conferencing api 5 10 i‘...
lllllllllllllllllllllllllllIlllllllllllllllllllllllllllllllllllIIIIIIIHIII _ USO05434913A
UIlltBd States Patent [19] [11] Patent Number: 5,434,913 Tung et a1. [45] Date of Patent: Jul. 18, 1995
[54] AUDIO SUBSYS'I'EM FOR COMPUTER-BASED CONFERENCING SYSTEM
OTHER PUBLICATIONS
Computer Conferencing: IBM scientists demo proto type of affordable computer conferencing system, Nov.
[75] Inventors: Peter Tung, Beaverton; Ben Vrvilo, 2’ 1992_ EDGE’ on & about AT&T’ V7, 11223’ p, 22_ Portland, both of Greg.
Primary Examiner—.larnes L. Dwyer [73] Assignee: Intel Corporation, Santa Clara, Calif. Assistant Examiner-Scott Wolinsky [21] A 1 N 158 246 Attorney, Agent, or Firm—-Steve Mendelsohn; William
pp . 0.: , H. Murray
[22] Filed: Nov. 24, 1993 [57] ABSTRACI‘
[51] Int. 01.6 ............................................ .. HD4M 3/56 An audi° task ,residing °n 3,11 audio/communicating [52] us. (:1. .................................. .. 379/202; 395/800; Pwd °f a“ “(11° ‘Subsystem “1 a COmPuF“ °°Y%fe“?“°'
395/162 ing system. An audio manager and an audio applications [58] Field of Search ______________ u 395/800’ 162; 379/202, programming interface reside on a host processor of: the
379/205 203 204 computer conferencing system. The audio task receives ’ ’ local analog audio signals, generates local compressed
[56] References Cited audio signals corresponding to the local analog audio U S PATENT DOCUMENTS signals, and passes the local compressed audio signals to
' ‘ ' a communications subsystem of the computer confer
4,475,l93 10/1984 Brown ....................... .. 379/202 encing system for transmission over a communications 4,333,795 12/1989 AndO e} 31 -- 379/53 link to a remote computer conferencing system. The 5,014,267 5/1991 Tompi‘ms ct a1‘ " """"" " 370/62 audio task receives remote compressed audio signals
snuzuktllet a1‘ """""""" from the communications subsystem and generates re 5Z231Z492 7/1993 Dangig:al:":::............12: 358/143 mote decompress“ audio Signals correspmding to the 5,315,633 5/1994 remote compressed audio signal for local playback. 5,319,793 6/1994 5,335,321 8/1994 16 Claims, 32 Drawing Sheets
102 102 104
CANERA MICROPHONE CANERA MICROPHONE
ANALOG ANALOG ANALOG ANALOG
VIDEO AUDIO VIDEO AUDIO
V V V V
100 ' 100 1 CONFERENCING ISDN NETWORK CONFERENCING f
SYSTEN SYSTEN
A (DIGITAL) B
1 1 0
ANALOG ANALOG ANALOG ANALOG
VIDEO AUDIO VIDEO AUDIO
V l l V
KINITOR SPEAKER NONITOR SPEAKER
106 108 106 108
CISCO SYSTEMS, INC. Ex. 1031 Page 1
CISCO SYSTEMS, INC. Ex. 1031 Page 2
US. Patent July 18, 1995 Sheet 2 of 32 5,434,913
2: o H ~ No“ M26525; :5 5:6 55 65>: 5:
we“
52% T 22 228532 is 22>
Fvom
EKR _ _
wcm ma <2
2%.. 2: 11+ “Maw:
“058% 5%
E
NQNR
CISCO SYSTEMS, INC. Ex. 1031 Page 3
U.S. Patent July 18, 1995 Sheet 3 of 32 5,434,913
wow m2 <2 65>: BEBE 2m <2
mg mg 22> 1.1.6:“ luv @558 :22 .2; “8&5;
SE 3 82> 25: 82> E:
won mom won Non
vow
CISCO SYSTEMS, INC. Ex. 1031 Page 4
CISCO SYSTEMS, INC. Ex. 1031 Page 5
US. Patent July 18, 1995 Sheet 5 of 32 Y 5,434,913
F IG . 5 .
100
502 AUDIO/VIDEO DATA CONFERENCING 5 04 CONFERENCING APPN APPLICATION
506'\ CONFERENCING API
5 10 I‘ 5 1 Z 5 1 4
508 in A_, r‘, [J ‘\- VIDEO API coMM API AUDIO API MAvE API
1 5 1 6 ‘L VIDEO coMM AUDIO
MANAGER MANAGER MANAGER 5 24
g 522 518 520 ‘J
‘1 VIDEO CAPTURE NAvE DRIVER DRIVER
5 26, HOST INTERFACE DSP INTERFACE
5 28 530\_ VIDEO BOARD DSP I532
NICROCODE INTERFACE
5 36 5 34 % H
AUDIO HOST DEVICE NAME
5 3 8 f TASK DRIVER TASK
cGNN
TASK 1'5 40
CISCO SYSTEMS, INC. Ex. 1031 Page 6
US. Patent July 18, 1995 Sheet 6 of 32 5,434,913
2e: -H 5c I 22: F mamlm wON
wON ma <2 51:2
3
E8 052 55:5 2.2 v.2 5m 55528.5 552 ,2 52m : _
a E 922
. 5.0m 5%
855
5 .NM
“z: SE8 2%
:85 EU 8:: ~55 5:52 22 :3
a 22:62 as? miss.
5 E:
E: w x
$22 2 \ E2
E2: 25 was: as: 55:5 .52 :2
a 22:62 was: 25$
.@ AIL
CISCO SYSTEMS, INC. Ex. 1031 Page 7
CISCO SYSTEMS, INC. Ex. 1031 Page 8
CISCO SYSTEMS, INC. Ex. 1031 Page 9
US. Patent July 18, 1995 Sheet 9 of 32 5,434,913
\oLummQ
\obcou \SEQBQESW $520k muLaommm 2QoLm>oomLtb ngmbui
A9395
0. .UNK omkqoum.\tgmx IESQ Qocm. \o?cou mmbol Loicoz @Eq?mbé? 3.0339963 .uLbIQb. moLaommt mgoLmioomLcb .WSQQKBM. QQGQQ
CISCO SYSTEMS, INC. Ex. 1031 Page 10
US. Patent July 18, 1995 Sheet 10 of 32 5,434,913
33> ERFMEM. v3 v5» "3% MEQSQK
t3
QB» ESQSQ.
335 §
5e 32§§ CISCO SYSTEMS, INC. Ex. 1031 Page 11
US. Patent July 18, 1995 Sheet 11 of 32 5,434,913
F IG . 1 1 .
5 1 6
1 102
VIDEO MANAGER 1 108 LIBRARY
[nu] \ REcvv
NETW SENDMESSAGE [on] m INTERFACE 1 106
1104 H ‘\- VCAPT VPLAY [EXE] [5x51
m0 Rm 8 I I
1 1 10
xm
Vf'W: VIDEO CAPTURE DRIVER
PLAYBACK (CODEC)
1.522 I
CISCO SYSTEMS, INC. Ex. 1031 Page 12
U.S. Patent July 18, 1995 Sheet 12 of 32 5,434,913
FIG. 12. I1]
CISCO SYSTEMS, INC. Ex. 1031 Page 13
CISCO SYSTEMS, INC. Ex. 1031 Page 14
CISCO SYSTEMS, INC. Ex. 1031 Page 15
CISCO SYSTEMS, INC. Ex. 1031 Page 16
CISCO SYSTEMS, INC. Ex. 1031 Page 17
US. Patent July 18, 1995 Sheet 17 of 32 5,434,913
F IG . 17 .
UPPER LAYERS
HOST (moons) m.o
202 \ LL RDULDLL DULDLL
532 ‘\- DSP INTERFACE
comm (0 cm) 0m com TASKS
mum/com BOARD (Sm) :1 cm DRIVER s CHAN DRIVERS
206
CISCO SYSTEMS, INC. Ex. 1031 Page 18
CISCO SYSTEMS, INC. Ex. 1031 Page 19
US. Patent July 18, 1995 Sheet 19 0f 32 5,434,913
END sass/01v BEG 1N SESSION
REJECT c0/v/v / \\ c0/v/v REJEC TED / \
/
corwv REQUEST
REQUEST CONN I
/ /
CL OSE CONN / /
/ / co/v/v ACCEPTED /
ACCEPT CONN
CONNCTED
REJECT CHAN \ \ \CHAN REJEC r50
\
@ OPEN CL OSE CHAN CHAN 1
ACCEPT // CHAN CHAN , ACCEPTED
-—— ACTIVE REQUEST 0 STATE
“""-' RESULT OF REQUEST
FIG. 19 CISCO SYSTEMS, INC. Ex. 1031 Page 20
CISCO SYSTEMS, INC. Ex. 1031 Page 21
CISCO SYSTEMS, INC. Ex. 1031 Page 22
CISCO SYSTEMS, INC. Ex. 1031 Page 23
CISCO SYSTEMS, INC. Ex. 1031 Page 24
CISCO SYSTEMS, INC. Ex. 1031 Page 25
CISCO SYSTEMS, INC. Ex. 1031 Page 26
CISCO SYSTEMS, INC. Ex. 1031 Page 27
CISCO SYSTEMS, INC. Ex. 1031 Page 28
CISCO SYSTEMS, INC. Ex. 1031 Page 29
CISCO SYSTEMS, INC. Ex. 1031 Page 30
CISCO SYSTEMS, INC. Ex. 1031 Page 31
CISCO SYSTEMS, INC. Ex. 1031 Page 32
CISCO SYSTEMS, INC. Ex. 1031 Page 33
CISCO SYSTEMS, INC. Ex. 1031 Page 34
CISCO SYSTEMS, INC. Ex. 1031 Page 35
CISCO SYSTEMS, INC. Ex. 1031 Page 36
CISCO SYSTEMS, INC. Ex. 1031 Page 37
CISCO SYSTEMS, INC. Ex. 1031 Page 38
CISCO SYSTEMS, INC. Ex. 1031 Page 39
CISCO SYSTEMS, INC. Ex. 1031 Page 40
CISCO SYSTEMS, INC. Ex. 1031 Page 41
CISCO SYSTEMS, INC. Ex. 1031 Page 42
CISCO SYSTEMS, INC. Ex. 1031 Page 43
CISCO SYSTEMS, INC. Ex. 1031 Page 44
CISCO SYSTEMS, INC. Ex. 1031 Page 45
CISCO SYSTEMS, INC. Ex. 1031 Page 46
CISCO SYSTEMS, INC. Ex. 1031 Page 47
CISCO SYSTEMS, INC. Ex. 1031 Page 48
CISCO SYSTEMS, INC. Ex. 1031 Page 49
CISCO SYSTEMS, INC. Ex. 1031 Page 50
CISCO SYSTEMS, INC. Ex. 1031 Page 51
CISCO SYSTEMS, INC. Ex. 1031 Page 52
CISCO SYSTEMS, INC. Ex. 1031 Page 53
CISCO SYSTEMS, INC. Ex. 1031 Page 54
CISCO SYSTEMS, INC. Ex. 1031 Page 55
CISCO SYSTEMS, INC. Ex. 1031 Page 56
CISCO SYSTEMS, INC. Ex. 1031 Page 57
CISCO SYSTEMS, INC. Ex. 1031 Page 58
CISCO SYSTEMS, INC. Ex. 1031 Page 59
CISCO SYSTEMS, INC. Ex. 1031 Page 60
CISCO SYSTEMS, INC. Ex. 1031 Page 61
CISCO SYSTEMS, INC. Ex. 1031 Page 62
CISCO SYSTEMS, INC. Ex. 1031 Page 63
CISCO SYSTEMS, INC. Ex. 1031 Page 64
CISCO SYSTEMS, INC. Ex. 1031 Page 65
CISCO SYSTEMS, INC. Ex. 1031 Page 66
CISCO SYSTEMS, INC. Ex. 1031 Page 67
CISCO SYSTEMS, INC. Ex. 1031 Page 68
CISCO SYSTEMS, INC. Ex. 1031 Page 69
CISCO SYSTEMS, INC. Ex. 1031 Page 70
CISCO SYSTEMS, INC. Ex. 1031 Page 71
CISCO SYSTEMS, INC. Ex. 1031 Page 72
CISCO SYSTEMS, INC. Ex. 1031 Page 73
CISCO SYSTEMS, INC. Ex. 1031 Page 74
CISCO SYSTEMS, INC. Ex. 1031 Page 75
CISCO SYSTEMS, INC. Ex. 1031 Page 76
CISCO SYSTEMS, INC. Ex. 1031 Page 77
CISCO SYSTEMS, INC. Ex. 1031 Page 78
CISCO SYSTEMS, INC. Ex. 1031 Page 79
CISCO SYSTEMS, INC. Ex. 1031 Page 80
CISCO SYSTEMS, INC. Ex. 1031 Page 81
CISCO SYSTEMS, INC. Ex. 1031 Page 82
CISCO SYSTEMS, INC. Ex. 1031 Page 83
CISCO SYSTEMS, INC. Ex. 1031 Page 84
CISCO SYSTEMS, INC. Ex. 1031 Page 85
CISCO SYSTEMS, INC. Ex. 1031 Page 86
CISCO SYSTEMS, INC. Ex. 1031 Page 87
CISCO SYSTEMS, INC. Ex. 1031 Page 88
CISCO SYSTEMS, INC. Ex. 1031 Page 89
CISCO SYSTEMS, INC. Ex. 1031 Page 90
CISCO SYSTEMS, INC. Ex. 1031 Page 91
CISCO SYSTEMS, INC. Ex. 1031 Page 92
CISCO SYSTEMS, INC. Ex. 1031 Page 93
CISCO SYSTEMS, INC. Ex. 1031 Page 94
CISCO SYSTEMS, INC. Ex. 1031 Page 95
CISCO SYSTEMS, INC. Ex. 1031 Page 96
CISCO SYSTEMS, INC. Ex. 1031 Page 97
CISCO SYSTEMS, INC. Ex. 1031 Page 98
CISCO SYSTEMS, INC. Ex. 1031 Page 99
CISCO SYSTEMS, INC. Ex. 1031 Page 100
CISCO SYSTEMS, INC. Ex. 1031 Page 101
CISCO SYSTEMS, INC. Ex. 1031 Page 102
CISCO SYSTEMS, INC. Ex. 1031 Page 103
CISCO SYSTEMS, INC. Ex. 1031 Page 104
CISCO SYSTEMS, INC. Ex. 1031 Page 105
CISCO SYSTEMS, INC. Ex. 1031 Page 106
CISCO SYSTEMS, INC. Ex. 1031 Page 107
CISCO SYSTEMS, INC. Ex. 1031 Page 108
CISCO SYSTEMS, INC. Ex. 1031 Page 109
CISCO SYSTEMS, INC. Ex. 1031 Page 110
CISCO SYSTEMS, INC. Ex. 1031 Page 111
CISCO SYSTEMS, INC. Ex. 1031 Page 112
CISCO SYSTEMS, INC. Ex. 1031 Page 113
CISCO SYSTEMS, INC. Ex. 1031 Page 114
CISCO SYSTEMS, INC. Ex. 1031 Page 115
CISCO SYSTEMS, INC. Ex. 1031 Page 116