close

Вход

Забыли?

вход по аккаунту

?

JP2002209300

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2002209300
[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a
sound image localization apparatus for producing a sound image in any set three-dimensional
direction.
[0002]
2. Description of the Related Art When a human listens to an audio signal (sound signal) such as
a musical tone, he can aurally recognize the position of the sound source. This is based on the
difference in the characteristics of the signals reaching the left and right ears. That is, when the
sound source is at a position shifted from the front of the listener to the left and right, a shift
occurs in the time to reach the left and right ears. Also, the acoustic characteristics (impulse
response) differ between when the sound source is in front of and behind the listener. This is due
to the influence of the skull and earlobe.
[0003]
Conventionally, in order to perform localization control of a three-dimensional sound image,
consider a path where a sound wave from a sound source reaches the human ear (tympanic
membrane), and reflection, diffraction, etc. of a wall called space transfer function (spatial
impulse response) It is necessary to consider the transmission path such as scattering, and the
transmission path such as reflection, diffraction, and resonance by the head and pinna called
head transfer function (head impulse response), and such research is currently It is popular in
10-05-2019
1
the area.
[0004]
A lot of literature has been published for a long time about the theory of using this head transfer
function to localize sound images, and "Spatial sound" by Brawelt, Morimoto, Gotoh et al. There is
also a patent 2873982 (in particular, the item of the prior art).
These documents make the following facts known, and a conventional sound image localization
technique will be described with reference to FIG.
[0005]
FIG. 11 shows an example of the basic principle of the conventional sound image localization
apparatus, and FIGS. 11 (a) and 11 (b) show an example of perceiving a sound image in a real
space, FIG. In the example shown in FIG. 11 (d), an electric information signal is generated by an
electric information signal from an earpiece through an earphone. An example of processing via
an unknown transfer function for localization outside is shown.
[0006]
Generally, it is said that a human being perceives the position of the sound source by binaural
hearing as shown in FIGS. 11 (a) and 11 (b).
Here, a sound wave is emitted from the sound source signal Source (s) through space, and a
space impulse response transfer function up to a small microphone attached to the entrance of
the ear canal or the front of the tympanic membrane as a specific part of the left and right ears
Space (s) Assuming that the transfer function of the speaker is Speaker (s) and the ear canal
impulse response transfer function from the earphone to the small microphone through the ear
canal is Earphone (s) and the sound pressure characteristic of the small microphone is Pressure
(s), the actual sound source Or, from the electrical information signal I (s) of the speaker input,
through the space propagation and the ear canal, the sound pressure characteristic of the small
microphone is Pressure (s) = Space (s) = Space (s) × Source (s) = Space (s) ) × Speaker (s) × I (s)
(Equation 1)
10-05-2019
2
[0007]
On the other hand, the sound pressure level Pressure (s) of the earphone can be expressed by the
unknown transfer function Unknown (s) and the ear canal response response transfer function,
as can be seen from FIG. 4 (d). Pressure (s) = Unknown (S) × Earphone (s) × I (s)... (Equation 2)
(Equation 1) and (Equation 2) in order to obtain an auditory out-of-head sound image localization
that can be heard from the sound source position as if Can be equalized, and Space (s) × Speaker
(s) = Unknown (s) × Earphone (s) (Equation 3) is obtained. Therefore, the unknown transfer
function is Unknown (s), which is known as Unknown (s) = Space (s) × Speaker (s) / Earphone (s)
(Equation 4)
[0008]
From this, a space impulse response transfer function approximating the real sound field impulse
response of the space including the speaker transfer function and an ear canal impulse response
transfer function from the earphone to the small microphone set in the ear canal are measured in
advance and processed. Then, it becomes possible to obtain an unknown transfer function
Unknown (s).
[0009]
Furthermore, if an arbitrary input sound signal is convoluted in real time with this unknown
transfer function Unknown (s), the input sound source can be perceptually localized at any place.
[0010]
As described above, in the sound image localization apparatus described above, the sound image
signal is convoluted with a spatial impulse response, that is, a head impulse response and an
inverse filter for flattening an impulse response at any one point in the ear canal. Can be
reproduced at any one point in the ear canal.
[0011]
However, in the sound image localization apparatus as described above, although the ear canal
transfer function at any one point in the ear canal is flattened, the ear canal transfer function by
inserting an earphone It does not mean that corrections are made on the tympanic membrane.
10-05-2019
3
Therefore, there is a problem that accurate sound image localization using an earphone can not
be performed.
[0012]
The present invention has been made to solve such conventional problems, and it is possible to
obtain a change in the ear canal impulse response at the tympanic membrane position as a result
of wearing the earphone, and correct it to obtain an accurate sound image. It is an object of the
present invention to provide a sound image localization apparatus capable of localization.
[0013]
In order to achieve the above object, a sound image localization apparatus according to the
present invention is a sound image localization apparatus for sound image localization of a sound
source signal to be output to a stereo earphone using at least an ear canal transfer function. The
setting means for setting the direction in which the sound image of the sound source signal is
localized, the head transfer function corresponding to the direction in which the sound image is
set by the setting means, and the stereo earphone are changed by being attached to the outer ear
And sound image localization means for performing sound image localization of the sound source
signal to be output to the stereo earphone based on the correction information of the ear canal
transfer function.
[0014]
With this configuration, sound image localization of the sound source signal to be output to the
stereo earphone can be performed based on the correction information of the ear canal transfer
function that changes when the stereo earphone is attached to the outer ear, so that the stereo
earphone is attached Sound image localization can be performed corresponding to the amount of
change in the ear canal transfer function, and sound source signals that have been accurately
sound image localized can be heard by the stereo earphone.
[0015]
Further, the sound image localization apparatus of the present invention has a configuration for
performing sound image localization of the sound source signal based on the correction
information calculated using a pseudo head.
[0016]
With this configuration, it is possible to easily calculate the amount of change (correction
10-05-2019
4
amount) of the ear canal transfer function that has been changed by wearing the stereo
earphone.
[0017]
Further, in the sound image localization apparatus of the present invention, when the sound
image localization means performs sound image localization of the sound source signal,
regardless of the direction in which the sound image set by the setting means is localized. It has a
configuration using one type of correction information set in advance.
[0018]
With this configuration, when sound image localization is performed in the sound image
localization means, the transfer function in the direction for localization of the sound image set
by the setting means and any direction regardless of the direction for localization of the sound
image Since sound image localization can be performed based on one type of correction
information set in advance, only one type of correction information to be stored can be stored, so
that the memory can be downsized.
[0019]
In the sound image localization apparatus of the present invention, the sound image localization
means performs the sound image localization by convoluting the head transfer function and the
correction information with the sound source signal.
[0020]
With this configuration, sound image localization can be performed by convoluting the headrelated transfer function and the correction information with the sound source signal.
[0021]
A conference apparatus using a sound image localization apparatus according to the present
invention comprises the sound image localization apparatus according to any one of claims 1 to
3, and has a configuration for performing sound image localization of a received acoustic signal
by the sound image localization apparatus. There is.
[0022]
10-05-2019
5
According to this configuration, since the sound image localization of the sound signal received
by the sound image localization apparatus can be controlled, it is possible to listen to the sound
whose sound image is accurately localized by the stereo earphone without using the speaker.
In addition, in the case of reproducing the sound signal by a plurality of speakers, accurate sound
image localization can not be realized unless it is listened to near the center position of the
speakers, but in the case of reproduction by stereo earphones, the listening position is not
limited, Accurate sound image localization can be realized.
Furthermore, since a speaker is not used, an acoustic echo disturbance caused by the signal
output from the speaker being input to the microphone does not occur, so that a comfortable
conference can be performed.
[0023]
A mobile phone using a sound image localization apparatus according to the present invention
includes the sound image localization apparatus according to any one of claims 1 to 3, and has a
configuration for performing sound image localization of received acoustic signals by the sound
image localization apparatus. There is.
[0024]
With this configuration, the sound signal received by the sound image localization apparatus can
be output as a multi-channel sound signal to a stereo earphone as if it were being listened to in a
standard multi-speaker arrangement, so that a sense of reality can be realized with a mobile
phone. You can enjoy some listening.
[0025]
An audio reproducing apparatus using a sound image localization apparatus according to the
present invention comprises a sound image localization apparatus according to any one of claims
1 to 3, signal detection means for detecting at least an acoustic signal and a recording
information signal recorded on a recording medium. The sound image localization apparatus is
configured to perform sound image localization of the acoustic signal read from the recording
medium based on the recording information signal detected by the signal detection unit.
[0026]
10-05-2019
6
With this configuration, the sound image localization of the sound image localization apparatus
can be controlled based on the recording information signal detected by the signal detection
means. Therefore, when the signal detection means detects that the sound signal is a plurality of
channels, the sound image The localization device can output an audio signal to the stereo
earphone as if listening in an appropriate multi-speaker arrangement.
Therefore, it is possible to enjoy realistic listening without limiting the listening position.
[0027]
A sound recording apparatus using a sound image localization apparatus according to the
present invention comprises the sound image localization apparatus according to any one of
claims 1 to 3 and recording means for recording on a recording medium having two channels,
the sound image localization apparatus However, the sound image is localized so that recording
can be performed on the recording medium while holding the sound effect of the input sound
signal.
[0028]
With this configuration, it is possible to record a sound image localized signal on a recording
medium having two channels while holding the sound effect of the input sound signal, so that it
is accurate without additional processing by the sound reproducing apparatus. It is possible to
reproduce a signal subjected to sound image localization.
Further, when processing audio signals of three or more channels, the sound image localization
apparatus can process the signals of two channels, so the recording capacity can be reduced.
[0029]
An information terminal apparatus using the sound image localization apparatus of the present
invention comprises the sound image localization apparatus according to any one of claims 1 to
3, receiving means for receiving data including at least an acoustic signal and localization
information of the acoustic signal; And at least a sound signal recorded on a recording medium
and signal detection means for detecting localization information of the sound signal, wherein
the sound image localization apparatus detects the sound information received by the reception
means and the sound detected by the signal detection means Control of sound image localization
10-05-2019
7
of the acoustic signal is performed based on localization information of either one of the signals.
[0030]
With this configuration, the sound signal received by the sound image localization apparatus and
the sound signal recorded in the recording medium can be controlled to the optimum sound
image localization and output to the stereo earphone, so there is a sense of reality without
limiting the listening position. You can enjoy listening.
[0031]
Further, an information terminal apparatus using the sound image localization apparatus of the
present invention has a configuration provided with operation means for operating the sound
image localization apparatus.
[0032]
With this configuration, the user can control the sound signal input by the operation means to
the desired sound image localization.
[0033]
A game machine using a sound image localization apparatus according to the present invention
comprises a sound image localization apparatus according to any one of claims 1 to 3, signal
detection means for detecting at least an acoustic signal and a recording information signal
recorded on a recording medium; A controller, wherein the sound image localization apparatus
performs sound image localization of the acoustic signal read from the recording medium based
on the recorded information signal detected by the signal detection unit and the operation of the
controller There is.
[0034]
With this configuration, the sound image localization apparatus can control the sound image
localization of the sound signal based on the localization information on the recording medium in
which the game software and the like are recorded and the information that the user operates
the controller. The localization can be output to the stereo earphones, and you can enjoy the
virtual sound space without limiting the listening position
[0035]
A communication and broadcasting system using a sound image localization apparatus according
10-05-2019
8
to the present invention includes the sound image localization apparatus according to any one of
claims 1 to 3, and the sound image localization apparatus is a sound image of an acoustic signal
input by the sound image localization apparatus. While localization is performed, the sound
signal localized by the sound image localization apparatus is transmitted in a predetermined
signal format.
[0036]
With this configuration, it is possible to transmit a sound image localized signal in a
predetermined signal format, and therefore, when receiving the transmitted signal, it is possible
to reproduce a signal subjected to accurate sound image localization without adding processing.
Can.
Further, when processing audio signals of three or more channels, the sound image localization
apparatus can process the signals of two channels, so the recording capacity can be reduced.
[0037]
BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be
described below with reference to the drawings.
[0038]
[First Embodiment] FIGS. 1 to 4 show a sound image localization apparatus according to the
present invention, and a conference apparatus using the sound image localization apparatus, a
portable telephone, an audio reproduction apparatus, an audio recording apparatus, an
information terminal apparatus, a game machine, communication FIG. 1 is a diagram showing a
first embodiment of a broadcast system, and this embodiment is an embodiment of a sound
image localization apparatus.
[0039]
First, the configuration will be described.
[0040]
The sound image localization apparatus 100 shown in FIG. 1 has a sound image direction setting
unit 101 that sets a three-dimensional direction (hereinafter referred to as a sound image
10-05-2019
9
localization direction) where sound image localization is desired, and a sound image in three
dimensions set by the sound image direction setting unit 101. Correction information of external
ear canal impulse response change (hereinafter simply referred to as head impulse response
storage unit 102 for storing the head impulse response for localizing the sound and insertion of
stereo earphones corresponding to the three-dimensional direction set by the sound image
direction setting unit 101) A correction information storage unit 103 for storing correction
information), and a convolution operation unit 104 for inputting a sound source signal and
performing a convolution process of a head impulse response and correction information on the
input sound source signal. The convolution calculation unit 104 is configured to output to a
stereo earphone or stereo headphone including an earplug type and an inner type not shown.
[0041]
The sound image direction setting unit 101 has an operation unit (not shown), and the operator
sets the sound image localization direction in three dimensions, and the head impulse response
storage unit 102 based on the set sound image localization direction. And the correction
information storage 103 is controlled.
[0042]
The head impulse response storage unit 102 stores a plurality of head impulse responses
measured in advance, and performs convolution operation on any head impulse response based
on the sound image localization direction set by the sound image direction setting unit 101. It is
output to the unit 104.
[0043]
In the correction information storage unit 103, correction information of the external ear canal
impulse response change by inserting the earphone obtained for each direction in which the
sound image is to be localized, more specifically, correction values corresponding to respective
sound image localization directions No, the calculation method will be described later, or an
inter-direction average value of the correction value (hereinafter, simply referred to as an interdirection average value) or a representative value (hereinafter, simply referred to as a
representative value) is stored. Similar to the storage unit 102, the correction value, the interdirection average value, and any one of the representative values are output to the convolution
operation unit 104 based on the sound image localization direction set by the sound image
direction setting unit 101. There is.
[0044]
10-05-2019
10
FIG. 2 shows the correction value (Hc) of the change in the ear canal impulse response due to the
insertion of the earphone, which is obtained for each direction in which the sound image is to be
localized.
Although FIG. 2 shows, as an example, the correction value of the ear canal impulse response
change by inserting the earphone when the direction in which the sound image is to be localized
is taken in the horizontal plane, the same configuration is also applied to any three-dimensional
direction. It goes without saying that it is applicable.
FIG. 2 is a correction value (Hc) calculated by a pseudo head described later.
[0045]
Here, the calculation principle of the above-mentioned correction value is demonstrated.
Here, for convenience, however, the description will be made in the frequency domain rather
than the time domain.
[0046]
The sound pressure P1 at the ear drum of the listener of the sound source signal s radiated in the
space r is P1 = S × R × HRTF (ED) = S × R × HRTF (EEC) × H (EC) · · · · (Equation 5) where S:
sound source signal, R: transfer function of room, HRTF (ED): head transfer function observed at
tympanic membrane position, HRTF (EEC): head transfer function observed at entrance of the ear
canal, H (EC): indicates the ear canal transfer function.
[0047]
The sound pressure P2 at the entrance of the listener of the sound source signal s radiated in the
space r at the entrance of the ear canal (Entry of Ear Canal) is P2 = S × R × HRTF (EEC)
(Equation 6) This sound pressure The sound pressure P3 at the eardrum of the listener when P2
is reproduced by the stereo earphone is P3 = P2 × SIP × H (EC_SIP) (Eq. 7) where SIP:
characteristics of the stereo earphone, H (EC_SIP) : Indicates the ear canal transfer function with
the stereo earphones attached.
10-05-2019
11
[0048]
Now, considering the correction value (correction filter) Hc in which the sound pressure at the
eardrum of the listener, that is, the sound pressure P3 becomes equal to the sound pressure P1
when the sound pressure P2 is reproduced by the stereo earphone, From the equation 7), S × R
× HRTF (EEC) × H (EC) = S × R × HRTF (EEC) × SIP × H (EC_SIP) × Hc (Equation 8)
[0049]
Therefore, Hc = H (EC) / {SIP × H (EC_SIP)} (Equation 9)
[0050]
As a result, if the sound pressure P2 is reproduced from the stereo earphone by signal processing
of the correction value Hc, the sound pressure P1 at the eardrum of the listener of the sound
source signal s emitted in the space r can be reproduced.
[0051]
Next, a method of calculating the correction filter Hc using a pseudo head will be shown below.
[0052]
In the calculation of the correction value Hc as described above, it is difficult to measure the ear
canal transfer function H (EC_SIP) with the ear canal transfer function H (EC) and the stereo
earphones attached.
So, in this embodiment, it measures using a false head.
[0053]
In this embodiment, it is desirable that the simulated head performing this measurement is that
the ear canal transfer function is faithfully simulated and that the shape of the pinna is similar to
that of a human. KEMAR (MD Burkhard and RM Sachs, "Anthropometric Manikin for acousric
research," J. Acoust.
10-05-2019
12
Soc.
Am., Vol. 58, No. 1, July 1975).
H (EC) can be determined from HRTF (ED) and HRTF (EEC) using (Equation 10).
H (EC) = HRTF (ED) / HRTF (EEC) (Equation 10)
[0054]
HRTF (ED) is to be measured by using a microphone of a pseudo head placed at the tympanic
membrane position, and HRTF (EEC) is to be measured by installing a microphone at the
entrance of the ear canal of the pseudo head .
In addition, H (EC_SIP) can be obtained by inserting a stereo earphone into the ear canal
entrance of the artificial head, emitting a measurement signal from there, and receiving it with a
microphone installed at the tympanic membrane position .
[0055]
FIG. 2 is an example of the correction value Hc calculated by such a method.
Further, by converting the correction value Hc into the time domain by inverse Fourier transform
or the like, it is possible to obtain a correction value of the ear canal impulse response change
due to the insertion of the earphone.
[0056]
As described above, it is possible to easily obtain the change in the ear canal impulse response at
the eardrum position due to wearing the earphone. By correcting the change as described above,
accurate sound image localization can be achieved. It is possible to do
10-05-2019
13
[0057]
Further, it is understood from FIG. 2 that the incident direction dependency of the correction
value Hc is low.
This can be understood from the fact that the structure of the external auditory canal is a
cylindrical tube having a diameter of about 7 mm and a length of 23 to 27 mm (see "Hearing and
psychoacoustics" Sakahisa Sakai, Tsuyoshi Nakayama, edited by 1978 / Corona Co.).
Therefore, by averaging or representing between incident directions, only one type of correction
value Hc can be used regardless of the sound image localization direction.
The averaging is performed, for example, according to (Expression 11).
FIG. 3 is an example of the correction value Hc averaged by (Expression 11).
Hc = ΣHc (i) (Equation 11) where i represents the incident direction.
[0058]
Measuring the correction value of the change of the ear canal impulse response in all directions
by converting the correction value Hc calculated in this manner or the representative value or
the average value of the correction value Hc into the time domain by inverse Fourier transform
or the like. Instead, the sound image can be localized with a small storage capacity.
[0059]
In the present embodiment, although the listener is a stereo earphone, it goes without saying that
the invention can be applied to a stereo headphone in the same manner.
[0060]
10-05-2019
14
Next, the operation of the sound image localization apparatus in the present embodiment will be
described.
Note that the sound source signal is input to the convolution calculation unit 104.
[0061]
First, when the sound image direction setting unit 101 sets a three-dimensional direction to
which the sound image is desired to be localized according to an instruction from the operator or
the control unit, the sound image direction setting unit 101 detects head impulses corresponding
to the set three-dimensional direction setting. The response is called from the head impulse
response storage unit 102 and output to the convolution operation unit 104.
Further, the sound image direction setting unit 101 calls the correction value, the inter-direction
average value or the representative value corresponding to the set three-dimensional direction
setting from the correction information storage unit 103 and causes the convolution calculation
unit 104 to output it.
[0062]
Next, the convolution operation unit 104 performs convolution operation of the input sound
source signal and correction information of the external ear canal impulse response change due
to the head impulse response and the earphone insertion, and creates a right ear signal and a left
ear signal.
[0063]
Finally, the created right ear signal and left ear signal are output to a stereo earphone (not
shown).
[0064]
As described above, according to the present embodiment, the head impulse response stored in
the head impulse response storage unit 102 and the stereo earphone stored in the correction
information storage unit 103 are changed by being attached to the outer ear It is possible to
perform sound image localization of the sound source signal input based on the correction
10-05-2019
15
information of the change of the ear canal impulse response, so that sound image localization
corresponding to the amount of change of the ear canal transfer function is carried out by
wearing the stereo earphone. It is possible to output a sound source signal whose sound image is
correctly localized to a stereo earphone.
[0065]
Further, in the present embodiment, since the correction value Hc can be calculated using the
pseudo head, it is possible to easily calculate the change in the ear canal impulse response that is
changed by wearing the stereo earphone.
[0066]
Further, in the present embodiment, the correction information of the external ear canal impulse
response change stored in the correction information storage unit 103 uses the representative
value or the average value of the calculated correction value Hc regardless of the direction in
which sound image localization is performed. Since this can be done, the storage capacity of the
correction information storage unit can be reduced.
[0067]
Second Embodiment FIG. 4 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and broadcasting system Is a diagram
showing a second embodiment of the present invention.
[0068]
In this embodiment, the sound image localization apparatus according to the first embodiment is
used in a conference system which is installed in each of a plurality of remote places and
performs a video conference by communicating voice and video through a communication line
such as a telephone public network line. It is an embodiment at the time of applying.
[0069]
First, the configuration will be described.
[0070]
A conference system 200 shown in FIG. 4 includes a conference apparatus 201 that performs
10-05-2019
16
transmission and reception control of a video signal and an audio signal, a stereo earphone 202
that reproduces an audio signal, and a microphone that records sounds such as a speaker's voice
and venue sound. The conference apparatus 201 includes a reception unit 205 that receives a
reception signal including a video signal or an audio signal, and a video that displays the video
signal received by the reception unit 205. A display unit 206, a sound image localization
apparatus 207 for controlling sound image localization of an audio signal received by the
reception unit 205, and a control unit 208 for position control of image display in the image
display unit 206 and setting a sound image localization direction of the sound image localization
apparatus 207. And a transmitting unit 209 for transmitting an audio signal and a video signal
input by the microphone 203 and the camera 204.
[0071]
The receiving unit 205 is connected to the communication line, receives the received signal, and
divides the received signal into a video signal and an audio signal. The divided video signal is
output to the video display unit 206, and the audio is output. A signal is output to the sound
image localization device 207.
[0072]
The video signal divided by the receiving unit 205 is input to the video display unit 206, and the
video display unit 206 is configured to display the input video signal on a display unit (not
shown). There is.
Further, in the video display unit 206, the position of the video displayed on the display unit by
the control unit 208 is controlled.
[0073]
The sound image localization apparatus 207 is configured to receive the sound signal divided by
the receiving unit 205, and the sound image localization apparatus 207 receives the sound image
localization direction set by the control unit 208. The sound image localization of the acoustic
signal is controlled.
Further, the operation of the sound image localization apparatus 207 is configured to perform
10-05-2019
17
the same operation as that of the first embodiment, and the controlled signal is output to the
stereo earphone 202.
[0074]
The control unit 208 is configured to set the position of the image on the image display unit and
the setting of the sound image localization direction based on the operation of the operator in the
operation unit (not shown). The position setting and the set sound image localization are
performed. The image display unit 206 and the sound image localization apparatus 207 are
controlled based on the direction.
[0075]
The transmitting unit 209 is configured to receive an audio signal output from the microphone
203 and a video signal output from the camera 204. The transmitting unit 209 is connected to
the communication line and receives the input audio signal and the audio signal. A video signal is
converted into a transmission signal and output.
[0076]
Next, the reception operation of this embodiment will be described.
[0077]
In this operation, it is assumed that the display position of the video on the video display unit and
the sound image localization direction in which the position of the video and the sound image
localization direction coincide with each other are set in advance.
[0078]
First, when the receiving unit 205 receives a received signal, the receiving unit 205 divides the
received signal into a video signal and an audio signal, and the divided video signal and audio
signal are sent to the video display unit 206 and the sound image localization device 207. Output
each.
[0079]
Next, the video signal output from the reception unit 205 is displayed on the video display unit
206, and the audio signal is input to the sound image localization device 207, and control is
performed so that the sound image is localized in the set three-dimensional direction. Be done.
10-05-2019
18
[0080]
Then, the sound signal controlled by the sound image localization device 207 is reproduced by
the stereo earphone 202.
[0081]
As described above, in the present embodiment, the reception operation is performed, and
usually the conference is performed while wearing the stereo earphone 202, so the voice of the
other party is heard through the stereo earphone 202. It can be done.
[0082]
In the transmission operation, the voice of the speaker is collected by the microphone 203, and
when the video of the speaker is captured by the camera 204, the voice signal and the video
signal are input to the transmission unit 209.
Next, the transmission unit 209 transmits the video signal and the audio signal to the
communication line.
[0083]
As described above, according to the present embodiment, the speaker orientation of the image
displayed on the image display unit 206 under the control of the control unit 208 matches the
sound image localization direction of the sound reproduced by the sound image localization
apparatus 207. So you can have a natural meeting.
[0084]
In addition, in the case of reproducing the sound signal by a plurality of speakers, accurate sound
image localization can not be realized unless it is listened to near the center position of the
speakers, but in the case of reproduction by stereo earphones, the listening position is not
limited, Accurate sound image localization can be realized.
[0085]
Also, in the case of reproduction with a speaker, an acoustic echo is generated when a signal
output from the speaker is input to a sound collection microphone, but when a stereo earphone
10-05-2019
19
is used, an acoustic echo is not generated and a comfortable conference can be performed. .
[0086]
[Third Embodiment] FIG. 5 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and a broadcast system Is a diagram
showing a third embodiment of the present invention.
[0087]
In the present embodiment, the sound image localization apparatus according to the first
embodiment is applied to a mobile phone that receives or reproduces a voice signal received or
stored through a communication line such as a telephone public network line. It is.
[0088]
First, the configuration will be described.
[0089]
The stereo earphone 301 and the microphone 302 are connected to the mobile telephone 300
shown in FIG. 5, and the stereo earphone 301 can listen to the audio received by the mobile
telephone 300, and the microphone 302 can also be used to transmit the mobile telephone The
voice of the operator operating 300 is input and can be transmitted to the communication line.
[0090]
The mobile phone 300 includes a receiving unit 303 that receives a reception signal including an
acoustic signal, a memory 304 that stores the acoustic signal received by the receiving unit 303,
a sound image localization device 305 that controls sound image localization of the sound signal,
A control unit 306 for controlling the output of the unit 303 and the memory 304 to the sound
image localization apparatus 305 and setting the sound image localization direction of the sound
image localization apparatus 305, and a transmission unit 307 for transmitting acoustic signals
output from the microphone 302 .
[0091]
10-05-2019
20
The receiving unit 303 is connected to the communication line, receives a received signal, and
outputs an acoustic signal from the received signal to the memory 304 and the sound image
localization apparatus 305.
Note that this output control is controlled by an instruction of the control unit 306.
[0092]
The sound signal output from the receiving unit 303 is input to the memory 304, and the
memory 304 is configured to store the input sound signal.
Further, the memory 304 is configured to output the accumulated acoustic signal to the sound
image localization device 305 based on an instruction of the control unit 306.
[0093]
The sound image localization apparatus 305 receives an acoustic signal output from the
reception unit 303 or the memory 304. The sound image localization apparatus 305 uses the
sound image localization direction set by the control unit 306. The sound image localization of
the input sound signal is controlled.
In addition, the operation of the sound image localization apparatus 305 is configured to perform
the same operation as that of the first embodiment, and is configured to output a controlled
signal to the stereo earphone 301.
[0094]
For example, in the case of 5.1-ch multi-channel audio signals, the stereo earphones 301 are
controlled so that each audio signal can be heard from each direction of the 5.1-ch standard
multi-speaker arrangement.
[0095]
Also, in the case of stereo sound signals, in order to make the stereo earphones 301 listen in the
10-05-2019
21
middle of the two speakers, control is made so that the L and R signals are heard from the left
and right speaker directions. ing.
[0096]
Furthermore, in a conference application such as three-party talks using the cellular phone 300,
control is performed so that the direction of the speaker in the image acquired by video
communication matches the direction of the sound output by the stereo earphone 301. It has
become.
[0097]
The control unit 306 is configured to perform the output destination of the receiving unit 303,
the calling of the acoustic signal stored in the memory 304, and the setting of the sound image
localization direction based on the operation of the operator in the operation unit (not shown).
The sound image localization apparatus 305 is controlled based on the set sound image
localization direction.
[0098]
The transmitting unit 307 is configured to receive an acoustic signal output from the microphone
302. The transmitting unit 307 is connected to a communication line, converts the input audio
signal into a transmission signal, and outputs the transmission signal. It has become.
[0099]
Next, the reception operation of this embodiment will be described.
[0100]
In this operation, it is assumed that the position setting of the image display and the setting of
the sound image localization direction are performed in advance.
[0101]
First, when a signal such as a voice or stereo sound signal or a multi-channel sound signal such
as 5.1 ch is input to the reception unit 303 as a reception signal, the reception unit 303
determines an output instruction of the control unit 306, The received signal is converted to an
acoustic signal and output to the memory 304 or the sound image localization apparatus 305.
10-05-2019
22
[0102]
When the sound signal is output to the memory 304, the sound signal input to the memory 304
is stored, and the operation ends.
In addition, when output to the sound image localization apparatus 305, the following operation
is performed.
When the acoustic signal stored in the memory 304 is input, the same operation as the following
operation is performed.
[0103]
First, when an acoustic signal output from the receiving unit 303 (or the memory 304) is input to
the sound image localization apparatus 305, the sound image localization apparatus 305
determines the input acoustic signal in the three-dimensional direction set by the control unit
306. Control to localize the sound image.
[0104]
Next, the sound image localization apparatus 305 outputs the sound signal whose sound image
localization is controlled to the stereo earphone 301, and the stereo earphone 301 reproduces
the input sound signal.
[0105]
As described above, the present embodiment is configured to perform the reception operation,
and can listen to the received audio signal or the audio signal stored in the memory 304 or the
voice of the other party via the stereo earphone 301. It has become.
[0106]
In the transmission operation, when the voice of the speaker is picked up by the microphone
302, this voice signal is input to the transmission unit 307.
10-05-2019
23
Next, the transmitting unit 307 transmits the video signal and the audio signal to the
communication line.
[0107]
As described above, according to the present embodiment, the multi-channel music signal
received by the reception unit 303 or stored in the memory 304 is output to the stereo earphone
301 as if it is being listened to by the multi-speaker. Since it is possible, the mobile phone 300
can enjoy music with a sense of reality.
[0108]
[Fourth Embodiment] FIG. 6 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine and a broadcast system It is a figure which shows 4
embodiment.
[0109]
The present embodiment is an embodiment in which the sound image localization apparatus
according to the first embodiment is applied to an audio reproduction apparatus (audio player)
such as a CD player.
[0110]
First, the configuration will be described.
[0111]
A video display device 401 for displaying a video signal and a stereo earphone 402 for playing
back an audio signal are connected to the audio playback device 400 shown in FIG. 6, and audio
signals and channels are recorded from a recording medium (not shown) such as CD or DVD.
Controlling the sound image localization device 404 based on the recording information detected
by the signal detection unit 403 that detects the recording information such as the number, the
sound image localization device 404 that controls the sound image localization of the input
acoustic signal, And a control unit 405.
[0112]
10-05-2019
24
The signal detection unit 403 detects recording information such as the number of channels of
audio signals of a single channel or a plurality of channels, video signals, and audio signals
recorded on the recording medium from a recording medium such as a CD or a DVD. There is.
Further, the signal detection unit 403 outputs the detected video signal to the video display unit
401, information such as the number of channels of the audio signal as the recording
information signal to the control unit 405, and outputs the audio signal to the sound image
localization device 404. It has become
[0113]
An acoustic signal output from the signal detection unit 403 is input to the sound image
localization apparatus 404. The sound image localization apparatus 404 is input based on the
sound image localization direction set by the control unit 405. The sound image localization of
the acoustic signal is controlled.
In addition, the operation of the sound image localization apparatus 404 is configured to perform
the same operation as that of the first embodiment, and output a controlled signal to the stereo
earphone 402.
[0114]
For example, in the case of two-channel sound signals, the sound image localization apparatus
404 sets the sound image localization direction as when listening to the center of the speakers
disposed on the left and right by the stereo earphone 402.
[0115]
Also, in the case of a 5-channel signal and a 6-channel acoustic signal such as a woofer signal,
when three speakers and a woofer speaker are disposed forward by the stereo earphone 402 and
two speakers are disposed rearward, and listening is performed at the center Set the sound image
localization direction as shown in.
[0116]
In the case of one-channel or two-channel audio signals, the control unit 405 controls to create a
10-05-2019
25
pseudo stereo signal or a pseudo surround signal, thereby reproducing multi-channel signals and
using the stereo earphone 402. It may be possible to listen as in the above-described multichannel and stereo.
[0117]
The control unit 405 determines an optimal sound source reproduction direction (sound image
localization direction) based on the input recording information signal, and controls the sound
image localization device 404 based on the determined sound image localization direction. There
is.
[0118]
Next, the reproduction operation of the present embodiment will be described.
[0119]
First, when an operator inserts an arbitrary recording medium into a reproduction unit (not
shown) and reproduction of the recording medium is started, the signal detection unit 403
detects an audio signal, a video signal, and recording information.
[0120]
Next, the video signal detected by the signal detection unit 403 is output to the video display unit
401 and displayed, and the detected recording information signal is input to the control unit
405.
Further, the acoustic signal detected by the signal detection unit 403 is output to the sound
image localization device 404.
[0121]
Next, the control unit 405 determines the sound image localization direction optimum for the
recorded sound signal from the input recording information signal, and sets the sound image
localization direction in the sound image localization apparatus 404.
[0122]
10-05-2019
26
Next, the sound image localization apparatus 404 controls the sound signal detected by the
signal detection unit 403 to be localized in the direction set by the control unit 405 for each
signal of each channel.
[0123]
Next, the sound image localization device 404 outputs an acoustic signal whose sound image
localization has been controlled to the stereo earphone 402, and the stereo earphone 402
reproduces the input acoustic signal.
[0124]
As described above, according to the present embodiment, the sound image localization direction
of the control unit 405 can be set by the recording information signal detected by the signal
detection unit 403, and the sound image localization device 404 can be Since sound image
localization can be controlled, when the signal detection unit 403 detects that it is an audio
signal of a plurality of channels, it is possible to use stereo earphones as if listening with an
appropriate multi-speaker arrangement by the sound image localization device 404. It can be
output.
Therefore, it is possible to enjoy realistic listening without limiting the listening position.
Also, even when listening to music or the like while carrying a small audio player, realistic
playback can be performed.
[0125]
[Fifth Embodiment] FIG. 7 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and broadcasting system 5 is a diagram
showing a fifth embodiment of the present invention.
[0126]
The present embodiment is an embodiment in the case where the sound image localization
apparatus in the first embodiment is applied to a sound recording apparatus (audio recorder).
10-05-2019
27
[0127]
First, the configuration will be described.
[0128]
A sound image localization apparatus 500 shown in FIG. 7 includes a sound image localization
apparatus 501 that controls sound image localization of an input sound signal, and a recording
medium such as a CD, a DVD, or a hard disk that stores sound signals whose sound image
localization is controlled A recording unit 503 for recording in 502 and a control unit 504 for
controlling the sound image localization direction of the sound image localization apparatus 501
are provided.
[0129]
The sound image localization apparatus 501 is configured such that an acoustic signal is input
from the outside, and the sound image localization apparatus 501 generates a sound image of
the input acoustic signal based on the sound image localization direction set by the control unit
504. It is designed to control the localization.
Further, the operation of the sound image localization apparatus 501 is configured to perform
the same operation as that of the first embodiment, and output a controlled signal to the
recording unit 503.
[0130]
For example, when a multi-channel signal is input, the sound image localization direction is set so
that the user can listen in the center of the optimal speaker arrangement when listening to the
signal.
[0131]
The sound image localization apparatus 501 is configured to generate signals of two channels
and to output the signals of two channels to the recording unit 503.
[0132]
10-05-2019
28
The control unit 504 controls the sound image localization apparatus 501 based on an
instruction of the operator in the operation unit (not shown), and in particular, sets the sound
image localization direction of the sound signal input to the sound image localization apparatus
501. It has become.
[0133]
Next, the recording operation of the present embodiment will be described.
[0134]
In this operation, it is assumed that the setting of the sound image localization direction is
performed.
[0135]
First, when an audio signal is input to the audio image localization apparatus 501, the audio
image localization apparatus 501 controls the audio image localization direction of the input
audio signal in accordance with the audio image localization direction of each channel set by the
control unit 504.
[0136]
Next, the sound image localization apparatus 501 outputs the sound signal whose sound image is
localized to the recording unit 503, and then the recording unit 503 writes the sound signal on
the recording medium 502.
[0137]
As described above, according to this embodiment, the sound signal input by the sound image
localization apparatus 501 can be sound image localized, and the sound image localized signal
can be recorded on the recording medium 502 in two channels. Therefore, recording can be
performed on the two-channel recording medium 502 while holding the acoustic effect
generated by multiple channels or the like.
Therefore, it is possible to reproduce a signal subjected to accurate sound image localization
without adding processing by a sound reproduction device (not shown).
10-05-2019
29
[0138]
Further, when processing audio signals of three or more channels, the sound image localization
apparatus 501 can process the signals of two channels, so the recording capacity can be reduced.
[0139]
Sixth Embodiment FIG. 8 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and a broadcast system. It is a figure
which shows 6th Embodiment of a sound image localization apparatus of this.
[0140]
In addition, this embodiment is an embodiment at the time of applying the sound image
localization apparatus in 1st Embodiment to information terminal devices, such as a personal
computer or a portable terminal device.
[0141]
First, the configuration will be described.
[0142]
An information terminal device 600 shown in FIG. 8 is connected to a communication line such
as the Internet, and receives a reception signal including localization information such as the
number of channels of video signals, audio signals and audio signals, CD, DVD, A signal detection
unit 603 for detecting localization information such as an acoustic signal and the number of
channels of the audio signal from a recording medium 602 such as a hard disk or a memory, a
video signal received by the reception unit 601 and a video signal detected by the signal
detection unit 603 A sound image localization apparatus 605 for controlling the sound image
localization direction of the sound signal received by the reception unit 601 and the sound signal
detected by the signal detection unit 603; localization information received by the reception unit
601 and a signal detection unit Control unit 607 for controlling the sound image localization
apparatus based on the localization information detected by 603 or based on an instruction input
by the keyboard 606; 605 sound image localization in the stereo earphones 608 connected to is
adapted to output a control signal.
10-05-2019
30
[0143]
The receiving unit 601 is connected to the communication line, receives the received signal, and
divides the received signal into a video signal and an audio signal, and outputs the divided video
signal to the video display unit 604, and outputs the audio signal. A signal is output to the sound
image localization apparatus 605, and localization information is output to the control unit 607.
[0144]
The signal detection unit 603 detects localization information such as the number of channels of
an audio signal recorded on a single channel or a plurality of channels and a video signal
recorded on a recording medium 602 such as a CD, a DVD, a hard disk or a memory. It is
supposed to be.
Further, the signal detection unit 603 outputs the detected video signal to the video display unit
604, the acoustic signal to the sound image localization apparatus 605, and the localization
information to the control unit 607 as a recording information signal.
[0145]
A video signal output from the receiving unit 601 is input to the video display unit 604. The
video display unit 604 displays the input video signal on a display unit (not shown). There is.
[0146]
The sound image localization apparatus 605 is configured to receive an acoustic signal output
from the reception unit 601. The sound image localization apparatus 605 receives the sound
image localization direction set by the control unit 607. The sound image localization of the
acoustic signal is controlled.
Further, the operation of the sound image localization apparatus 605 is configured to perform
the same operation as in the first embodiment, and the controlled signal is output to the stereo
earphone 608.
[0147]
10-05-2019
31
The localization information output from the reception unit 601 and the localization information
detected by the signal detection unit 603 are input to the control unit 607, and the control unit
607 is configured to input the localization information. The sound image localization direction of
the sound image localization apparatus 605 is set.
[0148]
Next, the reception operation of this embodiment will be described.
[0149]
First, when a received signal including audio information, video information or other information
is input to the receiving unit 601 via the Internet or the like, the receiving unit 601 divides the
signal into an audio signal, an image signal, and a localization information signal. Output to the
image display unit 604, the sound image localization apparatus 605, and the control unit 607.
[0150]
Next, the video display unit 604 displays the input video signal, and the control unit 607
calculates the optimal sound image localization direction based on the input localization
information and sets the sound image localization direction of the sound image localization
apparatus 605 Do.
[0151]
Next, the sound image localization apparatus 605 controls the sound image localization of the
sound signal input based on the sound image localization direction set by the control unit 607,
and outputs the sound image to the stereo earphone 608, and the stereo earphone 608 Play the
signal.
[0152]
Next, the reproduction operation of the information recorded on the recording medium will be
described.
[0153]
First, when the signal detection unit 603 detects the information recorded in the recording
medium 602, the signal detection unit 603 sets the information as an audio signal, an image
signal, and a localization information signal, and the respective image display units 604 and the
sound image localization device And 605 and output to the control unit 607.
10-05-2019
32
[0154]
Next, the video display unit 604 displays the input video signal, and the control unit 607
calculates the optimal sound image localization direction based on the input localization
information and sets the sound image localization direction of the sound image localization
apparatus 605 Do.
[0155]
Next, the sound image localization apparatus 605 controls the sound image localization of the
sound signal input based on the sound image localization direction set by the control unit 607,
and outputs the sound image to the stereo earphone 608, and the stereo earphone 608 Play the
signal.
[0156]
The control unit 607 is connected to the keyboard 606, and the user can set a desired sound
image localization direction via the keyboard 606.
[0157]
As described above, according to the present embodiment, the sound image localization of the
sound signal received by the receiving unit 601 by the sound image localization apparatus 605
and the sound signal recorded in the recording medium 602 is controlled based on the respective
localization information. As a result, the stereo earphone 608 can perform optimum listening
according to a signal obtained through the Internet or the like or recorded in the recording
medium 602, and realistic reproduction can be performed regardless of the listening position. .
In addition, the user can use the keyboard 606 to perform sound image localization as desired.
[0158]
Seventh Embodiment FIG. 9 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and broadcasting system Is a diagram
showing a seventh embodiment of the present invention.
10-05-2019
33
[0159]
The present embodiment is an embodiment in the case where the sound image localization
apparatus in the first embodiment is applied to a game device.
[0160]
First, the configuration will be described.
[0161]
The game device 700 shown in FIG. 9 includes a signal detection unit 702 for detecting
localization information such as acoustic signals and the number of channels from a recording
medium 701 such as a CD, a DVD, a memory or a hard disk, and a video signal detected by the
signal detection unit 702. Based on the image display unit 703 to be displayed, the sound image
localization apparatus 704 for controlling the sound image localization direction of the sound
signal detected by the signal detection unit 702, and the localization information detected by the
signal detection unit 702, or And a control unit 706 for setting the sound image localization
direction of the sound image localization apparatus 704 based on the instruction, and outputting
an acoustic signal whose sound image localization is controlled to the stereo earphone 707
connected to the sound image localization apparatus. .
[0162]
The signal detection unit 702 detects localization information such as the number of channels of
an audio signal recorded on a single channel or a plurality of channels and a video signal
recorded on a recording medium 701 such as a CD, a DVD, a hard disk, or a memory. It is
supposed to be.
Further, the signal detection unit 702 outputs the detected video signal to the video display unit
703, the sound signal to the sound image localization apparatus 704, and the localization
information to the control unit 706 as a localization information signal.
[0163]
A video signal detected by the signal detection unit 702 is input to the video display unit 703,
and the video display unit 702 is configured to display the input video signal.
10-05-2019
34
[0164]
The sound image localization apparatus 704 is configured to receive the sound signal detected
by the signal detection unit 702, and the sound image localization apparatus 704 is input based
on the sound image localization direction set by the control unit 706. The sound image
localization of the acoustic signal is controlled.
Further, the operation of the sound image localization apparatus 704 is configured to perform
the same operation as that of the first embodiment, and output a controlled signal to the stereo
earphone 707.
[0165]
The localization information detected by the signal detection unit 702 is input to the control unit
706, and the control unit 706 sets the sound image localization direction of the sound image
localization apparatus 704 based on the input localization information. It is supposed to
In addition, a controller 705 having a plurality of buttons and keys is connected to the control
unit 706, and when the user performs an operation of pressing the determination button or
direction key by the controller 705, a signal indicating the operation is It is to be notified at 706.
[0166]
Next, the reproduction operation of the present embodiment will be described.
[0167]
First, when the signal detection unit 702 detects the information recorded in the recording
medium 701, the signal detection unit 702 sets the information as an audio signal, an image
signal, and a localization information signal. , And the sound image localization device 704 and
the control unit 706.
[0168]
10-05-2019
35
Next, the video display unit 703 displays the input video signal.
[0169]
On the other hand, when the operator operates a button of the controller 705, this operation
information is output to the control unit 706.
[0170]
Next, the control unit 706 calculates an optimal sound image localization direction based on the
input localization information and the operation information from the controller 705, and sets
the sound image localization direction of the sound image localization apparatus 704.
[0171]
Next, the sound image localization device 704 performs signal processing so as to cause sound
image localization based on the sound image localization direction set by the control unit 706
and outputs the signal to the stereo earphone 707, and the stereo earphone 707 reproduces the
input sound signal. Do.
[0172]
As described above, according to the present embodiment, the sound image can be localized in a
three-dimensional direction based on the localization information on the recording medium on
which the game software is recorded or the information that the user operates the controller.
Since a sound signal obtained by localizing the sound image can be output to the stereo earphone
707, sound image localization is accurately performed as intended by the software developer,
regardless of the listening position such as listening at the center of the speaker. With the stereo
earphones 707, a virtual sound space can be enjoyed.
[0173]
Eighth Embodiment FIG. 10 shows a sound image localization apparatus according to the present
invention, and a conference apparatus using the sound image localization apparatus, a portable
telephone, an audio reproduction apparatus, an audio recording apparatus, an information
terminal apparatus, a game machine, a communication and broadcasting system Embodiment of
the present invention.
[0174]
The present embodiment is an embodiment in which the sound image localization apparatus
10-05-2019
36
according to the first embodiment is applied to a broadcasting system that performs TV
broadcasting on the ground wave, satellite broadcasting, radio broadcasting, and music
distribution using a network.
[0175]
First, the configuration will be described.
[0176]
In a broadcast system 800 shown in FIG. 10, video signals and audio signals are input, and
encoders 801 and 802 for compressing each input signal and encoding them into a
predetermined format, and sound image localization directions of the input audio signals A sound
image localization apparatus 803 for controlling, a control unit 804 for setting a sound image
localization direction of the sound image localization apparatus 803, and a transmission unit 805
for transmitting data encoded into a predetermined format by each of the encoders 801 and 802;
TV distribution, satellite broadcasting, radio broadcasting, and music distribution using a
network.
[0177]
A video signal is input to the video encoder 801 from the outside, and the video encoder 801
encodes the input video signal into a predetermined format and compresses an amount of data.
There is.
Further, the video encoder 801 is configured to output the encoded data to the transmission unit
805.
[0178]
The sound encoder 802 receives a signal whose sound image localization direction is controlled
by the sound image localization device 803. The sound encoder 802 encodes the input sound
signal into a predetermined format. And to compress the amount of data.
Further, the acoustic encoder 802 is configured to output the encoded data to the transmission
10-05-2019
37
unit 805.
[0179]
Note that the video encoder 801 and the acoustic encoder 802 may not compress the data
amount.
[0180]
The sound image localization apparatus 803 receives an external acoustic signal, and the sound
image localization apparatus 803 performs sound image localization of the input sound signal
based on the sound image localization direction set by the control unit 804. It is supposed to
control.
In addition, the operation of the sound image localization apparatus 803 is configured to perform
the same operation as that of the first embodiment, and output a controlled signal to the acoustic
encoder 802.
[0181]
The control unit 804 sets the sound image localization direction based on the operation of the
operator in the operation unit (not shown), and controls the sound image localization apparatus
803 based on the set sound image localization direction. ing.
[0182]
For example, for a multi-channel signal, the control unit 804 sets the sound image direction as
when listening to a sound at the center of the speaker arrangement that is optimal for listening
to the signal.
[0183]
The transmitting unit 805 is configured to receive each data encoded by each of the encoders
801 and 802. The transmitting unit 805 is input via, for example, a network such as the Internet,
radio waves, a telephone line, etc. Video and audio data are transmitted to the outside.
[0184]
10-05-2019
38
As described above, according to the present embodiment, the signal whose sound image has
been localized by the transmission unit 805 can be transmitted in a predetermined signal format,
so that no additional processing is added when the transmitted signal is received. It is also
possible to reproduce a signal subjected to accurate sound image localization.
Further, when processing audio signals of three or more channels, the sound image localization
apparatus can process the signals of two channels, so the recording capacity can be reduced.
[0185]
The sound image localization apparatus of the present invention can perform sound image
localization of the sound source signal to be output to the stereo earphone based on the
correction information of the ear canal transfer function which changes when the stereo
earphone is attached to the outer ear. By mounting the stereo earphone, sound image localization
can be performed corresponding to the change amount of the ear canal transfer function, and the
sound source signal whose sound image is correctly localized can be listened to by the stereo
earphone.
10-05-2019
39
Документ
Категория
Без категории
Просмотров
0
Размер файла
54 Кб
Теги
jp2002209300
1/--страниц
Пожаловаться на содержимое документа