close

Вход

Забыли?

вход по аккаунту

?

JP2010154549

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2010154549
PROBLEM TO BE SOLVED: To reproduce a sound field in a measurement environment in an
environment different from the measurement environment based on transfer functions
corresponding to each of a plurality of positions on the first closed surface measured in the
measurement environment. It enables adjustment of sound quality such as reverberation and
sound localization. SOLUTION: With respect to a normal transfer function based on measurement
results by the directional measurement microphones arranged at the plurality of positions,
another transfer function determined corresponding to each of the plurality of positions is
indicated as well. The reproduction signal is convoluted with a synthetic transfer function
generated by adding together at a ratio to generate a reproduction signal corresponding to each
of the plurality of positions. This makes it possible to adjust the sound quality such as
reverberation and sound localization. [Selected figure] Figure 11
Sound signal processing method, sound field reproduction system
[0001]
The present invention relates to an audio signal processing method suitable for reproducing the
sound field of one environment in another environment. A sound comprising: a recording device
for recording information on a recording medium; and an audio signal processing device for
generating a reproduction audio signal for performing sound field reproduction based on the
information recorded on the recording medium. It relates to the field reproduction system.
[0002]
09-05-2019
1
JP 2002-186100 A
[0003]
For example, in the case of viewing content such as a movie or music, reverberation is added in
order to give a sense of reality to reproduced sound.
A so-called digital reverb method is known as the reverberation addition processing. This digital
reverb method generates a lot of delay information that is considered to be a random delay time
to the original sound, and further reduces the volume as the delay time becomes longer, applies
feedback at a location where the delay time is long, and reverberation time It performs signal
processing such as taking a long time. Thereby, it is possible to artificially generate a
reverberation effect on the original sound. However, since the parameters for generating the
delay information are set based on the aural feeling of the operator who sets the parameters, this
setting operation becomes complicated. In addition, there is no concept of localizing the original
sound because the reverberation is artificially generated, and the reproduction of the sound field
is not excellent.
[0004]
On the other hand, for example, the technique described in Patent Document 1 is known as a
method for actually measuring impulse response in a sound field space and obtaining a
reverberation effect based on spatial information such as localization of a sound source. There is.
In the technology described in Patent Document 1, for example, as shown in FIG. 1, a speaker 3
for measurement is disposed as a sound source in a measurement environment (measurement
sound field) 1 such as a hole. Then, an audio signal for impulse response measurement such as a
TSP (Time Stretched Pulse) signal is supplied to this measurement speaker 3, and the plural
measurement microphones 4a to 4p arranged at the required positions in the same sound field
are supplied. And the measurement sound output from the measurement speaker 3 is input. In
this case, for example, in the measurement microphone 4a, as shown by the arrow in FIG. 1, the
direct sound from the measurement speaker 3 and the reflected sound output from the
measurement speaker 3 and reflected in the hole as a measurement environment Can be
detected. Although illustration is omitted, the same applies to the other measurement
microphones 4b, 4c, 4d,. Therefore, based on the audio signals detected by the measurement
microphones 4a to 4p, the transfer function corresponding to each of the measurement speakers
3 to the measurement microphones 4 is obtained by measuring the impulse response including
09-05-2019
2
reverberation. Can.
[0005]
If such a transfer function is used, for example, as shown in FIG. 3, in the environment where the
speakers 8 a to 8 p are arranged in the same positional relationship as each measuring
microphone 4 in FIG. Sound field can be reproduced. That is, when the transfer functions
corresponding to the respective arrangement positions of the measurement microphones 4 are
obtained as described above, the audio signals to be reproduced are respectively convoluted
using these transfer functions, whereby the arrangement of the speakers 8 is obtained. An audio
signal to be output can be obtained from the position. Therefore, by outputting the audio signals
from the speakers 8 arranged at corresponding positions, it is possible to obtain the same
reverberation effect as the measurement environment of FIG. 1 in the space surrounded by the
speakers 8. Such a method uses the transfer function actually measured, and therefore is
excellent in the reproducibility of the sound field at the time of reproduction. At the same time, it
also becomes clearer as sound image localization in the reproduction sound field.
[0006]
The important thing at this time is that the measurement microphones 4a to 4p in the
measurement environment of FIG. 1 and the speakers 8a to 8p in the reproduction environment
of FIG. 3 are arranged in a geometrically equivalent positional relationship. is there. By doing
this, the localization (sound image localization) of the sound source of the measurement sound
field is clearly reproduced in the area (closed surface) surrounded by the speakers 8 in the
reproduction environment, and the sound field of the measurement environment Can be clearly
reproduced.
[0007]
Thus, according to the method described in Patent Document 1 above, by performing sound
reproduction based on actual voice measurement results in a measurement environment such as
a hole, in a space different from the measurement environment, in the measurement environment
It can give a unique sense of reverberation and a sense of localization of a virtual sound image.
[0008]
09-05-2019
3
By the way, as an audio reproduction system, by being able to adjust reproduction sound to a
user's favorite sound quality, it can be considered as a more convenient system.
For example, some conventional audio reproduction systems have been configured to be able to
enhance the bass or to adjust the sound quality according to the genre of the music to be
reproduced (such as rock or jazz), and the user prefers the desired sound quality. There are some
that have been made to be able to enjoy the music. In view of this, the system for reproducing the
sound field as described above can also adjust, for example, the above-mentioned reverberation
and the localization of the sound image as such sound quality adjustment, User-friendliness can
be improved, and its realization is required.
[0009]
Therefore, in the present invention, in view of the above problems, the following method is used
as an audio signal processing method. A first sound generation step of generating a sound by a
directional speaker from a virtual sound image position outside the first closed surface, and a
directional microphone arranged outward at a plurality of positions on the first closed surface
Based on the result of measuring the sound produced in the first sound generation step, the
directivity as a transfer function corresponding to each of the plurality of positions on the first
closed curved surface from the virtual sound image position A directional measurement transfer
function generating step for generating a measurement transfer function group, the directional
measurement transfer function group, and the directional measurement transfer function group
separately from the virtual sound image position separately from the directional sound transfer
function group From the virtual sound image position, the auxiliary transfer function group
obtained based on the voice reaching each of the plurality of positions on the curved surface is
added at a designated ratio. A first transfer function generating step of generating a first transfer
function group as a synthetic transfer function group corresponding to each of the number
positions, and for the input speech signal, based on the first transfer function group A process of
generating a first reproduction audio signal for obtaining a first reproduction audio signal
corresponding to each of the plurality of positions on the first closed curved surface by
performing arithmetic processing, and enclosing a required sound source Recording a voice from
the sound source with a directional microphone from a plurality of directions, and in the first
sounding step, the voice from the sound source is captured in the recording step by the
directional speaker The voice is generated in a plurality of directions opposite to the plurality of
recorded directions, and in the directional measurement transfer function generating step, the
voice is generated for each of the plurality of directions produced by the directional speaker. The
directional measurement transfer function group is generated for each of the plurality of
09-05-2019
4
directions based on the measurement result, and in the first transfer function generation step, the
plurality of directions generated by the directional measurement transfer function generation
step The first transfer function group for each of the plurality of directions is generated by
adding the auxiliary transfer function group at a designated ratio for each of the directional
measurement transfer function groups of each In the audio signal generation step, the plurality
of positions on the first closed curved surface are subjected to arithmetic processing based on
the first transfer function group in the respective directions corresponding to the audio signals
recorded in the recording step. The reproduction audio signal corresponding to each of the
plurality of directions is obtained as the reproduction audio signal corresponding to each of the
plurality of directions, and the reproduction audio signal is generated for each of the plurality of
positions on the first closed surface. By adding together, the first reproduction audio signal is
obtained.
[0010]
The present invention also includes a recording device for recording information on a recording
medium, and an audio signal processing device for generating a reproduction audio signal for
performing sound field reproduction based on the information recorded on the recording
medium. The sound field reproduction system configured, wherein the recording device is
disposed outward at a plurality of positions on the first closed surface, sounds generated from a
virtual sound image position outside the first closed surface. A directional measurement transfer
function group corresponding to each of the plurality of positions on the first closed curved
surface from the virtual sound image position generated based on the result of measurement by
the directional microphone, and a required sound source The audio signal processing apparatus
further comprises: recording means for recording the recorded audio signal recorded on the
recording medium; The plurality of positions on the first closed surface are generated from the
virtual sound image position separately from input means for inputting a voice signal, the
directional measurement transfer function group, and the directional measurement transfer
function group. The auxiliary transfer function group obtained based on the voice reaching each
of the above is summed at the indicated ratio to obtain a synthetic transfer function group
corresponding to the virtual sound image position to each of the plurality of positions. First
transfer function generation means for generating a first transfer function group as the first
group, and arithmetic processing based on the first transfer function group on the input audio
signal, And a first reproduction audio signal generation unit for obtaining a first reproduction
audio signal corresponding to each of the plurality of positions, in the recording apparatus, the
recording unit is configured to generate the virtual signal with respect to the recording medium.
Sound image A non-directional measurement transfer function group generated based on a result
of measurement of the sound produced from the position by the non-directional microphone
disposed outward at the plurality of positions; The input means is further configured to input the
nondirectional measurement transfer function group recorded in the recording medium, and the
first transfer function generation means is configured to individually receive the directional
09-05-2019
5
measurement transfer function group. From the virtual sound image position for the audio
reaching each of the plurality of positions on the first closed curved surface, for each of the
plurality of positions of the audio delay time and the audio level. The information is extracted,
and the information on the audio delay time and the audio level and the nondirectional
measurement transfer function group inputted by the input means are used as the auxiliary
transfer function. The first transfer function group is configured to be generated by adding
together at a designated ratio to the directional measurement transfer function group.
[0011]
As described above, according to the present invention, when the sound field in one environment
is reproduced in another environment, it is possible to adjust the sound quality of the
reproduction sound field, and the user's convenience is improved in this respect. Can be
[0012]
It is a schematic diagram for demonstrating a measurement environment.
FIG. 2 is a block diagram showing a basic configuration of a reproduction system of reproduced
speech in a reproduction environment.
It is a schematic diagram for demonstrating a reproduction environment. It is the figure which
showed typically the mode for the measurement in the measurement environment in, when
reproducing a several virtual sound image position. FIG. 6 is a diagram showing a configuration
of a reproduced signal generation device corresponding to a case where a plurality of virtual
sound image positions are reproduced. FIG. 7 is a diagram schematically showing a reproduction
environment in the case of reproducing a plurality of virtual sound image positions. It is the
figure which showed typically the mode of the measurement in the measurement environment in,
when performing the sound field reproduction in a 2nd closed surface. It is the block diagram
which showed the structure of the reproduction signal production | generation apparatus in,
when performing sound field reproduction | regeneration with a 2nd closed surface. It is a figure
explaining the reverberation sound field at the time of making the inside of a 2nd closed curve
into a listening position in a reproduction environment, and sound image localization. It is the
figure which showed typically the mode of the measurement in the measurement environment in,
when performing sound quality adjustment using a nondirectional measurement transfer
function as sound field reproduction as embodiment. FIG. 6 is a block diagram showing a
configuration of a sound quality adjustment system in the case of performing sound quality
09-05-2019
6
adjustment using a nondirectional measurement transfer function as sound field reproduction as
an embodiment. It is the block diagram shown about the composition of the reproduction signal
generation device in the case of performing sound quality adjustment using a nondirectional
measurement transfer function as sound field reproduction as an embodiment. It is a figure for
demonstrating the information of the audio | voice delay time and audio | voice level extracted
from a directivity measurement transfer function. It is a figure for demonstrating the method to
extract information of audio | voice delay time and audio | voice level from a directivity
measurement transfer function. It is the block diagram shown about the composition of the
adjustment system in the case of performing sound quality adjustment using the information on
audio delay time and audio level as sound field reproduction as an embodiment. It is a figure for
demonstrating the image of sound quality adjustment. It is a figure for demonstrating an example
of sound quality adjustment. It is the figure which showed typically the mode of the
measurement of a directional measurement transfer function as a mode of the measurement in
the measurement environment in, when reproducing a specific directivity direction. It is the
figure which showed typically the mode of the measurement of a nondirectional measurement
transfer function as a mode of the measurement in the measurement environment in, when
reproducing a specific directivity direction. It is a schematic diagram for demonstrating the
method to reproduce a specific directivity direction in a reproduction | regeneration
environment. It is the figure which showed typically the mode of the measurement in the
measurement environment in the case of simulating a performance type. It is a block diagram
shown about composition of a reproduction signal generation device corresponding to a case of
performing a performance style simulation. It is a data structure figure showing the data
structure example of the Direction and transfer function correspondence information about a
directional measurement transfer function.
It is a data structure figure which shows the data structure example of the Direction and transfer
function corresponding | compatible information about a nondirectional measurement transfer
function. FIG. 6 is a view schematically showing a measurement environment in the case of
reproducing two sound sources of Rch and Lch at one virtual sound image position. It is a block
diagram shown about composition of a reproduction signal generation device corresponding to a
case where two sound sources of Rch and Lch are reproduced for one virtual sound image
position. It is a figure for demonstrating the recording method of the sound source in the case of
performing sound field reproduction which considered the directivity of a sound source, and the
sound emission characteristic for every directivity direction. It is a block diagram shown about
composition of a reproduction signal generation device corresponding to a case of performing
sound field reproduction in consideration of directivity of a sound source and sound emission
characteristics for each directivity direction. It is a figure for demonstrating the method to
surround sound source three-dimensionally and to record audio | voices. It is the figure which
showed typically the mode of the measurement in measurement environment in, when
performing sound field reproduction corresponding to, when carrying out sound recording by
09-05-2019
7
three-dimensionally surrounding a sound source. It is the figure which showed typically the
mode of ambience recording in a measurement environment. It is a block diagram shown about
composition of a reproduction signal generation device corresponding to a case where sound
field reproduction is performed using ambience. It is a figure for demonstrating the measurement
method in the measurement environment in, when performing sound field reproduction
according to a camera angle. It is the figure shown about the operation process which should be
performed by the production side in the sound field reproduction system as an embodiment, and
the composition of a recording device. It is a block diagram showing composition of a
reproduction signal generating device in a sound field reproduction system as an embodiment. It
is a data structure figure shown about the data structure example of angle / Direction and
transfer function corresponding information about a directional measurement transfer function.
It is a data structure figure shown about the data structure example of angle / Direction and
transfer function corresponding information about a nondirectional measurement transfer
function.
[0013]
The best mode for carrying out the invention (hereinafter referred to as the embodiment) will be
described below. The description will be made in the following order. <1. Basic configuration>
1-1. Reproduction of one sound image position 1-2. Reproduction of multiple sound image
positions 1-3. Sound field reproduction on the second closed surface <2. Sound Field
Reproduction as Embodiment> 2-1. Adjustment using nondirectional measurement transfer
function 2-2. Adjustment using voice delay time and voice level information <3. Additional
configuration example> 3-1. Reproduction of pointing direction of sound source 3-2. Simulating
the playing form 3-3. Reproduction of stereo effector 3-4. Reproduction of directivity of sound
source and sound emission characteristics for each directivity direction 3-5. Addition of
ambience data 3-6. Sound field reproduction according to the camera viewpoint <4. Sound Field
Reproduction System as Embodiment> 4-1. System configuration example
[0014]
In the present specification, unless otherwise specified, the “operation processing based on
transfer function” for an audio signal means that the transfer function is subjected to
convolutional integration processing for the audio signal, or the transfer function is set as a filter
coefficient. It refers to applying a filtering process to an audio signal by an FIR (Finite Impulse
Response) filter.
[0015]
09-05-2019
8
<1.
Basic Configuration> 1-1. Reproduction of One Sound Image Position FIG. 1 is a view
schematically showing a measurement environment for sound field reproduction. なお、この「
1. The sound field reproduction technology described in “Basic configuration” is a
technology based on which the sound field reproduction as the present embodiment to be
described later is realized, and this content is the prior application of the present applicant. It is
described also in "Japanese Patent Application Laid-Open No. 2002-186100".
[0016]
In FIG. 1, the measurement environment 1 is a sound field to be reproduced in a reproduction
environment to be described later, and in this case, it may be considered as, for example, a
concert hall or a live hall. In this measurement environment 1, for example, the measurement
microphones (microphones) 4a, 4b, 4c, 4d, 4e, 4f, 4g, 4h on the circumference having a radius
R_bnd at a position not close to the wall of the measurement environment 1. , 4i, 4j, 4k, 4l, 4m,
4n, 4o, 4p. In the following, the circumference having such radius R_bnd will be referred to as a
first closed curved surface 10.
[0017]
Each of the measurement microphones 4 a to 4 p directs its directivity outward in the normal
direction of the first closed surface 10. In the following description of the present specification,
the arrow indicated by the microphone also indicates the main direction of the directivity.
Further, the measurement speaker 3 is disposed as a virtual sound source at a position having a
radius R_sp from the center of the first closed curved surface 10. The measurement signal
reproduction unit 2 supplies a measurement signal to the measurement speaker 3. As this
measurement signal, a TSP (Time Stretched Pulse: Time Stretched Pulse) signal for impulse
response measurement described later is output. In addition, since the measurement speaker 3 is
provided to reproduce a virtual speaker in a reproduction environment to be described later, it is
desirable that the directivity and the frequency characteristic be assumed to be the listener's
hearing in the reproduction environment.
09-05-2019
9
[0018]
In the measurement in this measurement environment 1, the measurement signal TSP is supplied
to the measurement speaker 3, and the measurement voices output from the measurement
speaker 3 are input to the respective measurement microphones 4a to 4p. These schematically
show only the audio path from the measurement speaker 3 to the measurement microphone 4a.
The audio signal detected by each of the measurement microphones 4a to 4p is supplied to an
impulse response measurement device (not shown), and here, based on the sound pressure of the
sound detected by each of the measurement microphones 4, the measurement speaker 3 The
impulse response corresponding to each of the measurement microphones 4a to 4p is measured.
The impulse response may be about 5 to 10 seconds in a large hole or the like, but may be
shorter in a small hole or a less noisy hole. This measurement makes it possible to obtain a
transfer function based on each impulse response. That is, FIG. 1 shows a voice path in the case
of obtaining a transfer function Ha corresponding to the measurement microphone 4a. Although
not shown, transfer functions Hb to Hp corresponding to the measurement microphones 4b to
4p can be obtained similarly. The measurement of the impulse response may be performed for
each of the measurement microphones, or may be performed simultaneously for all of the
measurement microphones 4a to 4p. Further, the measurement signal is not limited to the TSP
signal, and pseudo random noise or a music signal may be used. Also in the following description,
the transfer function from the measurement speaker to the measurement microphone in the
measurement environment 1 is represented by “H”.
[0019]
Thus, in the measurement environment 1, transfer functions Ha, Hb, Hc, Hd... Hp corresponding
to the measurement microphones 4a, 4b, 4c, 4d. Then, by using these transfer functions Ha to
Hp, the sound field of the measurement environment 1 can be reproduced in an environment
(reproduction environment) different from the measurement environment 1.
[0020]
FIG. 2 shows the configuration of a reproduction system (reproduction signal generation device)
of reproduction speech in a reproduction environment. In the reproduced signal generation
device 5, the audio reproduction unit 6 can output an arbitrary audio signal S. The audio signal S
output from the audio reproduction unit 6 is supplied to the arithmetic units 7a, 7b, 7c, 7d,... 7n,
7o, 7p. The transfer functions H to which the same suffix (alphabet) is added among the transfer
09-05-2019
10
functions Ha to Hp measured corresponding to the measurement microphones 4a to 4p as
described above are set in the respective operation units 7a to 7p. Each arithmetic unit 7
performs arithmetic processing based on the transfer function H set for each of the supplied
audio signals S. Thus, reproduction signals SHa, SHb, SHc, SHd,..., SHn, SHo, and SHp in which the
impulse response corresponding to the transfer function is convoluted with the audio signal S are
output from the arithmetic units 7a to 7p. Ru. As described above, the operation of each
operation unit 7 can also be realized by an FIR filter in which transfer functions (impulse
responses) set respectively are set as filter coefficients. The same applies to all "calculation units"
described later.
[0021]
Reproduction signals SHa to SHp are supplied to reproduction speakers 8a, 8b, 8c, 8d,... 8n, 8o,
8p arranged in a reproduction environment. As a result, from each of the reproduction speakers
8a to 8p, sounds based on the reproduction signals SHa to SHp based on the transfer functions
Ha to Hp in the measurement environment 1 are output.
[0022]
FIG. 3 is a schematic view for explaining the reproduction environment. The reproduction
environment 11 is, for example, an anechoic chamber or a studio with little reverberation. In this
reproduction environment 11, the reproduction speakers 8a to 8p shown in FIG. 2 are arranged.
In this case, the reproduction speakers 8a to 8p are arranged inward on the outer periphery of
the first closed surface 10 formed with a radius R_bnd in correspondence with the arrangement
positions of the measurement microphones 4a to 4p shown in FIG. Ru. That is, the arrangement
positions of the reproduction speakers 8a to 8p and the measurement microphones 4a to 4p
attached with the same suffix (alphabet) correspond to each other. Although the first closed
surface 10 in the measurement environment 1 and the first closed surface 10 in the reproduction
environment 11 are closed surfaces existing in different spaces, they are geometrically
equivalent here formed by the same radius. The same reference numerals are given for the sake
of convenience for the closed surface of.
[0023]
Then, by supplying and outputting the reproduction signals SHa to SHp from the reproduction
speakers 8a to 8p as shown in FIG. It can be felt that the sound field in the case of reproducing
the audio signal S from the measurement speaker 3 shown in FIG.
09-05-2019
11
[0024]
Here, when there is no sound source in a closed surface, in order to accurately reproduce the
sound field at another place, the sound pressure and the normal direction of the outer periphery
of the closed surface in the original sound field and the reproduction sound field. It is known that
it is sufficient to match particle velocities (see publicly known document: "Acoustic system and
digital processing" edited by the Institute of Electronics, Information and Communication
Engineers (corona).
Specifically, as many bidirectional microphones are installed on a closed surface, and the sound
pressure and particle velocity at each installation point are measured. Therefore, in the first
closed surface 10 in the measurement environment 1, innumerable measurement microphones
are installed outward in the normal direction, and in the first closed surface 10 in the
reproduction environment 11, the innumerable number corresponding to these measurement
microphones. When the inside of the first closed curved surface 10 in the reproduction
environment 11 is set as the viewing position by arranging the reproduction speakers, the same
localization as the case where the listener is in the first closed curved surface 10 of the
measurement environment 1 A feeling and reverberation can be obtained, and furthermore, a
virtual sound image can be perceived at the position of the measurement speaker 3 which is not
in the reproduction environment 11. That is, at any listening position inside the first closed
curved surface 10 of the reproduction environment 11, a sound field feeling equivalent to that of
the measurement environment 1 can be obtained outside the listening position. However, as
described above, it is difficult to actually achieve this by requiring innumerable microphones and
reproduction speakers. Therefore, the present applicant focused on the fact that sound pressure
and particle velocity components are included in the output of a directional microphone, for
example, a unidirectional microphone, to reproduce a finite number of directional microphones
and the corresponding number thereof. It was confirmed by experiments that almost the same
sound effect can be obtained by the speaker.
[0025]
Thus, for example, the sound field in the measurement environment 1 such as a hole can be
reproduced in the reproduction environment 11 as an anechoic chamber. Here, according to this,
if the measurement of the impulse response in the measurement environment 1 is performed
once as shown in FIG. 1, then, by using these measurement data (transfer function), the
09-05-2019
12
reproduction environment 11 etc. The sound field of the measurement environment 1 can be
artificially reproduced at any time in an environment other than the measurement environment
1. And, in this case, according to the configuration of FIG. 2 described above, any sound can be
used as the sound to be reproduced in the sound field reproduced in this way, so any sound can
be reproduced in the measured hole. It can be reproduced as being played (any playing has been
performed).
[0026]
1−2. Reproduction of a plurality of sound image positions In the above description, one
sound image position is reproduced in the reproduction environment 11 based on the result of
measuring the impulse response from one measurement speaker 3 to each of the measurement
microphones 4a to 4p in the measurement environment 1. Although this technique is applied, it
becomes possible to reproduce a plurality of measurement speakers 3 arranged as shown in the
following FIG. 4, that is, a plurality of sound image positions.
[0027]
In FIG. 4, first, in this case, in the measurement environment 1 in which the measurement
microphones 4a to 4p similar to those in FIG. 1 are arranged, as shown in the drawing, a plurality
of measurement speakers 3-1, 3-2, and 3-3. , 3-4 are arranged at different positions outside the
first closed surface 10, respectively. Here, the arrangement position of the measurement speaker
3-1 is referred to as Position 1, and the arrangement position of the measurement speaker 3-2 is
referred to as Position 2. Similarly, the arrangement positions of the measurement speaker 3-3
and the measurement speaker 3-4 are assumed to be Position 3 and Position 4, respectively.
[0028]
The measurement in the measurement environment 1 in this case is performed by supplying the
measurement signal TSP to each of the measurement speakers 3. At this time, in each of the
measurement microphones 4a to 4p, an output sound signal of each of the measurement
speakers 3 is detected. The audio signal for each of the measuring speakers 3 obtained by each
of the measuring microphones 4 is also supplied to an impulse response measuring device (not
shown) in this case, whereby the measuring speakers 3 (3-1 to 3-4) are obtained. The impulse
response corresponding to each of the measurement microphones 4a to 4p is measured, and
09-05-2019
13
based on the result, the transfer function corresponding to each of the measurement speakers 3
to each of the measurement microphones 4 can be obtained. For example, in FIG. 4, a path for
obtaining a transfer function Ha-1 corresponding to the measuring speaker 3-1 to the measuring
microphone 4a and a transfer function Hb-1 corresponding to the measuring speaker 3-1 to the
measuring microphone 4b It is shown schematically. Similarly, regarding a path for obtaining a
transfer function Ha-3 corresponding to the measurement speaker 3-3 to the measurement
microphone 4a, and a transfer function Ho-3 corresponding to the measurement speaker 3-3 to
the measurement microphone 4o Is also shown schematically.
[0029]
Thus, according to the measurement signal TSP output for each of the measurement speakers 3,
transfer functions Ha-1 to Hp-1 corresponding to the measurement microphones 3-1 to the
measurement microphones 4a to 4p, and measurement Transfer function Ha-2 to Hp-2
corresponding to each of the measurement microphones 4a to 4p, and transfer function Ha-3 to
3 corresponding to each of the measurement microphones 3a to 4p. Hp-3, transfer functions Ha4 to Hp-4 corresponding to the measurement microphones 4a to 4p can be obtained. In this case,
it is desirable that the measurement of the impulse response is performed by outputting the
measurement signal TSP for each measurement speaker 3 so that the sound from the
measurement speakers 3 of different Positions is not mixed. In addition to arranging the plurality
of measurement speakers 3, one measurement speaker 3 may be sequentially arranged at each
position.
[0030]
FIG. 5 is a reproduction for performing sound field reproduction based on these transfer
functions Ha-1 to Hp-1, Ha-2 to Hp-2, Ha-3 to Hp-3, and Ha-4 to Hp-4. The configuration of the
reproduced signal generation device 15 that generates an audio signal (also referred to simply as
a reproduced signal) is shown. The reproduction signal generation device 15 has a configuration
corresponding to the case where different sounds are output, for example, for each of a plurality
of sound image positions (Position 1 to Position 4). For this purpose, a total of four audio
reproduction units, that is, audio reproduction units 6-1, 6-2, 6-3, and 6-4, corresponding to each
Position are provided. Also in this case, each audio reproduction unit 6 can output an arbitrary
audio signal S. Here, the audio signals S output from the audio reproduction units 6 are shown as
audio signals S1, S2, S3 and S4 in association with the respective Position numbers.
09-05-2019
14
[0031]
Further, four sets corresponding to each of Position 1 to Position 4 are provided as the operation
unit 7 in this case. That is, arithmetic units 7a-1 to 7p-1 corresponding to Position 1, arithmetic
units 7a-2 to 7p-2 corresponding to Position 2, arithmetic units 7a-3 to 7p-3 corresponding to
Position 3, and an arithmetic unit corresponding to Position 4 7a-4 to 7p-4 are provided. As
shown in the drawing, for the arithmetic units 7a-1 to 7p-1, transfer functions Ha-1 to Hpobtained in accordance with the outputs from the measurement speakers 3-1 (Position 1) to the
respective measurement microphones 4 are illustrated. 1 is set. The arithmetic units 7a-1 to 7p-1
perform arithmetic processing based on the set transfer function H on the audio signal S1 input
from the audio reproduction unit 6-1, and reproduce signals SHa-1 to SHp. Output -1. As a result,
first, a reproduced signal for reproducing the sound image position of the measurement speaker
3-1 (Position 1) is obtained. Further, for the calculation units 7a-2 to 7p-2, transfer functions Ha2 to Hp-2 obtained according to the outputs from the measurement speaker 3-2 (Position 2) to
the respective measurement microphones 4 are These arithmetic units 7a-2 to 7p-2 perform
arithmetic processing based on the transfer function H set on the audio signal S2 input from the
audio reproduction unit 6-2, and reproduce the reproduced signal SHa-2 Output ~ SHp-2. As a
result, a reproduced signal for reproducing the sound image position of the measurement
speaker 3-2 (Position 2) is obtained. Similarly, in the calculation units 7a-3 to 7p-3, transfer
functions Ha-3 to Hp-3 obtained in accordance with the measurement speaker 3-3 (Position 3)
are set, and from the sound reproduction unit 6-3, respectively. Arithmetic processing based on
the set transfer function H is performed on the input audio signal S3, and reproduced signals
SHa-3 to SHp-3 are output. As a result, a reproduced signal for reproducing the sound image
position of the measurement speaker 3-3 (Position 3) is obtained. Further, transfer functions Ha4 to Hp-4 obtained according to measurement loudspeaker 3-4 (Position 4) are set to operation
units 7a-4 to 7p-4, and are input from audio reproduction unit 6-4, respectively. Arithmetic
processing based on the set transfer function H is performed on the audio signal S4 to be
reproduced to output reproduced signals SHa-4 to SHp-4. As a result, a reproduction signal for
reproducing the sound image position of the measurement speaker 3-4 (Position 4) is obtained.
[0032]
The adders 9a to 9p are provided in a one-to-one relationship with the reproduction speakers 8a
to 8p, and operation units 7a-1 to 7p-1, operation units 7a-2 to 7p-2, and operation units 7a-3.
.About.7p-3, among the arithmetic units 7a-4 to 7p-4, the output from the arithmetic unit 7 to
which the corresponding subscript (alphabet) is attached is input, and they are added to add the
corresponding subscript. To the reproduction speaker 8. That is, for example, the adder 9a
receives four reproduction signals SHa-1, SHa-2, SHa-3, and SHa-4 from the arithmetic units 7a-
09-05-2019
15
1, 7a-2, 7a-3, and 7a-4, These are added and supplied to the reproduction speaker 8a. As a result,
reproduction sound corresponding to the path from all the positions shown in FIG. 4 to the
measurement microphone 4a can be output from the speaker 8a. Further, the adder 9p receives
the four reproduction signals SHp-1, SHp-2, SHp-3 and SHp-4 from the operation units 7p-1, 7p2, 7p-3 and 7p-4, Are added and supplied to the reproduction speaker 8p. As a result, from the
speaker 8p, it is possible to output reproduced voice corresponding to the path from all the
positions shown in FIG. 4 to the measurement microphone 4p. Such addition of the reproduced
signal SH is similarly performed in the adders 9b to 9o, so that the corresponding speakers 8b to
8o correspond to the paths from all Positions to the corresponding measurement microphones 4
as well. A reproduced signal can be output. As a result, the listener inside the first closed curved
surface 10 in the reproduction environment 11 surrounded by the reproduction speakers 8a to
8p is the listener of each of the measurement speakers 4 (Position 1, Position 2, Position 3,
Position 4) shown in FIG. It can be felt that the sound field in the case where the sound is
reproduced from each of them is artificially reproduced outside the first closed curved surface
10. That is, the sound image can be reproduced (localized, presented) at each position of
Position1, Position2, Position3, and Position4.
[0033]
FIG. 6 schematically shows the reproduction environment 11 in this case. The reproduced signal
generation device 15 shown in FIG. 5 is configured to be able to independently input separate
voices for each of Position1, Position2, Position3, and Position4. According to this, for example,
by inputting voices of different players such as vocals, drums, guitars, keyboards (keyboard
instruments), etc. for each Position, as shown in FIG. Player 1), Position 2 drum (Player 2),
Position 3 guitar (Player 3), Position 4 keyboard (Player 4), etc., it will be possible to present the
sound image of the player appropriate to the appropriate Position.
[0034]
1−3. Sound Field Reproduction on the Second Closed Surface Here, in the method of sound
field reproduction as described above, the number of arrangement of the measurement speakers
4 and the number of arrangement of the reproduction speakers 8 in the reproduction
environment 11 are increased. The sense of localization of the sound image (reproducibility of
the sound field) can be increased. According to this, although an environment in which as many
reproduction speakers 8 as possible can be arranged is desirable as the reproduction
environment 11, it is considered that, for example, a room of a general household is used as an
actual reproduction environment. Be In an environment such as a room of a general home, the
09-05-2019
16
number of loudspeakers arranged is limited, and in addition to the limitation of the number of
loudspeakers arranged as described above, the arrangement relationship of each loudspeaker is
different in each home. Is expected. Therefore, assuming sound field reproduction in a typical
home, according to the conditions, in the measurement environment such as a hole,
measurement is made according to the arrangement relationship and the arrangement number of
the measurement microphones 4 according to the respective conditions. Need to do. However,
according to this, for example, in order to correspond to the condition of the number and
arrangement of new speakers, it is necessary to go to the target hole one by one and to perform
the measurement by the arrangement of the measurement microphone according to the
condition The result is a lot of labor and expense in this regard.
[0035]
Here, as described above, the fact that the sound field in the measurement environment 1 can be
reproduced inside the first closed surface 10 in the reproduction environment 11 means that the
second further inside of the first closed surface 10 Also in the case of the closed surface, if the
calculation process using the transfer function from each speaker on the first closed surface 10
is performed, the reproduced signal for reproducing the sound field of the measurement
environment 1 can be obtained. That is, this makes it possible to reproduce the sound field of the
measurement environment 1 in the second closed curved surface. According to this, for example,
if the measurement in the target hall is performed once, the measurement for adaptation to the
actual reproduction environment such as the room of the home does not go to the target hall or
the like. In, for example, an experimental facility or the like as the reproduction environment 11,
the process can be performed from each of the reproduction speakers 8 on the first closed
curved surface 10 to the respective measurement microphones on the second closed curved
surface 14.
[0036]
In addition, to describe for confirmation here, the sound field reproduction on the first closed
surface 10 in the reproduction environment 11 is not limited to the application to the room of
the home or the like in the above-mentioned experimental facility etc. A variety of applications
can be envisioned. For example, as an event such as live, in addition to the form in which the
artist actually plays in the hall (hall), a hall where a screen for projecting an image in an actual
live hall is arranged, which is performed as a so-called film live. There are also cases where live
audio is played by In such a film live venue, a relatively large number of reproduction speakers 8
can be arranged (in other words, a large number of measurement microphones 4 can be
09-05-2019
17
arranged at the time of measurement). Based on the reproduced sound from these reproduction
speakers 8, it is possible to reproduce the sound field just like an actual live venue. At this time, if
the position of each player is determined in advance, measurement is performed for each
position in advance at an actual venue, and at the time of reproduction, the sound of the player
corresponding to that position is measured at that position. By performing arithmetic processing
based on the result (transfer function), the sound image position of each player can be accurately
reproduced.
[0037]
FIG. 7 is a schematic diagram for explaining a method of measuring an impulse response when
performing sound field reproduction on the second closed surface in the first closed surface 10
as described above. Here, in order to simplify the description, the case where only one
measurement speaker 3 is disposed in the measurement environment 1 and only one sound
image position is reproduced is illustrated. In FIG. 7, in this case, the measurement microphones
13A, 13B, 13C, 13D, and 13E are disposed inside the first closed curved surface 10 in the
reproduction environment 11. These measurement microphones 13A to 13E may be arranged in
correspondence with reproduction speakers arranged in a reproduction environment
(reproduction environment 20 described later), which is, for example, a room at home, The
arrangement relationship is not limited to that illustrated. In this figure, a closed curved surface
formed with the measurement microphones 13A to 13E as the outer periphery is shown as a
second closed curved surface 14. The inside of the second closed curved surface 14 is a listening
position in a reproduction environment, which is a room of a home. In addition, since it is
necessary to form the 2nd closed curved surface 14 inside the 1st closed curved surface 10,
when measuring in the measurement environment 1, the width of the 2nd closed curved surface
14 is considered in consideration of the width of the 2nd closed curved surface 14 It is desirable
to form the curved surface 10. Further, in this case, it is preferable to arrange as many
measurement microphones 4 as possible for measurement in a hole and to obtain a transfer
function H for as many points as possible on the first closed curved surface 10. As a result, the
target sound field can be reproduced with higher reproducibility in the measurement
environment 1 → reproduction environment 11, and a higher reproducibility can be realized as
adaptation to a reproduction environment such as a home room.
[0038]
Then, in this case, the measurement signal reproduction device 2 outputs the measurement
signal TSP for each reproduction speaker 8 disposed on the first flat curved surface 10 by the
09-05-2019
18
measurement signal reproduction device 2 as shown in FIG. The impulse response corresponding
to the microphone 13 is measured. From these impulse responses, it is possible to obtain the
transfer function in each path of each speaker 8 → each measurement microphone 13.
[0039]
The transfer function from such a reproduction speaker disposed on the first closed curved
surface 10 to the measurement microphone disposed on the second closed curved surface 14 is
represented by “E”. For example, as also shown in FIG. 7, the transfer function from the
reproduction speaker 8a to the measurement microphone 13A is represented as Ea-A. The
transfer function from the reproduction speaker 8b to the measurement microphone 13A is Eb-A,
and the transfer function from the reproduction speaker 8c is Ec-A. Although not shown, the
transfer functions from the reproduction speaker 8a to the remaining measurement microphones
13B to 13E are Ea-B, Ea-C, Ea-D, Ea-E, and the above-mentioned reproduction. The transfer
functions from the speaker 8b for measurement to the measurement microphones 13B to 13E
are Eb-B, Eb-C, Eb-D, Eb-E, and the transfer functions from the reproduction speaker 8c to the
measurement microphones 13B to 13E are Ec- B, Ec-C, Ec-D, Ec-E. Similarly, the lower case
alphabet indicates the other of the measurement speaker 8 and the capital alphabet after the
hyphen indicates the other of the measurement speaker 13 so that the transfer function E is
expressed as the correspondence of the speaker → the microphone.
[0040]
Here, if the transfer function E obtained as described above is used, the sound field reproduced
inside the first closed surface 10 can be reproduced in the second closed surface 14. As
described above, since the sound field of the measurement environment 1 can be reproduced
using the transfer function H inside the first closed surface 10 in the reproduction environment
11, according to this, even within the second closed surface 14 described above The sound field
of measurement environment 1 can be reproduced.
[0041]
FIG. 8 shows the configuration of the reproduction signal generator 19 for reproducing the
sound field of the measurement environment 1 in the second closed surface 14 in this way. Note
that, in this figure, reproduction speakers 18A, 18B,... 18E arranged in an actual reproduction
09-05-2019
19
environment 20, which is a room of a home, etc., are shown. First, the audio signal S from the
audio reproduction unit 6 is input to each of the operation units 7a to 7p in which transfer
functions Ha to Hp are set as in the case shown in FIG. As described above, the audio signals S
are arithmetically processed by the arithmetic units 7a to 7p based on the transfer functions Ha
to Hp, respectively, whereby reproduction signals SHa to SHp corresponding to the reproduction
speakers 8a to 8p are obtained.
[0042]
Here, as can be seen with reference to FIG. 7 above, the output sound from the reproduction
speaker 8 on the first closed curved surface 10 in this case is input to each of the microphones
13 on the second closed curved surface 14. Ru. And in connection with this, as the transfer
function E, the number according to the speakers 8a-8p for reproduction | regeneration on the
1st closed curved surface 10 is obtained, respectively about the microphone 13 for
measurement. That is, Ea-A, Eb-A ... Ep-A corresponding to the measurement microphone 13A,
Ea-B, Eb-B ... Ep-B corresponding to the measurement microphone 13B, for measurement Ea-C,
Eb-C,... Ep-C are obtained corresponding to the microphone 13C. Also, Ea-D, Eb-D... Ep-D
corresponding to the measurement microphone 13 D, and Ea-E, Eb-E... Ep-E corresponding to the
measurement microphone 13 E can be obtained. It is a thing. Therefore, in order to obtain
reproduction signals corresponding to each position of each of the measurement microphones
13 on the second closed curved surface 14 (that is, the reproduction speaker 18 in the actual
reproduction environment 20), the position of the measurement microphone 13 as illustrated.
Arithmetic units 16A-a to 16A-p, 16B-a to 16B-p,. 16E-p is provided. Then, as shown in the
figure, these arithmetic units 16A-a to 16A-p, 16B-a to 16B-p... 16E-a to 16E-p are reproduced
signals SHa from the above-mentioned arithmetic units 7a to 7p. The reproduction signals SH to
which the corresponding subscripts are attached are supplied as ~ SHp, whereby each arithmetic
unit 16 performs arithmetic processing based on the transfer function E set for each of the
reproduction signals SH input thereto. Make it
[0043]
With such a configuration, for each arrangement position of measurement microphones 13A to
13E (arrangement position of reproduction speakers 18A to 18E), according to each path of
measurement speakers 8a to 8p on first closed curved surface 10 The reproduced signal SHE
calculated and processed by the transfer function E can be obtained. That is, for example,
corresponding to the measurement microphones 13A (reproduction speakers 18A), reproduction
signals SHEA-a to SHEA-p calculated by the transfer function E corresponding to the paths from
09-05-2019
20
the measurement microphones 8a to 8p, respectively. Is obtained. Similarly, corresponding to the
measurement microphone 13B (reproduction speaker 18B), the reproduction signals SHEB-a to
SHEB-p processed by the transfer function E according to the respective paths from the
measurement microphones 8a to 8p are It can be obtained. Likewise, the outputs from the
arithmetic units 16C-a-16C-p, 16D-a-16D-p, 16E-a-16E-p are SHEC-a-SHEC-p and SHED-a-SHEDp, respectively. , SHEE-a to SHEE-p.
[0044]
The adders 17A, 17B,... 17E are provided in a one-to-one relationship with the reproduction
speakers 18A, 18B,. As illustrated, the adders 17A, 17B,... 17E are SHEA-a to p from the
operation units 16a-A to 16p-A, and SHEB-a to p ... 16a from the 16a-B to 16p-B. SHEE-a to p
from -E to 16p-E are input, added together, and supplied to the corresponding one of the
reproduction speakers 18A, 18B,... 18E. As understood from the above description, the
reproduced signals SHEAa to SHEEp input to each of the adders 17 are processed based on the
transfer function H and the transfer function E, respectively, and the respective measurement
microphones 13 (speakers for reproduction 18 It has become a reproduced signal according to
each). Therefore, as described above, by adding them by each adder 17 and supplying them to
the corresponding reproduction speaker 18, the reproduction signal SHE for reproducing the
sound field in the measurement environment 1 from each reproduction speaker 18 respectively.
(SHEA, SHEB ... SHEE) will be output. That is, in an actual reproduction environment 20 in which
such a reproduction speaker 18 is arranged in the same manner as the measurement
microphone 13 on the second closed surface 14, the sound field of the measurement
environment 1 in the second closed surface 14 is It can be reproduced.
[0045]
FIG. 9 shows the actual reproduction environment 20, the measurement environment 1 as a
virtual sound field, and the first closed surface 10 when the sound field of the measurement
environment 1 is reproduced by the second closed surface 14 in this way. It is shown
schematically. The reproduction speakers 18A to 18E in the reproduction environment 20 are
equivalent to the measurement microphones 13A to 13E in FIG. 7 on the second closed surface
14 having the same radius as the second closed surface 14 shown in FIG. Are arranged by the
positional relationship of That is, the reproduction speakers 18 in the reproduction environment
20 are arranged in a geometrically equivalent positional relationship with the measurement
microphones 13. As shown in the figure, these reproduction speakers 18A to 18E are disposed
on the second closed curved surface 14 in the inward direction, and the reproduction signal
09-05-2019
21
SHEA from the reproduction speaker 18A and the reproduction signal from the reproduction
speaker 18B. By outputting the reproduction signal SHEC from the SHEB and the reproduction
speaker 18C, the reproduction signal SHED from the reproduction speaker 18D, and the
reproduction signal SHEE from the reproduction speaker 18E, for the listener who is inside the
second closed curved surface 14. A sound field equivalent to the sound field reproduced by the
reproduction speakers 8a to 8p disposed on the first closed curved surface 10 indicated by a
broken line can be felt. That is, it is possible to artificially perceive the sound field of the
measurement environment 1 indicated by the broken line (sound image position of the
reverberation and measurement speaker 3). Therefore, when the inside of the second closed
curved surface 14 is at the listening position, the reverberation sound field and the sound image
localization in the measurement environment 1 can be obtained. This makes it possible to listen
to the audio as the content, for example, by a reverberation sound field such as a hall and sound
image localization while staying in a room at home, for example.
[0046]
Here, the case where only one position is assumed is exemplified as one measuring speaker 3 is
arranged in the measurement environment 1, but if a plurality of positions are assumed, the
number of the increased number of positions The configuration prior to each adder 17 shown in
FIG. 8 may be added. That is, for example, assuming two Positions of Position 1 and Position 2,
the audio reproduction unit 6 (6-2) for Position 2 and the operation units 7a to 7p (7a-2 to 7p)
are further provided with respect to the configuration shown in FIG. -2), operation units 16A-a16A-p, 16B-a-16B-p... 16E-a-16E-p (16A-a-2 to 16A-p-2, 16B-a-2 16B-p-2 ... 16E-a-2 to 16E-p-2)
are added. Then, the reproduction output from the added operation units 16A-a-2 to 16A-p-2,
16B-a-2 to 16B-p 2 ... 16E-a-2 to 16E-p-2. With regard to the signals, in this case also, the adders
17A to 17E may be configured to input and add those with the same suffix (upper case alphabet).
However, in this case, in the arithmetic units 7a to 7p and the arithmetic units 7a-2 to 7p-2 that
process the reproduction signal S based on the transfer function H from the measurement
environment 1 to the first closed surface 10, the transmissions set for each The functions H (ab)
are different. That is, for example, assuming that the transfer function H set by the calculation
units 7a to 7p is Ha-1 to Hp-1 corresponding to each of the measurement microphones 8 from
Position 1, the transmission set by the calculation units 7a to 7p-2 The function H measures Ha-2
to Hp-2 corresponding to the measurement microphones 8 from Position2. With the above
configuration, as the outputs of the adders 17A to 17E, the sound image positions of Position 1
and Position 2 are taken into consideration in the correspondence of the measurement
environment 1 → the first closed surface 10, and the first closed surface 10 → the second closed
surface 14 In the correspondence of, the reproduced signals SHEA to SHEE adapted by the
transfer function E are obtained. As a result, reproduction signals capable of reproducing the
sound image positions of Position 1 and Position 2 can be output from the reproduction speakers
09-05-2019
22
18A to 18E, whereby the listener on the inner side of the second closed surface 14 can also It
becomes possible to perceive each sound image in Position 1 and Position 2 in the measurement
environment 1 as a virtual sound field.
[0047]
<2. Sound Field Reproduction as Embodiment> 2-1. Adjustment using a nondirectional
measurement transfer function According to the technology of sound field reproduction
described so far, reverberation effect and sound image localization are performed using spatial
information based on the result of actually measuring the impulse response in the measurement
environment 1 Since the effects are obtained, more realistic sound field reproduction can be
performed. By the way, as the audio reproduction system, in addition to pursuing the realism of
the sound quality as described above, the system can be made more convenient because the
reproduction sound can be adjusted to the sound quality desired by the user. For example, some
conventional audio reproduction systems have been configured to be able to enhance the bass or
to adjust the sound quality according to the genre of the music to be reproduced (such as rock or
jazz), and the user prefers the desired sound quality. There are some that have been made to be
able to enjoy the music. In view of this, also in the system for reproducing the sound field as in
the present embodiment, it is possible to adjust, for example, the above-mentioned reverberation
and the localization of the sound image as such sound quality adjustment. This is preferable
because it can improve the usability of the user.
[0048]
Therefore, in the present embodiment, in order to realize the adjustment of the sound quality of
the reproduction sound in such a sound field reproduction system, the following technology is
proposed. First, sound quality adjustment using a directional measurement transfer function will
be described with reference to FIGS. Here, it is assumed that only one position 1 is assumed as
the virtual sound image position, and the reproduction of the sound field of the measurement
environment 1 is the reproduction speaker on the first closed surface 10 as shown in FIG. The
description will be continued assuming that it is performed in the reproduction environment 11
in which 8a to 8p are arranged.
[0049]
09-05-2019
23
First, in this case, according to the same method as that described above with reference to FIG. 1,
the output sound from the measurement speaker 3 is obtained by the measurement microphones
4 a to 4 p disposed on the first closed curved surface 10 of the measurement environment 1.
Based on the measurement results of the measurement signal TSP, transfer functions Ha to Hp
corresponding to the respective measurement microphones 4a to 4p are obtained. Here, for
confirmation, unidirectional microphones are used as the measurement microphones 4a to 4p.
Depending on this, in the following, the transfer functions Ha to Hp obtained in this way may be
called a directional measurement transfer function.
[0050]
Then, after the directional measurement transfer functions Ha to Hp are obtained by the method
similar to the method described in FIG. 1 as described above, the non-directional based on the
measurement result by the non-directional microphone shown in the following FIG. Generate a
sex measurement transfer function. In the measurement environment 1 shown in FIG. 10, a
nondirectional microphone (microphone) is used as a measurement microphone to which voice
from the measurement speaker 3 is input. As the measurement here, nondirectional microphones
arranged in the same arrangement relationship as the same number of measurement
microphones 4a to 4p used in generation of the directional measurement transfer functions Ha
to Hp are used. In this figure, these nondirectional microphones are shown as nondirectional
measurement microphones 24a to 24p. Also in this case, the measurement signal TSP from the
measurement signal reproduction unit 2 shown in the figure is output by the measurement
speaker 3 disposed at the virtual sound image position, and measurement is performed by the
nondirectional measurement microphones 24a to 24p. Transfer functions Ha to Hp as impulse
responses corresponding to each of the omnidirectional measurement microphones 24 are
obtained based on the voices thus obtained. Here, the transfer function H obtained as a result of
the measurement of the omnidirectional measurement microphone 24 in this manner is called
the omnidirectional measurement transfer function omniH (or simply the transfer function
omniH). That is, regarding the transfer functions Ha to Hp obtained for the respective
nondirectional measurement microphones 24a to 24p as described above, the nondirectional
measurement transfer functions omniHa to omniHp are used.
[0051]
Here, by using the omnidirectional measurement microphone 24 to measure the impulse
response in this way, the echo component in the measurement environment 1 is more than when
the measurement by the unidirectional microphone 4 is performed. Can be incorporated more
09-05-2019
24
often. Therefore, the component of the transfer function omniH obtained based on the
measurement result of the omnidirectional measurement microphone 24 is a component capable
of giving more reverberation. Therefore, according to the present embodiment, the reverberation
of the reproduced voice is felt by appropriately adding the nondirectional measurement transfer
function omniH to the directional measurement transfer function H used in normal sound field
reproduction to increase the reverberation component. To adjust the sound quality in the
direction of increasing
[0052]
FIG. 11 is a diagram showing a configuration of a sound quality adjustment system in the case of
performing sound quality adjustment based on such a nondirectional measurement transfer
function. First, as shown in the figure, balance parameter setting units 21a to 21p for setting the
addition ratios of the omnidirectional measurement transfer functions omniHa to omniHp and
the directional measurement transfer functions Ha to Hp, respectively. Balance parameter setting
units 22a to 22p are provided. Each of the balance parameter setting units 21a to 21p inputs the
transfer function omniH with the same subscript among the nondirectional measurement
transfer functions omniHa to omniHp. Further, each of the balance parameter setting units 22a
to 22p inputs the transfer function H having the same subscript among the directional
measurement transfer functions Ha to Hp.
[0053]
The adjustment of the balance parameter in the balance parameter setting units 21 and 22 is
performed by the controller 25 illustrated in response to the operation input from the operation
unit 26. Here, for convenience of illustration, the controller 25 and each balance parameter
setting unit 21 and each balance parameter setting unit 22 are illustrated as being connected by
only one control line, but the controller 25 sets each balance parameter. The values of the
balance parameter can be supplied independently to the units 21a to 21p and the balance
parameter setting units 22a to 22p, respectively. By operating the operation unit 26, the user can
independently input the value of the balance parameter to be set in the setting unit. The
controller 25 supplies balance parameters to be set to each balance parameter setting unit 21
and each balance parameter setting unit 22 based on this instruction input.
[0054]
09-05-2019
25
The adder 23 is provided with the same number 23 a to 23 p as the measurement microphones
4 (measurement microphones 24) disposed on the first closed curved surface 10 at the time of
measurement, and these adders 23 a to 23 p have the same suffixes. The outputs of the balance
parameter setting unit 21 and the balance parameter setting unit 22 are input and added. Thus,
for example, in the adder 23a, the omnidirectional measurement transfer function omniHa to
which the balance parameter is given by the balance parameter setting unit 21a and the
directional measurement transfer function Ha to which the balance parameter is given by the
balance parameter setting unit 22a. And a combined transfer function coefHa is obtained.
Similarly, in the adder 23b, a nondirectional measurement transfer function omniHb to which the
balance parameter is given by the balance parameter setting unit 21b, and a directional
measurement transfer function Hb to which the balance parameter is given by the balance
parameter setting unit 22b. Are synthesized, and a synthetic transfer function coefHb is obtained.
Similarly, the combined transfer functions coefH obtained by the other adders 23c to 23p are
referred to as combined transfer functions coefHc to coefHp.
[0055]
According to the above configuration, the user can adjust the ratio of adding the directional
measurement transfer function H and the nondirectional measurement transfer function omniH.
According to this, by reducing the ratio of the directional measurement transfer function H and
setting the ratio of the nondirectional measurement transfer function omniH a large, it is possible
to adjust the sound quality in the direction of increasing the reverberation. The transfer function
coefH can be obtained. Further, by performing the reverse setting, it is possible to obtain a
composite transfer function coefH capable of adjusting the sound quality in the direction of
reducing the reverberation.
[0056]
FIG. 12 shows the configuration of the reproduced signal generating device 28 that is compatible
with the case of performing the sound quality adjustment based on the nondirectional
measurement transfer function, provided with such an adjustment system configuration. Also in
this case, the reproduction speakers 8 a to 8 p are disposed on the first closed curved surface 10
in the reproduction environment 11. First, in the reproduction signal generating device 28 in this
case, coefH generating units as the balance parameter setting units 21a to 21p, the balance
parameter setting units 22a to 22p, and the adders 23a to 23p according to the connection form
shown in FIG. 27 are provided. Also in this case, the controller 25 and the operation unit 26
09-05-2019
26
shown in FIG. 11 are provided.
[0057]
The memory unit 29 comprehensively shows a storage device such as a ROM, a RAM, and a hard
disk included in the controller 25. The directional measurement transfer functions Ha to Hp and
the nondirectional measurement transfer functions omniHa to omniHp obtained based on the
measurement according to the method described in FIGS. 1 and 10 above are stored in advance
in the memory unit 29. Will be done. The controller 25 in this case supplies the nondirectional
measurement transfer functions omniHa to omniHp stored in the memory unit 29 to the balance
parameter setting unit 21 with the same subscript in the coefH generation unit 27. The
directional measurement transfer functions Ha to Hp are respectively supplied to the balance
parameter setting unit 22 to which the same subscript is attached. Also in this case, the
controller 25 supplies balance parameters to be set to each balance parameter setting unit 21
and each balance parameter setting unit 22 in the coef H generation unit 27 in response to an
operation input from the operation unit 26. In this case, the operation unit 26 is provided with
operators for setting parameters such as a knob operator (for example, a slide operator etc.)
corresponding to each balance parameter setting unit 21 and each balance parameter setting
unit 22, and the user By operating, the value of the balance parameter to be set can be indicated
according to each balance parameter setting unit 21 and each balance parameter setting unit 22.
Alternatively, adjustment of each balance parameter can be performed using an operation panel
displayed on the screen of a display (not shown). In that case, the operation unit 26 is an
operation element such as a mouse. The balance parameter setting unit 21 and each balance
parameter setting are performed by moving the cursor on the operation panel by the mouse
operation and dragging the knob operation icon provided on the operation panel for adjusting
parameters. It is possible to indicate the value of the balance parameter to be set respectively
corresponding to the part 22.
[0058]
The combined transfer functions coefHa to coefHp generated by the coefH generation unit 27
are supplied to corresponding ones of the operation units 7a to 7p which respectively receive the
audio signal S from the audio reproduction unit 6, as illustrated in the drawing. Each is set. That
is, the arithmetic unit 7 is set such that the synthetic transfer function coefHa is set for the
arithmetic unit 7a, the synthetic transfer function coefHb for the arithmetic unit 7b, and the
synthetic transfer function coefHp for the arithmetic unit 7p. Are supplied and set from the coef
H generation unit 27 as a composite transfer function coef H having the same subscript. Also in
09-05-2019
27
this case, each arithmetic unit 7 (a to p) performs arithmetic processing on the audio signal S
based on the set transfer function, and the reproduced signals obtained as a result thereof are
attached with the same subscript. The speaker 8 is supplied.
[0059]
With such a configuration, it is possible to obtain a reproduced signal based on a composite
transfer function coefH by the directional measurement transfer function H and the
nondirectional measurement transfer function omniH which are added at a rate based on user
operation. That is, the user can adjust the reverberation of the reproduced sound with respect to
the sound field reproduced by the reproduced signal output from the reproduction speaker 8 by
this.
[0060]
Here, for confirmation, since the sound quality (reverberation) adjustment in this case is
performed based on the impulse response measured in the measurement environment 1, the
reverberation feeling specific to the measurement environment 1 is increased ( Adjustments can
be made). That is, this point is different from the case of performing adjustment by a method of
artificially creating reverberation such as conventional digital echo and digital reverberation
methods.
[0061]
2−2. Adjustment using information on speech delay time and speech level By using the
transfer function combining the omnidirectional measurement transfer function omniH as
described above, it is possible to adjust the reverberation feeling, but this non-directive can be
performed. When adjustment is made in the direction in which the sense of reverberation is
increased by setting the ratio of the component of the sex measurement transfer function omniH
to a large value, the sense of localization of the virtual sound image position may be unclear.
Therefore, in consideration of this point, in the present embodiment, as a transfer function to be
synthesized with respect to the directional measurement transfer function H, it is also possible to
adjust the component corresponding to the direct sound not including the reverberation
component. It is possible to make adjustments also in the direction that makes the sense of
localization of the position clearer (makes the sound image sharper).
09-05-2019
28
[0062]
Here, the sense of localization of the virtual sound image is determined by the component of
sound (direct sound) directly input to each of the measurement microphones on the first closed
surface 10 from the arrangement position of the measurement speaker 3 in the measurement
environment 1 As a result, it is possible to make the sound image sharper by increasing the
component of the direct sound as a component of the transfer function to be convoluted to the
reproduced sound. The transfer function corresponding to the direct sound to each of the
measurement microphones is determined by the delay time and the sound level (waveform
energy) of the sound produced from the measurement speaker 3 and directly reaching the
measurement microphones. Can be represented. Here, information on the delay time of the voice
directly reaching each measurement microphone and its level as a transfer function
corresponding to such direct sound to each measurement microphone is a directional
measurement transfer function. It shall extract from Ha-Hp, respectively. The method will be
described with reference to FIGS. 13 and 14 below.
[0063]
First, in FIG. 13A, waveform components of an impulse response as the directional measurement
transfer function H are schematically shown. From the components of each directional
measurement transfer function H as shown in FIG. 13 (a), information of voice delay time and
voice level is extracted as shown in FIG. 13 (b). Here, the information on the respective audio
delay time and audio level extracted from each of the directional measurement transfer functions
Ha to Hp is referred to as a delay-dry transfer function dryHa to dryHp.
[0064]
Here, as a method of extracting such audio delay time and audio level information, it is
performed as shown in the following FIG. FIG. 14 (a) schematically shows a waveform component
of an impulse response as a directional measurement transfer function H, and FIG. 14 (b) shows a
delay-dry transfer function extracted based on the impulse response. The waveform component
of dryH is shown typically. In this case, first, for the impulse response as the directional
measurement transfer function H, as shown in FIG. 14A, the rising point T1 of the waveform is
detected. Then, from this detected waveform rising point T1, a position shifted forward in time
09-05-2019
29
by a separately set predelay is obtained, and this position is determined by the delay dry transfer
function dryH shown in FIG. 14 (b). Set to the waveform rising position. Then, in FIG. 14 (a), an
energy conversion window EW (rectangular in the figure) starting from the detected waveform
rising point T1 is set, the energy value in this window is determined, and then FIG. In b), a
constant proportional amount to this energy value is set as the waveform amplitude value of the
waveform rising position of the previous delay dry transfer function dryH (energy proportional
amount in the figure). By such a method, as each delay dry transfer function dryH (a to p), the
information on the voice delay time and the sound level for the direct sound is extracted from
each directional measurement transfer function H (a to p) Components can be obtained. The
method for obtaining the information on the audio delay time and the audio level from the
impulse response in this way is described in Japanese Patent Application No. 2005-67413, which
was proposed by the present applicant. Please refer to that.
[0065]
In the above method, the rising timing of the waveform component of the delay-dry transfer
function dryH is shifted by the separately set pre-delay, but such a pre-delay period is not
provided, and the directivity measurement transfer is performed. The rising point T1 of the
impulse response waveform as the function H can also be used as the waveform rising timing as
it is. However, if such a pre-delay is provided and the period can be variably set, the range of
sound quality adjustment can be expanded, which is preferable. In that case, the length of the
predelay period may be variably set, for example, within a relatively short range of about 0 ms to
20 ms.
[0066]
FIG. 15 shows the configuration of an adjustment system corresponding to the case where sound
quality adjustment is performed using such a delay dry transfer function dryH. First, also in this
case, balance parameter setting units 21a to 21p are provided to set the individual balance
parameters by inputting the nondirectional measurement transfer functions omniHa to omniHp.
Similarly, balance parameter setting units 22a to 22p are provided for inputting directional
measurement transfer functions Ha to Hp and setting individual balance parameters. However, in
this case, the directional measurement transfer functions Ha to Hp input to the balance
parameter setting units 22a to 22p are branched and supplied to the illustrated waveform energy
calculation and space delay detection unit 31.
09-05-2019
30
[0067]
The waveform energy calculation and space delay detection unit 31 extracts the information
components of the audio delay time and the audio level from the directional measurement
transfer functions Ha to Hp according to the method shown in FIG. Generate functions dryHa to
dryHp. And, in this case, these delay / dry transfer functions dryHa to dryHp are input, and
balance parameter setting units 32a to 32p are provided for setting individual balance
parameters. Among the delay / dry transfer functions dryHa to dryHp to which the same suffixes
are respectively attached, the delay / dry transfer functions dryH to which the same subscript is
attached are input to the balance parameter setting units 32a to 32p. Each balance parameter
setting unit 32 gives a coefficient as a balance parameter supplied from the controller 25 shown
in the drawing to the input delay dry transfer function dryH.
[0068]
The controller 25 in this case can individually supply the value of the balance parameter to be
set to each of the balance parameter setting units 32 a to 32 p in response to the operation input
from the operation unit 26. That is, in this case, depending on the operation unit 26 and the
controller 25, the user can individually adjust the value of the balance parameter to be set in the
balance parameter setting units 32a to 32p. For that purpose, for example, a knob operator for
adjusting the value of the balance parameter to be set in each balance parameter setting unit 32
may be added to the operation unit 26 described above with reference to FIG. Alternatively, as
described above, when the operation by the operation panel displayed on the display screen is
enabled, the values of the balance parameters to be set in the balance parameter setting unit 32
are individually adjusted on the operation panel. You may add and display the operation knob
icon for doing. Although the controller 25 and each of the balance parameter setting units 21,
22, and 32 are illustrated as being connected by only one control line here for convenience of
illustration, these balance parameter setting units 21, 22, For each of the 32 individual units, the
value of the balance parameter can be supplied independently in this case as well.
[0069]
The adders 33a to 33p are non-directional measurement transfer functions omniHa to omniHp
output from the balance parameter setting units 21a to 21p, balance parameter setting units 22a
to 22p, and balance parameter setting units 32a to 32p, and directivity measurement Nondirectional measurement transfer function omniH, directional measurement transfer function H,
09-05-2019
31
delayed dry transfer function dryH with the same suffix for transfer functions Ha to Hp and
delayed dry transfer functions dryHa to dryHp, respectively. Do. Thus, for example, in the adder
33a, the omnidirectional measurement transfer function omniHa to which the balance parameter
is given by the balance parameter setting unit 21a, and the directional measurement transfer
function Ha to which the balance parameter is given by the balance parameter setting unit 22a.
Furthermore, a combined transfer function coefHa is obtained by combining the delayed dry
transfer function dryHa to which the balance parameter is given by the balance parameter
setting unit 33a. Similarly, in the adder 33b, the omnidirectional measurement transfer function
omniHb to which the balance parameter is given by the balance parameter setting unit 21b, and
the directional measurement transfer function Hb to which the balance parameter is given by the
balance parameter setting unit 22b. Further, a combined transfer function coefHb is obtained by
combining the delayed dry transfer function dryHb to which the balance parameter is given by
the balance parameter setting unit 33b. Similarly, the combined transfer functions coefH
obtained by the other adders 33c to 33p are referred to as combined transfer functions coefHc to
coefHp.
[0070]
According to the above configuration, in this case, the delay-dry transfer functions dryHa to
dryHp can be added together as the synthetic transfer functions coefHa to coefHp. Further,
together with this, it is possible to adjust also the ratio of the delayed dry transfer functions
dryHa to dryHp to be added in this way. According to this, adjustment of the reverberation can
be performed by adjusting the ratio of the nondirectional measurement transfer function omniH,
and the localization of the sound image can be further adjusted by adjusting the ratio of the
delayed dry transfer function dryH. Adjustments can also be made. Incidentally, as also shown in
FIG. 15, the waveform energy calculation and the space delay detection for generating the
combined transfer function coefH corresponding to the case of performing the sound quality
adjustment using the delayed dry transfer function dryH in this way The configurations of the
unit 31, the balance parameter setting units 21a to 21p, the balance parameter setting units 22a
to 22p, the balance parameter setting units 32a to 32p, and the adders 33a to 33p are referred
to as a coefH generation unit 30.
[0071]
Here, although illustration is omitted, basically, the configuration of the reproduced signal
generation device corresponding to the case of performing the sound quality adjustment using
the delay dry transfer function dryH is the configuration shown in FIG. In place of the coefH
09-05-2019
32
generation unit 27 provided in the above, the coefH generation unit 30 illustrated in FIG. 15 may
be provided. However, as described above, the controller 25 and the operation unit 26 in this
case can individually set the value of the balance parameter to be set in each balance parameter
setting unit 32 in the coef H generation unit 30. It will be configured. Note that, as shown in FIG.
15, the delay-dry transfer function dryH is generated based on the directional measurement
transfer function H, so that the reproduced signal generation in this case is generated. The
controller 25 in the apparatus is also configured to supply only the directional measurement
transfer function Ha to Hp and the nondirectional measurement transfer function omniHa to
omniHp stored in the memory unit 29 to the coefH generation unit 30. It will be good if it is. That
is, since the delay-dry transfer function dryH is automatically generated on the device side based
on the directional measurement transfer function H, the directional measurement transfer
function H is also used as the measurement in the measurement environment 1 in this case. And
the omnidirectional measurement transfer function omniH.
[0072]
Here, for confirmation, an image of sound quality adjustment is shown in FIG. As shown, by
increasing the component of the directional measurement transfer function H, the volume in the
normal method (the method using the normal transfer function measured by the unidirectional
microphone 4) is increased. So can be adjusted. Further, by increasing the component of the
nondirectional measurement transfer function omniH, it is possible to perform adjustment in the
direction of increasing the reverberation component as described above. Furthermore, by
increasing the component of the delay-dry transfer function dryH, adjustment can be made to
clarify the sense of sound image localization and sharpen the sound image.
[0073]
FIG. 17 shows a setting example of each balance parameter assumed as an actual adjustment. For
example, as shown in FIG. 17A, when the position of the virtual sound image to be reproduced in
the reproduction environment 11 is only one side, the side closer to the position (Position 1 in
the drawing) of the virtual sound image (front side) In), the sense of localization of the sound
image is clarified as a delay dry system transfer function dryH component increase area, and
conversely, the area far from the position of the virtual sound image (back side) is a hole as an
omnidirectional measurement transfer function omniH increase area. It is possible to make
adjustments such as making the reverberation feeling a lot like in the world. FIG. 17B shows an
example of setting of each balance parameter corresponding to this case. In this case, the
component of the directional measurement transfer function H may be flat in all regions, and as
09-05-2019
33
shown in FIG. 15, for all of the reproduction speakers 8a to 8p (that is, balance parameter setting
units 22a to 22p shown in FIG. 15). For example, the balance parameter “1” may be set for all
of Further, as components of the nondirectional measurement transfer function omniH, the
reproduction speaker 8 (for example, 8f to 8l) in the area on the rear side, that is, the
reproduction speaker 8i located on the rearmost side with respect to the balance parameter
setting units 21f to 21l. The value of the balance parameter in (balance parameter setting unit
21i) is set to the highest (in this case, '2'), and balance is gradually balanced from the
reproduction speaker 8i to the reproduction speaker 8f at both ends of the region and the
reproduction speaker 8l. Set to decrease the parameter value. As values of balance parameters to
be set for other areas (balance parameter setting units 21m to 21e), for example, '0' is set as
illustrated. Furthermore, as a component of the delay-dry transfer function dryH, the highest
value (for example, '2') for the foremost reproduction speaker 8a for the foreside reproduction
speaker 8 (for example, 8o to 8c) described above Are set to gradually lower the value of the
balance parameter from the reproduction speaker 8a to the reproduction speaker 8o and the
reproduction speaker 8c on both sides of the area. That is, the balance parameter of the balance
parameter setting unit 32 a is set to “2”, and the set values are gradually lowered from the
balance parameter setting unit 32 a to the balance parameter setting unit 32 o and the balance
parameter setting unit 32 c. .
Then, '0' is set as the value of the balance parameter for the other area (the reproduction speaker
8d to the reproduction speaker 8n, that is, the balance parameter setting units 32d to 32n).
[0074]
Here, as described above with reference to FIG. 15, the balance parameters are individually set
for the balance parameter setting units 21a to 21p, the balance parameter setting units 22a to
22p, and the balance parameter setting units 32a to 32p, respectively. As described above, the
directional measurement transfer function H, the nondirectional measurement transfer function
omniH, and the delay-dry transfer function dryH are further supplied with the respective
reproduction speakers 8a to 8p. The value of each balance parameter can be adjusted for each
arrangement position of. Note that the directional measurement transfer function H, the
nondirectional measurement transfer function omniH, and the delay may be used other than the
configuration in which the value of the balance parameter can be adjusted individually for each
arrangement position of the reproduction speakers 8 as described above. It can also be
configured to be able to adjust the value of the balance parameter for each dry transfer function
dryH. That is, the controller 25 in this case is configured to supply balance parameters at the
divisions of the balance parameter setting units 21a to 21p, the balance parameter setting units
22a to 22p, and the balance parameter setting units 32a to 32p. .
09-05-2019
34
[0075]
Although the configuration corresponding to the case where only Position 1 is assumed as the
virtual sound image position has been described here, for example, in the case corresponding to
a plurality of Positions, the respective methods are the same as those described in FIG. For each
position, measurement is performed on the directional measurement transfer functions Ha to Hp
and the nondirectional measurement transfer functions omniHa to omniHp. Then, as the
reproduction signal generation device, based on the directional measurement transfer function H
(a to p) for each position measured in this way and the nondirectional measurement transfer
function omniHa to omniHp, synthesis transfer for each position It may be configured to
generate the functions coefHa to coefHp. The configuration of the reproduced signal generation
device in the case of corresponding to a plurality of Positions will be described later. Also in this
case, adaptation to the second closed surface 14 is also possible. The configuration of the
reproduced signal generation device in this case will be described later.
[0076]
Also, here, the case of using the nondirectional measurement transfer function and the delay dry
transfer function dryH as transfer functions to be added to the directional measurement transfer
function H used for normal sound field reproduction in sound quality adjustment has been
exemplified. It is also conceivable to perform sound quality adjustment by adding other transfer
functions. For example, if the transfer function based on the measurement results of the bidirectional microphones (a to p) similarly arranged on the first closed surface 10 in the
measurement environment 1 is added to the directional measurement transfer function H, the
reproduced sound field Adjustments can be made to the reverberation and the localization of the
sound image as the reproduced sound in the above. That is, in this case, with respect to the
directional measurement transfer function H, another transfer function obtained in
correspondence with the arrangement position of each of the measurement microphones of the
first closed surface 10 is obtained similarly to the directional measurement transfer function H.
By adding together, it is possible to adjust the sound quality of the reproduced sound in the
reproduction sound field, and therefore, as the above-mentioned other transfer function
(auxiliary transfer function) to be added to the normal transfer function H for sound quality
adjustment, The directivity measurement transfer function omniH is not limited to the delayed
dry transfer function dryH. It should be noted that the delay-dry transfer functions dryHa to
dryHp are obtained from the directional measurement transfer functions Ha to Hp, respectively.
There is no change in the transfer function obtained in correspondence with the arrangement
09-05-2019
35
position of the measurement microphone.
[0077]
<3. Additional configuration example> 3-1. Reproduction of pointing direction of sound
source Here, in the method of sound field reproduction described so far, the measurement
speaker 3 for outputting the measurement signal in the measurement environment 1 is
nondirectional, and from one point by this Information for expressing the sound caused by the
size of the measurement space, the material of the wall, floor, ceiling, geometric structure, etc. so
that sound can be emitted to the entire space (spatial information of measurement environment
1) It was supposed to measure. However, in practice, as a sound source to be reproduced as a
virtual sound image at the arrangement position of the measurement speaker 3, one having
directivity may be assumed. In such a case, if the sound field is reproduced based on the result of
measuring the impulse response using the measurement speaker 3 with nondirectionality as
described above, the directivity of the sound source can not be reproduced. It will be.
[0078]
Therefore, in the present embodiment, a directional speaker is used as a measurement speaker
for outputting a measurement signal in the measurement environment 1, and based on the result
of measuring the impulse response by directing this to a required direction, Reproduce the place.
FIG. 18 and FIG. 19 schematically show the state of measurement in the measurement
environment 1 in the case of reproducing a specific directivity direction of the sound source as
the sound field reproduction in this case. As can be seen from FIGS. 18 and 19, in this case as
well, measurement is performed on both the directional measurement transfer function H and
the nondirectional measurement transfer function omniH. First, FIG. 18 shows a state of
measurement of the directional measurement transfer function H. Also in this case, in the
measurement environment 1, the measurement microphones 4a to 4p are disposed outward on
the first closed curved surface 10. Then, in this case, as the directional measurement speaker, the
measurement signal TSP is output in a state in which the unidirectional measurement speaker 35
is directed to a specific direction as illustrated, Thereafter, the measurement of the impulse
response corresponding to the measurement microphones 4a to 4p is performed as in the above
to obtain the transfer function H. Here, in FIG. 18, the direction in which the measurement
speaker 35 is directed is Direction 2, and the arrangement position of the measurement speaker
35 is Position 1. The transfer function H obtained for each of the measurement microphones 4a
to 4p in the state directed to this Direction 2 is the transfer function Ha in the order of the
measurement microphones 4a, 4b, 4c,. -dir2, Hb-dir2, Hc-dir2 ... Hp-dir2
09-05-2019
36
[0079]
Further, FIG. 19 shows the measurement of the nondirectional measurement transfer function
omniH, but also in this case, the measurement of the nondirectional measurement transfer
function omniH is the case of measurement of the directional measurement transfer function H (
The nondirectional measurement microphones 24a to 24p are arranged in the same
arrangement relationship as in the case of FIG. That is, also in this case, the measurement signal
TSP is output in a state in which the measurement speaker 35 disposed at Position 1 is directed
to Direction 2, and the measurement signal TSP is measured by the respective nondirectional
measurement microphones 24a to 24p on the first closed surface 10. Based on the result, the
omnidirectional measurement transfer function omniH is determined. The nondirectional
measurement transfer function omniH obtained for each of the measurement microphones 24a
to 24p in the state directed to the Direction 2 in this manner is nondirectional in the order of the
measurement microphones 24a, 24b, 24c, ... 24p. The sex measurement transfer function is
expressed as omniHa-dir2, omniHb-dir2, omniHc-dir2, ... omniHp-dir2.
[0080]
FIG. 20 schematically shows how the sound field of the measurement environment 1 is
reproduced in the reproduction environment 11 based on the directional measurement transfer
function H and the nondirectional measurement transfer function omniH thus obtained. There is.
First, synthetic transfer functions coefHa-dir2 to coefHp-dir2 shown in this figure are directional
measurement transfer functions Ha-dir2 to Hp-dir2 and omnidirectional measurement transfer
obtained by the measurement of FIG. The same suffixes (for the functions omniHa-dir2 to Hpdir2 and the delayed dry transfer functions dryHa-dir2 to dryHp-dir2 extracted from the
directional measurement transfer functions Ha-dir2 to Hp-dir2 respectively) It is generated by
adding together those of a to p). In this case, a line recording sound source (Player 1) 36 shown
in the figure is assumed as the sound source. The line recording sound source 36 is a sound
source directly recorded from the target player, for example, an electric signal detected by a
microphone in vocals, and an audio output terminal in electric musical instruments such as a
guitar and a keyboard. Directly from the electrical signal from the For the purpose of
confirmation, “Player” mentioned here corresponds to each one of the virtual sound image
positions (Position) to be reproduced, and as shown in FIG. For example, it corresponds to each
performer separately, such as a vocal, a drum, a guitar, and a keyboard. Here, the virtual sound
image is indicated by a broken line, assuming that Player 1 is a vocal.
09-05-2019
37
[0081]
Then, as illustrated, in this case also in the reproduction environment 11, reproduction is
performed on the first closed curved surface 10 by the same positional relationship as the
measurement microphones 4a to 4p (that is, the measurement microphones 24a to 24p) in the
measurement environment 1. The speakers 8a-8p are arranged. Then, as described above, the
voice transfer signals from the line recording sound source 36 as line recording data are
combined transfer functions coefHa-dir2, coefHb-dir2, coefHc-dir2 ... coefHp-dir2 in which the
pointing direction of the sound source is added. , And output them from the corresponding
reproduction speakers 8 respectively. As a result, the listener in the first closed curved surface
10 perceives that the Player 1 is emitting sound toward the pointing direction indicated by the
arrow in the figure at the virtual sound image position of the Position 1 in the measurement
environment 1 it can. That is, in this way, it is possible to reproduce the sound field when the
sound is emitted from the virtual sound image position of Position 1 in the measurement
environment 1 toward the specific directivity direction in the reproduction environment 11. As
the configuration of the reproduced signal generating device for generating reproduced signals
to be output from the speakers 8a to 8p in this case, the directional measurement transfer
function Ha- is used in the memory unit 29 for the configuration shown in FIG. It is preferable to
store dir2 to Hp-dir2 and the omnidirectional measurement transfer function omniHa to omniHp,
and further to provide the coefH generation unit 30 shown in FIG. 15 instead of the coefH
generation unit 27. As a result, the synthetic transfer functions coefHa-dir2 to coefHp-dir2 are
set in the calculation units 7a to 7p in consideration of the pointing direction as described above.
[0082]
3−2. Simulating a Performance Form In this way, if a specific pointing direction can be
expressed, it is possible to simulate a performance type such as, for example, a player such as a
vocal or guitar looking back while playing, or turning an instrument. The method will be
described below. FIG. 21 is a view schematically showing the state of the measurement
environment 1 for realizing the simulation of the playing style in this manner. Also in the
following description, the measurement in the measurement environment 1 is performed for the
nondirectional measurement transfer function omniH as well as the directional measurement
transfer function H. The difference between these measurements is only whether the
measurement microphone disposed on the first closed surface 10 is the unidirectional
measurement microphone 4 or the nondirectional measurement microphone 24. Hereinafter,
only the state of measurement of the directional measurement transfer function H will be shown,
09-05-2019
38
and the illustration of the measurement of the nondirectional measurement transfer function H
will be omitted.
[0083]
First, in this case, the measurement speaker 35 is directed in each direction about the virtual
sound image position to measure the impulse response. Here, a speaker with a directivity of 60
° is used as the measurement speaker 35, and six directions (Direction 1, Direction 2... Direction
6) are defined as the directivity directions of the sound source. Then, as illustrated, the impulse
response when the measuring speaker 35 is directed to each Direction is measured by the
measuring microphones 4a to 4p disposed on the first closed curved surface 10, and the
measuring speaker 35 → each measurement The transfer function H corresponding to the
microphone 4 is obtained for each Direction. At this time, the transfer function H to each of the
measurement microphones 4a to 4p in the case of Direction 1 is represented as "Ha-dir1, Hb-dir1
... Hp-dir1". Similarly, transfer functions from the measurement microphones 4a to 4p when
using Direction2, Direction3, Direction4, Direction5, and Direction6 are respectively “Ha-dir2,
Hb-dir2... Hp-dir2”, “Ha-dir3, Hb-dir3 ... Hp-dir3 "," Ha-dir4, Hb-dir4 ... Hp-dir4 "," Ha-dir5, Hbdir5 ... Hp-dir5 "," Ha-dir6, Hb- dir6... Hp-dir6 ”.
[0084]
As described above, although not shown, with regard to the omnidirectional measurement
transfer function omniH, the transfer function omniH for each of the measurement microphones
24 a to 24 p in Direction 1 is “omniHa-dir 1, omniHb-dir 1 ... expressed as “omniHp-dir1”.
Similarly, transfer functions omniH for measurement microphones 24a to 24p when using
Direction2, Direction3, Direction4, Direction5, and Direction6 are “omniHa-dir2, omniHb-dir2 ...
omniHp-dir2”, and “omniHa-dir3”, respectively. , OmniHb-dir3 ... omniHp-dir3 "," omniHadir4, omniHb-dir4 ... omniHp-dir4 "," omniHa-dir5, omniHb-dir5 ... omniHp-dir5 "," omniHa-dir6,
omniHb " -dir6 ... expressed as omniHp-dir6 ".
[0085]
Also, as described above, the directional measurement transfer function H for each Direction is
obtained, and in this case as well, the delay dry transfer function dryH for each Direction is
extracted by extracting the delay dry transfer function dryH from each. You can get In the same
09-05-2019
39
manner as described above, the delay-dry transfer function dryH corresponding to each of the
measurement microphones 4a to 4p under Direction 1 is expressed as "dryHa-dir1, dryHb-dir1 ...
dryHp-dir1". Similarly, transfer functions dryH corresponding to each of the measurement
microphones 4a to 4p when using Direction2, Direction3, Direction4, Direction5, and Direction6
are "dryHa-dir2, dryHb-dir2 ... dryHp-dir2", "dryHa," respectively. -dir3, dryHb-dir3 ... dryHp-dir3
"," dryHa-dir4, dryHb-dir4 ... dryHp-dir4 "," dryHa-dir5, dryHb-dir5 ... dryHp-dir5 "," dryHa-dir6 " ,
DryHb-dir6... DryHp-dir6 ".
[0086]
By thus obtaining the directional measurement transfer function H, the nondirectional
measurement transfer function omniH, and the delayed dry transfer function dryH for each
Direction, it is possible to obtain a combined transfer function coefH for each Direction. That is,
the composite transfer functions coefHa-dir1, coefHb-dir1 ... coefHp-dir1 "are obtained
corresponding to Direction1. Similarly, corresponding to Direction2, Direction3, Direction4,
Direction5, and Direction6, "coefHa-dir2, coefHb-dir2 ... coefHp-dir2", "coefHa-dir3, coefHb-dir3
... coefHp-dir3", respectively "CoefHa-dir4, coefHb-dir4 ... coefHp-dir4", "coefHa-dir5, coefHb-dir5
... coefHp-dir5", "coefHa-dir6, coefHb-dir6 ... coefHp-dir6" are obtained . In response to this, the
direction of the voice emitted from the sound source can be made to sequentially differ by
performing the calculation process on the input voice signal while changing it to the synthetic
transfer function coefH according to different Direction with the passage of time. For example, by
changing the synthetic transfer function coefH used for arithmetic processing to one
corresponding to Direction 1 → Direction 2 → Direction 3 ... → Direction 6 sequentially, the
Player at the virtual sound image position is Direction 1 → Direction 2 → Direction 3 ... →
Direction 6 It is possible to reproduce the sounding state while rotating in the direction.
[0087]
FIG. 22 shows the configuration of the reproduction signal generation device 37 in the case
where such control of the pointing direction is performed. In addition, in this figure, the structure
corresponding to, when reproducing several Position (Position 1-Position 4) in the measurement
environment 1 as FIG. 4-FIG. 6 above showed is shown. As described above, when a plurality of
Positions are assumed, the transfer function H and the transfer function omniH are the same as
those described in FIG. 21 for the measurement speakers 35 (35-1 to 35-4) disposed at each
Position. It can obtain | require based on the result of having measured impulse response by the
method of (1).
09-05-2019
40
[0088]
In FIG. 22, first, since the reproduced signal generation device 37 in this case corresponds to a
plurality of Positions (1 to 4) as described above, each Position is the same as that shown in FIG.
An audio reproduction unit (6-1 to 6-4) for each and an operation unit for each Position are
provided. Also in this case, the audio reproduction units corresponding to each Position (each
Player) are shown as audio reproduction units 6-1, 6-2, 6-3, 6-4 in order from Position 1.
Moreover, about the calculating part for every Position, it is set as calculating part 46a-1 to 46p1, 46a-2 to 46p-2, 46a-3 to 46p-3, 46a-4 to 46p-4 in order from Position1. Furthermore, in this
case as well, adders 47a to 47p provided according to the one-to-one relationship with the
reproduction speakers 8a to 8p are provided. Among the adders 47a to 47p, among the
operation units 46a-1 to 46p-1, the operation units 46a-2 to 46p-2, the operation units 46a-3 to
46p-3, and the operation units 46a-4 to 46p-4, The output from the operation unit 46 to which
the corresponding subscript (alphabet) is attached is input, and they are added and supplied to
the corresponding reproduction speaker 8. As a result, reproduction signals representing the
sound image position of each Position can be output from each reproduction speaker 8.
[0089]
Then, in this case, the coef H generation units 30-1, 30-2, and 30 are configured to control the
pointing direction by sequentially changing and setting the combined transfer function obtained
for each Direction as described above. 3 and 30-4, the controller 40, the memory unit 38, and
the operation unit 39 are provided.
[0090]
First, in the memory unit 38, Direction · Transfer function H for the directional measurement
transfer function H as transfer function information for each Position and each Direction
obtained in advance as a result of measurement in the measurement environment 1 For the
correspondence information 38a and the nondirectional measurement transfer function omniH,
Direction / transfer function omniH correspondence information 38b is stored.
FIG. 23 shows the data structure of the Direction / transfer function H correspondence
information 38a stored in the memory unit 38, and FIG. 24 shows the data structure of the
Direction / transfer function omniH correspondence information 38b. As shown in these figures,
in this case, information of the transfer function H and the transfer function omniH when the
09-05-2019
41
measurement speaker 35 is directed to each Direction is stored for each position. In FIG. 23, with
respect to transfer functions Ha to Hp corresponding to the measurement microphones 4 a to 4
p, different positions are represented by numbers appended immediately thereafter.
Furthermore, each Direction is represented by the number of "-dir" added after. For example, the
transfer function H to the measurement microphone 4a when the measurement speaker 21 of
Position 1 is directed in the direction of Direction 2 is expressed as "Ha1-dir2", and the
measurement speaker 21 of Position 3 is directed in the direction of Direction 6 The transfer
function H to the measurement microphone 4b is expressed as "Hb3-dir6". Further, in FIG. 24,
similarly to the transfer functions omniHa to omniHp, the numerals attached immediately after
them represent the position of Position, and the numerals “−dir” attached after each indicate
Direction.
[0091]
Further, in FIG. 22, the coefH generating units 30-1, 30-2, 30-3, and 30-4 each have the same
configuration as the coefH generating unit 30 illustrated in FIG. In this case, the coefH generation
unit 30-1 is supplied with the transfer function H and the transfer function omniH for Position 1
(Player 1) read from the memory unit 38 by the controller 40, and generates the combined
transfer function coefH for Player 1 It will be. In addition, as the coefH generation unit 30-2, the
transfer function H and transfer function omniH for Position 2 read from the memory unit 38 by
the controller 40 are supplied to generate the combined transfer function coefH for Player 2 Be
done. Further, the coefH generation units 30-3 and 30-4 are supplied with the transfer function
H and transfer function omniH for Position 3 and Position 4 read from the memory unit 38 by
the controller 40, and synthesize the respective for Player 3 and Player 4 The transfer function
coef H is to be generated. The composite transfer functions coefHa to coefHp generated for the
Player 1 by the coef H generation unit 30-1 are given the same suffix among the operation units
46a to 46 p-1 to which the reproduction signal S1 for the Player 1 is supplied. It is supplied to
the arithmetic unit 46 and set. Similarly, the combined transfer functions coefHa to coefHp for
the Player 2 generated by the coef H generation unit 30-2 are given the same suffix among the
operation units 46a-2 to 46p-2 to which the reproduction signal S2 for the Player 2 is supplied.
It is supplied to the computing unit 46 to be set. Furthermore, the combined transfer functions
coefHa to coefHp for the Player 3 generated by the coef H generation unit 30-3 are sent to the
calculation unit 46 to which the same suffix is added among the calculation units 46a-3 to 46p-3
to which the reproduction signal S3 is supplied. The combined transfer functions coefHa to
coefHp for the Player 4 which are supplied and set, and which are generated by the coef H
generation unit 30-4, have the same suffix among the calculation units 46a-4 to 46p-4 to which
the reproduction signal S4 is supplied. It is supplied and set to the operation unit 46 to be
attached.
09-05-2019
42
[0092]
In this case, the controller 40 controls each Direction stored in the memory unit 38 for the
transfer function H and the transfer function omniH supplied to the coef H generation units 30-1,
30-2, 30-3, and 30-4, respectively. By selectively supplying one of the transfer function H and
the transfer function omniH for each, the combined transfer function coefH set in each operation
unit 46 is variably set, and thereby the directionality of the sound emitted from each Position
Control the direction. For example, when it is assumed that the pointing direction of Position 1 is
rotated in the Direction 1 → Direction 2 → Direction 3 direction, the transfer function Ha 1 -dir 1
of transfer function H and transfer function omniH for Position 1 stored in the memory unit 38. ~
Hp1-dir1 → Ha1-dir2 to Hp1-dir2 → Ha1-dir3 to Hp1-dir3 and transfer function omniHa1-dir1
to omniHp1-dir1 → omniHa1-dir2 to omniHp1-dir2 → omniHa1-dir3 to omniHp1-dir3
sequentially , These are sequentially supplied to the coefH generation unit 30-1. As a result, the
coefH generation unit 30-1 sequentially outputs coefHa1-dir1 to coefHp1-dir1 → coefHa1-dir2
to coefHp1-dir2 → coefHa1-dir3 to Hp1-dir3 as the synthetic transfer function coefH, which is
the calculation unit 46a-1 The values are sequentially set to .about.46 p-1. As a result, the
pointing direction for Position 1 can be rotated sequentially as Direction 1 → Direction 2 →
Direction 3 as time passes. Further, for example, when it is assumed that the pointing direction of
Position 4 is rotated in the Direction 4 → Direction 3 → Direction 2 direction, the transfer
function H 4 − of transfer function H and transfer function omni H for Position 4 stored in the
memory unit 38. dir4-Hp4-dir4-> Ha4-dir3-Hp4-dir3-> Ha4-dir2-Hp4-dir2 and transfer functions
omniHa4-dir4-omniHp4-dir4-> omniHa4-dir3-omniHp4-dir3-> omniHa4-dir2-omniHp4-dir2
sequentially These are read and sequentially supplied to the coefH generation unit 30-4.
As a result, the coefH generation unit 30-4 sequentially outputs coefHa4-dir4 to coefHp4-dir4 →
coefHa4-dir3 to coefHp4-dir3 → coefHa4-dir2 to Hp4-dir2 as the synthetic transfer function
coefH, which is the calculation unit 46a-4. The values are sequentially set to .about.46 p-4. As a
result, the pointing direction for Position 4 can be rotated sequentially to Direction 4 → Direction
3 → Direction 2 as time passes.
[0093]
Here, in order to express smoother rotation, it is necessary to shorten the interval of changing
Direction as much as possible. For this purpose, it is conceivable to define finer Direction
segments and obtain transfer function H and transfer function omniH for more directions.
However, this is not realistic because it causes an increase in the number of times of
09-05-2019
43
measurement, so in actually expressing the rotation, the transfer function H and transfer function
omniH of the adjacent Direction are interpolated to transfer the transfer function for each
Direction by further finer division. H and a transfer function omniH are generated, and these are
sequentially changed and set according to the passage of time. According to this, it is possible to
express smooth rotation even when relatively few Direction are defined.
[0094]
In addition, the balance parameter setting units (21a to 21p) in the respective coefH generation
units 30 are also controlled by the controller 40 and the operation unit 39 in this case as in the
case of the controller 25 and the operation unit 26 described in FIG. , 22a to 22p and 32a to
32p) are configured to be able to variably set the value of the balance parameter individually. In
this case, the components of the transfer function H / transfer function omniH / delayed dry
transfer function dryH can be adjusted for each player and for each arrangement position of the
reproduction speakers 8a to 8p. In this case, as the operation unit 39 in this case, the number of
knob operators may be increased in response to the increase of the Player to four. Alternatively,
the controller 40 may increase the number of display of operation knob icons on the operation
panel displayed on the screen.
[0095]
Although the configuration for instructing the controller 40 to change the pointing direction has
not been described here, such an instruction on the changing direction of the pointing direction
may be, for example, an operation unit 39 separately. This can be performed based on the user's
operation additionally or by providing in advance instruction information for instructing which
Direction should be set at which timing on the reproduction time axis of the audio signal. This is
also true for the specification of the sound source (Position) to be subjected to directional
control.
[0096]
Incidentally, in the configuration shown in FIG. 22, in the case where the directional control of
the sound source is not performed (that is, in the case where only sound field adjustment is
performed in correspondence with a plurality of Positions), The transfer function H and transfer
function omniH for each position are stored based on the measurement results when the
omnidirectional measurement speaker 3 is arranged at each position, and the controller 40
determines the transfer function H and the transfer function. Among the functions omniH, the
09-05-2019
44
transfer function H of Position 1 and the transfer function omniH are the coefH generating unit
30-1, and the transfer function H of Position 2 and the transfer function omniH are the coefH
generating unit 30-2 and the transfer function H of Position 3 and the transfer function omniH
For the transfer function H of the coef H generation unit 30-3, and for the transfer function H of
the Position 4 and the transfer function omni H for the coef H generation unit 30-4. .
[0097]
3−3.
Reproduction of Stereo Effector By the way, in the above description, it is assumed that the input
sound signal is a monaural sound signal, but the input sound signal may be a stereo sound signal.
For example, in an electric musical instrument such as an electric guitar, although the output
sound itself is monaural, when it passes through a so-called effector that effects this, the
monaural signal may be processed and output as a stereo signal. When it is desired to reproduce
the rendering effect by such an effector as it is, it is conceivable to reproduce two sound sources
of Rch (channel) and Lch at one virtual sound image position. Here, an example will be described
in which such reproduction of Rch and Lch is performed using the concept of the directivity
direction of the sound source described above.
[0098]
FIG. 25 schematically shows the state of measurement environment 1 in the case of reproducing
two sound sources of Rch and Lch at one virtual sound image position as described above. Here,
if the respective sound sources are based on Rch and Lch, the pointing directions corresponding
to these sound sources may be reversed or at least not made the same. Therefore, in this case,
Direction 6 is defined for the pointing direction of the Rch sound source, and Direction 2 is
defined for the pointing direction of the Lch sound source as illustrated. Then, corresponding to
this, as a measurement in this case, an impulse response to each measurement microphone 4
(each measurement microphone 24) when the measurement speaker 35 is directed to the
Direction 6 direction corresponding to the Rch sound source, The impulse response to each
measurement microphone 4 (each measurement microphone 24) when the measurement
speaker 21 is directed in the Direction 2 direction corresponding to the Lch sound source is
measured, thereby transmitting each corresponding to the Rch sound source and the Lch sound
source The function H and the transfer function omniH are obtained. Also in this case, assuming
that the arrangement position of the measurement speaker 35 is Position 1, the transfer function
09-05-2019
45
H obtained for each of the microphones 4 when directed to the Direction 6 as described above is
“Ha1-dir6, Hb1-dir6. It is indicated as "Hp1-dir6". Similarly, the transfer function H obtained for
each of the microphones 4 when directed to the Direction 2 is indicated as "Ha1-dir2, Hb1-dir2...
Hp1-dir2". The transfer function omniH obtained for each microphone 24 when directed to the
Direction 6 is indicated as “omniHa1-dir6, omniHb1-dir6... OmniHp1-dir6”. Similarly, the
transfer function omniH obtained for each microphone 24 when directed to the Direction 2 is
indicated as “omniHa1-dir2, omniHb1-dir2... OmniHp1-dir2”.
[0099]
FIG. 26 is a reproduction for generating reproduction signals to be output from the reproduction
speakers 8a to 8p in the reproduction environment 11 when reproducing two sound sources of
Rch and Lch at one virtual sound image position as described above. The configuration of the
signal generation device 50 is shown. The reproduction signal S from the audio reproduction unit
6 is input to the stereo effect processing unit 51. The stereo effect processing unit 51 subjects
the input monaural audio signal to digital effect processing such as so-called flanger or digital
delay to generate a stereo audio signal by Rch and Lch. Although the configuration in which the
stereo effector is incorporated is shown here, it is also possible to directly input the Rch audio
signal and the Lch audio signal obtained by performing stereo effect processing in an external
effector.
[0100]
The arithmetic units 51a-L, 51b-L... 51p-L perform arithmetic processing based on the transfer
function H set for the Lch audio signal input thereto. Similarly, the arithmetic units 51a-R, 51bR,... 51p-R perform arithmetic processing based on the set combined transfer function coefH on
the Rch audio signals respectively input.
[0101]
The combined transfer function coefH set in each of the arithmetic units 51a-L, 51b-L... 51p-L,
and the arithmetic units 51a-R, 51b-R. 30-L, produced by coefH generator 30-R. The
configuration of the coefH generating unit 30 -L and the coefH generating unit 30 -R is the same
as that of the coefH generating unit 30 illustrated in FIG. 15. Also in this case, the combined
transfer function coefH to be set for each operation unit can be generated by supplying the
09-05-2019
46
corresponding transfer function H and transfer function omniH to the coefH generation unit 30
with the controller 53 illustrated.
[0102]
In this case, in the memory unit 55 included in the controller 53, transfer functions Ha1-dir2 to
Hp-dir2 corresponding to the Direction 2 and transfer functions omniHa-dir2 obtained based on
the measurement results in the measurement environment 1 described above. omniHp-dir2,
transfer functions Ha1-dir6 to Hp-dir6 corresponding to Direction 6, and transfer functions
omniHa-dir6 to omniHp-dir6 are stored. The controller 53 reads the transfer functions Ha1-dir2
to Hp-dir2 and transfer functions omniHa-dir2 to omniHp-dir2 stored in the memory unit 55, and
supplies them to the coefH generation unit 30-L corresponding to Lch. As a result, the synthetic
transfer functions coefH (coefHa1-dir2 to coefHp-dir2) corresponding to Direction 2 are
generated from the coefH generation unit 30-L, and these are the same subscript among the
calculation units 51a-L to 51p-L. They are respectively supplied and set to the operation units 51
to which (a to p) are attached. Further, the controller 53 reads out the transfer functions Ha1dir6 to Hp-dir6 and transfer functions omniHa-dir6 to omniHp-dir6 stored in the memory unit
55, and supplies them to the coefH generation unit 30-R corresponding to Rch. . As a result, a
composite transfer function coefH (coefHa1-dir6 to coefHp-dir6) corresponding to Direction 6 is
generated from the coefH generation unit 30-R, and the same subscript among the calculation
units 51a-R to 51p-R It is supplied and set to each of the operation units 51 to be attached. As a
result, in the calculation units 51a-L, 51b-L... 51p-L, reproduction signals to be output from the
reproduction speakers 8 in order to reproduce the Lch sound source having the directional
direction of Direction 2 are obtained. Similarly, in the calculation units 51a-R, 51b-R,... 51p-R,
reproduction signals to be output from the reproduction speakers 8 in order to reproduce the
Rch sound source having the directivity direction of the Direction 6 are obtained.
[0103]
The controller 53 in this case also individually balances each of the balance parameter setting
units (21a to 21p, 22a to 22p, and 32a to 32p) in the coefH generation unit 30-L and the coefH
generation unit 30-R. It is configured to allow variable setting of parameter values. Also in this
case, the operation unit 54 is provided for adjusting these individual balance parameters.
[0104]
09-05-2019
47
Adders 52a to 52p respectively input and add reproduced signals from operation units 51 having
the same suffix among operation units 51a-L to 51p-L and operation units 51a-R to 51p-R. , The
result is also supplied to the speaker 8 for reproduction with the same subscript. Thus, the
reproduced signal for reproducing the pointing direction of the Lch sound source and the
reproduced signal for reproducing the pointing direction of the Rch sound source are
respectively added and output from the corresponding reproduction speaker 8. Thereby, the
sound field of the measurement environment 1 is reproduced in a form representing the
directivity direction of the Rch sound source and the directivity direction of the Lch sound source
in the first closed surface 10 in the reproduction environment 11 in which the reproduction
speakers 8 are arranged. be able to.
[0105]
3−4. Here, the so-called acoustic instruments which are not electric musical instruments
such as piano, violin, drum etc. The sound characteristics will be different. Strictly speaking, the
directivity of each musical instrument (sound source) and the sound emission characteristics of
each directional direction individually affect the entire acoustic space such as a hole to form the
acoustic characteristics of the sound source. Therefore, when the virtual sound image as the
sound source is to be reproduced more realistically, it is effective to perform the sound field
reproduction in the form of considering the directivity and the sound emission characteristics for
each directivity direction.
[0106]
A method in the case where sound field reproduction is performed in consideration of the
directivity of the sound source and the sound emission characteristics for each directivity
direction as described above will be described with reference to the following FIGS. FIG. 27 is a
view schematically showing a state of recording of a sound source in this case, and FIG. 27 (a)
shows a perspective view thereof and FIG. 27 (b) shows a top view thereof. In this case, first, a
sound source recording surface SR is defined which encloses the required sound source 56 in a
circular shape on a certain plane. Then, on the sound source recording surface SR, a plurality of
recording microphones 57 (directional microphones) are arranged so as to surround the sound
source 56. Also in this case, the directions of the arrows marked on the microphones 57 indicate
directivity directions, and the microphones 57 are arranged in the direction facing the sound
source 56 as can be seen from these arrows. By recording the voice from the sound source 56
for each of a plurality of directional microphones arranged in this way, it is possible to reflect the
09-05-2019
48
directivity of the sound source 56 and the sound emission characteristics for each directivity
direction in each recorded voice. it can. Here, an example is shown in which six recording
microphones 57 each having directivity of 60 ° are arranged on the sound source recording
surface SR and six directions of Direction 1 to Direction 6 are defined. As shown in the figure, the
recording microphone 57 of Direction 1 is the recording microphone 57-1, the recording
microphone 57 of the Direction 2 is the recording microphone 57-2, and the code of the
recording microphone 57 is arranged by the numbers following the hyphen. Indicates another
direction. By surrounding the sound source 56 in six directions in this manner, six directions are
defined as the directivity directions for the sound source 56 in this case. Furthermore, by
recording the sound by the recording microphones 57 arranged in six directions in this manner,
the sound emission characteristics of the sound source 56 for each of the six directivity
directions are recorded as the recording sound of each of the recording microphones 57. Each
can be reflected.
[0107]
According to this, in this case, if the sound recorded by each recording microphone 57 is emitted
outward for each Direction, the directivity of the sound source 56 and the emission
characteristics for each directivity direction are reproduced. can do. That is, in FIG. 27,
directional speakers of the same directivity 60 ° are arranged outward at the positions of the
recording microphones 57 arranged for each Direction, and recording is performed by the
recording microphones 57 respectively corresponding to these speakers. By outputting the
sound, the sound source 56 can be reproduced in a form that reflects the directivity of the sound
source 56 and the sound emission characteristics for each directivity direction. In this case, the
recording of the sound source 56 by each of the recording microphones 57 is as close as
possible to the sound source 56 (so-called "on" state) so as not to include the space information
at the recording site. It is preferred to be done.
[0108]
In this manner, the directivity of the sound source 56 is obtained by recording the sound from
each Direction so as to surround the sound source 56 and outputting each recorded sound by the
directional speaker arranged so as to have the same Direction relationship. In the present
embodiment, the sound field as the measurement environment 1 in which such a sound source
56 is disposed can be reproduced in another reproduction environment 11, which is another
environment. To reproduce. Here, in order to express the directional direction of Direction 1 to
Direction 6 of the sound source 56 disposed in the measurement environment 1 in the
09-05-2019
49
reproduction environment 11, as described above, the transfer function H and the transfer
function omniH (for every Direction) That is, the composite transfer function coefH) may be
obtained. In this case, since the recorded voice from the sound source 56 exists for each
Direction, the recorded voice of each Direction is convoluted with the synthesized transfer
function coefH of the same Direction among the synthesized transfer functions coefH obtained
for each Direction. Then, reproduced signals for each Direction can be obtained.
[0109]
Here, six directional directions for the sound source 56 are defined, so as to obtain the transfer
function H and transfer function omniH for each Direction, as described in FIG. 21 in this case as
well, The impulse response corresponding to each of the measurement microphones 4a to 4p
(24a to 24p) when the measurement speakers 35 in the measurement environment 1 are
directed to each direction (Direction 1 to Direction 6) may be performed. That is, for example,
assuming that the placement position of the sound source 56 in the measurement environment 1
is Position 1 (Player 1), transfer functions H corresponding to Direction 1 are transfer functions
Ha1-dir1, Hb1-dir1... Hp1-dir1, Direction2. Finds the transfer functions Ha1-dir2, Hb1-dir2, ...
Hp1-dir2. Similarly, for Direction 3, transfer functions Ha1-dir3, Hb1-dir3 ... Hp1-dir3, for
Direction 4 transfer functions Ha1-dir4, Hb1-dir4 ... Hp1-dir4, for Direction 5 transfer functions
Ha1-dir5, For Hb1-dir5... Hp1-dir5 and Direction 6, transfer functions Ha1-dir6 and Hb1-dir6...
Hp1-dir6 are obtained.
[0110]
FIG. 28 shows a configuration of a reproduced signal generation device 60 corresponding to the
case of performing sound field reproduction in consideration of the directivity of a sound source
and the sound emission characteristics for each directivity direction. In the drawing, for
convenience, the configuration for generating the combined transfer function coefH to be set in
each calculation unit 61 is not shown. Also in this case, the configuration is almost the same as
that shown in FIG. 22 (coef H generation units 30-1 to 30-4, controller 40, memory unit 38,
operation unit 39).
[0111]
However, in this case, the corresponding Position number (Player number) can be regarded as
09-05-2019
50
being increased from four to six in the case of FIG. 22, so the arithmetic units 61-1-1a to 61-1 in
FIG. -1p, computing units 61-1-2a to 61-1-2p, computing units 61-1-3a to 61-1-3p, computing
units 61-1-4a to 61-1-4p, computing unit 61-1 As the coefH generating unit 30 that supplies the
synthetic transfer functions coefHa to coefHp respectively corresponding to -5a to 61-1-5p and
the operation units 61-1-6a to 61-1-6p, the coefH generating unit 30-1, In addition to 30-2, 30-3,
and 30-4, coefH generation parts 30-5 and 30-6 are further provided. Further, in the memory
unit 38 in this case, the Direction / Transfer Function H correspondence information 38a and the
Direction / Transfer Function omniH correspondence information 38b are transmitted for each
Direction of Position 1 among those shown in FIGS. The function H and the transfer function
omniH may be stored. Then, as the controller 40 in this case, the transfer function H for
Direction 1 and transfer function omniH for coefH generation unit 30-1, transfer function H for
Direction 2 and transfer function omniH for coefH generation unit 30-2, for Direction 3 Transfer
function H and transfer function omniH for coefH generation unit 30-3, transfer function H for
Direction 4 and transfer function omniH for coefH generation unit 30-4, transfer function H for
Direction 5 and transfer function omniH for coefH generation unit 30-5 , Direction 6 and the
transfer function omniH are supplied to the coef H generation unit 30-6.
[0112]
In FIG. 28, in this case, the audio reproduced by the audio reproducing unit 6 is an audio signal
recorded for each Direction. Here, the audio reproduction unit 6 for reproducing the audio
recorded by the recording microphone 57-1 disposed in the Direction 1 is referred to as an audio
reproduction unit 6-1-1, and the recording microphone 57-2 disposed in the Direction 2 The
audio reproduction unit 6 that reproduces the recorded audio is shown as an audio reproduction
unit 6-1-2. Similarly, the audio reproduction unit 6 for reproducing the audio signals recorded by
the recording microphones 57-3, 57-4, 57-5, 57-6 is referred to as an audio reproduction unit 61-3, 6-1-4. , 6-1-5, 6-1-6. In the code attached to the audio reproduction unit in this case, the
number after the first hyphen is a number corresponding to the case where it is assumed that the
sound source 56 is Player 1 temporarily disposed at Position 1, for example, Position 2 In the
case of the player 2 placed in the, "2" is attached. The same applies to the reference numerals of
the respective parts described below.
[0113]
Then, arithmetic units 61-1-1a to 61-1-1p and 61-1 for processing audio signals recorded for
each of these Directions based on the combined transfer function coefH generated for each of the
Directions. -2a to 61-1-2p, arithmetic units 61-1-3a to 61-1-3p, arithmetic units 61-1-4a to 61-1-
09-05-2019
51
4p, arithmetic units 61-1.5a to 61- 1-5p , And operation units 61-1-6a to 61-1-6p. In the
operation units 61-1-1a to 61-1-1p, a combined transfer function coefH (coefHa1-dir1 to
coefHp1-dir1) corresponding to the measurement result when the measurement speaker 35 is
directed to Direction 1 is set. Each processes the audio signal supplied from the audio
reproduction unit 6-1-1 based on the set synthesis transfer function coefH. As a result, it is
possible to obtain reproduced signals to be output from the reproduction speakers 8a to 8p in
order to first express the recorded sound of Direction 1 as sound emitted in the Direction 1
direction. In addition, synthetic transfer functions coefHa1-dir2 to coefHp1-dir2 are set in the
operation units 61-1-2a to 61-1-2p, and recorded voice signals of Direction 2 reproduced from
the audio reproduction units 6-1-2, respectively. To obtain the reproduced signal to be output
from each reproduction speaker 8 in order to express the recorded audio of Direction 2 as that
emitted in Direction 2 by performing arithmetic processing based on the combined transfer
function coefH set for the above. Can. Similarly, operation units 61-1-3a to 61-1-3p, operation
units 61-1-4a to 61-1-4p, operation units 61-1.5a to 61- 1-5p, and operation units 61-1 -6a to
61-1-6p include synthetic transfer functions coefHa1-dir3 to coefHp1-dir3, synthetic transfer
functions coefHa1-dir4 to coefHp1-dir4, synthetic transfer functions coefHa1-dir5 to coefHp1dir5, synthetic transfer functions coefHa1-dir6 Cocoef H p 1-dir 6 are set, and the audio signals
from the audio reproduction units 6-1-3, 6-1-4, 6-1-5, 6-1-6 are set based on the set synthesis
transfer function coefH. To process. As a result, recorded voices of Direction 3 in the calculation
units 61-1-3a to 61-1-3p, recorded voices of Direction 4 in the calculation units 61-1-4a to 61-14p, and calculation units 61-1-5a to 61 In 1-5 p, reproduction signals to be output from the
reproduction speakers 8 a-8 p can be obtained for the recording sound in Direction 5 and in the
calculation units 61-1-6 a to 61-1-6 p, the recording sound in Direction 6.
[0114]
The adders 62a, 62b... 62p are provided in a one-to-one relationship with the reproduction
speakers 8a, 8b... 8p, and the reproduced signals from the operation unit 61 with the
corresponding subscripts are Inputting and adding up, the result is supplied to the reproduction
speaker 8 with the same subscript. Thereby, the reproduction signal to be output for each
reproduction speaker 8 obtained for each Direction as described above is added for each
reproduction speaker 8 and output from the corresponding reproduction speaker 8 It becomes.
[0115]
With such a configuration of the reproduction signal generation device 60, for example, recorded
audio in Direction 1 can be reproduced as output in the directional direction of Direction 1 in
09-05-2019
52
measurement environment 1, and similarly, recorded audio in Direction 2 is measured
environment 1 Can be reproduced in the reproduction environment 11 as being output in the
directional direction of Direction2. Also, the voices recorded in other Direction can be reproduced
as being output in the corresponding Direction direction of the corresponding Direction. As a
result, in the first closed surface 10 of the reproduction environment 11, the virtual sound image
in the measurement environment 1 can be reproduced more realistically by reflecting the
directivity of the sound source and the sound emission characteristics for each directivity
direction.
[0116]
Here, since six directions are defined by using six recording microphones 57 with directivity of
60 °, the combined transfer function coefH is the measurement result of the six directions
similar to FIG. For example, when different numbers of pointing directions are defined, for
example, by defining the Direction of Direction of 18 by the recording microphone 57 of
directivity 20 °, measurement is performed for each of the defined pointing directions. It is
sufficient to go and find the transfer function. Alternatively, without performing the
measurement of the transfer function in all directions actually defined, the measurement is
performed in the smaller direction to obtain the transfer function, and by interpolating the
transfer functions of adjacent Direction among them, A transfer function may be obtained
according to the defined Direction. This can reduce the number of measurements.
[0117]
In addition, although the case where sound recording from a sound source is planarly performed
is illustrated here, for example, as shown in the following FIG. 29, it is conceivable to perform
sound recording by three-dimensionally surrounding a sound source. In FIG. 29, the example
which encloses a sound source cylindrically is shown. In this case, the recording of the sound
source is performed by dividing the cylinder by upper, middle, and lower circular planes as
shown in the drawing, and arranging a plurality of recording microphones 71 on the respective
circular planes. Here, the upper, middle, and lower circular planes are indicated as a circular
plane 70-1, a circular plane 70-2, and a circular plane 70-3, respectively. Then, the recording
microphone 71 disposed on the outer periphery of the upper circular plane 70-1 is 71-1, the
recording microphone 71 disposed on the outer periphery of the middle circular plane 70-2 is
71-2, and the lower one The recording microphone 71 disposed on the outer periphery of the
circular plane 70-3 is denoted by 71-3. Also in this case, on each of the circular planes, the
recording microphones 71 have directivity of 60 °, and six directions of Direction 1 to Direction
09-05-2019
53
6 are defined. In this case, the Direction of each recording microphone 71 is represented by the
number after the second hyphen. For example, the recording microphone 71 disposed in the
upper direction Direction 2 is represented as a recording microphone 71-1-2, and the recording
microphone 71 disposed in the lower direction Direction 6 is expressed as 71-3-6.
[0118]
As described above, when the sound source is three-dimensionally surrounded and voice
recording is performed by each recording microphone 71, for example, assuming that the sound
source is a human, the noise of clothes rubbing, the sound or footstep generated by the action of
a hand, etc. In addition to voices, it becomes possible to record a plurality of sound sources
including their emission characteristics for each directivity and directivity direction. In other
words, at the same placement position as the recording microphone 71 shown in FIG. 29, the
same directivity 60 ° reproduction speaker is disposed outward and recorded from the
corresponding recording microphone 71 from them. By outputting voice, it is possible to make it
possible for a human being as a target of recording to be present in the space surrounded by the
circular flat surfaces 71-1 to 71-3.
[0119]
FIG. 30 is a view schematically showing the state of the measurement environment 1 when the
sound source surrounded in a three-dimensional manner is reproduced in the reproduction
environment 11 as described above. First, in this case, since three-dimensional reproduction is
performed, a three-dimensional space is also assumed as the first closed surface 10. In this case,
a space of a rectangular parallelepiped is assumed as the first closed curved surface 10, and the
measurement microphone is arranged to face outward at a required position covering the first
closed curved surface 10 of the rectangular parallelepiped. The measurement microphones
arranged three-dimensionally in this manner are denoted by 73a to 73x as illustrated. In
addition, this does not necessarily mean that the number of measurement microphones to be
arranged is different from that in the case of the first closed curved surface 10 by the plane so
far, and a to p may be used as the measurement microphones. it can. In the above description,
the first closed curved surface 10 is circular, but here, for convenience, the same reference
numeral is given also to a solid closed curved surface.
[0120]
09-05-2019
54
And the measurement in this case assumes circular plane 70-1, 70-2, 70-3 in the outer side of
the 1st closed curved surface 10 by the said solid, and measures it for every Direction same as at
the time of recording on these circular planes It arranges and performs the speaker 72 for. That
is, the measurement speakers 72 are disposed in accordance with the arrangement relationship
geometrically equivalent to the recording microphone 71 shown in FIG. A directional speaker
with a directivity of 60 ° is also used as the measurement speaker 72. Also in this case, the
reference numerals of the measurement speakers 72 indicate that the numbers after the first
hyphen indicate the positions of the circular planes 70-1, 70-2, and 70-3, and the numbers after
the second hyphen. Represents another of Direction 1 to Direction 6. Then, the measurement
signal TSP from the measurement signal reproduction device 2 (not shown) is output for each of
the measurement speakers 72, and at this time, each measurement microphone 73a arranged on
the first closed curved surface 10 The impulse response (transfer function H, transfer function
omniH) obtained corresponding to 73x is measured. For example, since there are x measurement
microphones 73 on the first closed surface 10 and 6 × 3 = 18 measurement speakers 72 in this
case, a total of 18 × x transfer functions (H and omniH ) Will be obtained.
[0121]
Although illustration is omitted, in the reproduction environment 11 in this case, the first closed
surface 10 of the same rectangular solid is assumed in accordance with the assumption that the
first closed curved surface 10 is a rectangular solid in the measurement environment 1, and
measurement is also performed in this case The reproduction speakers 8a to 8x are arranged in a
geometrically equivalent arrangement relationship with the measurement microphones 73
arranged in the environment 1. The configuration of a reproduced signal generation device for
generating reproduced signals to be output by the reproduction speakers 8a to 8x is basically the
same as that described with reference to FIG. That is, also in this case, when looking at one
circular plane 70, the reproduced signals to be output from the reproduction speakers 8 by
convoluting the recorded voices with the corresponding synthetic transfer function coefH for the
six Direction from Direction 1 to Direction 6 There is no change in obtaining the above, so the
configuration for that purpose (that is, six audio reproduction units 6 and six sets of operation
units 61 (1a to 1p, 2a to 2p... 6a to 6p)) is further increased by 2 It can be understood as
However, in this case, since the measurement microphones 73 are a to x, the combined transfer
function coefH obtained for each of the measurement speakers 72 is from coefHa to coefHx. That
is, as one set of operation units 61 provided for each of the recorded voices, ones having coefHa
to coefHx set are provided. Similarly, since a to x are also used as the reproduction speaker 8, the
adder 62 is also provided to a to x corresponding to each reproduction speaker 8. Also in this
case, each adder 62 inputs and adds the reproduced signal from the operation unit 61 with the
same subscript, and supplies the result to the reproduction speaker 8 with the same subscript.
09-05-2019
55
Configure.
[0122]
With such a configuration, it is assumed that the recording audio from each recording
microphone 71 is emitted from each reproduction speaker 8 toward each Direction in each of the
circular flat surfaces 70-1, 70-2, and 70-3. A reproduced signal that can be reproduced is output.
As a result, the listener in the first closed surface 10 in the reproduction environment 11 in
which the reproduction speaker 8 is arranged has a human being as a recording target in this
case in the cylindrical space as the virtual sound image position in the measurement environment
1 You will be able to feel as you do. In other words, in the first closed curved surface 10 of the
reproduction environment 11, reproduction can be performed such that a human being as a
recording target is present in the cylindrical space as the virtual sound image position of the
measurement environment 1.
[0123]
Such a method is suitably adopted as a method of after-recording (after-recording) such as
animation and CG. In other words, by recording the voice actor in a cylindrical shape by
enclosing it in the form of a cylinder, recording including the sound of rubbing clothes and
footsteps as well as the voice is performed. Then, as the transfer function to be used, for example,
depending on the relationship between the position where the character is present in the scene
and the space surrounding it, the selection of the measurement environment 1, and further the
virtual sound image position and the first closed surface in it. Select and measure the placement
relationship with 10. Thereby, in the reproduction environment 11, it is possible to reproduce as
if the character exists in the cylindrical space as the assumed virtual sound image position in the
assumed space.
[0124]
Although an example in which the sound source is enclosed in a cylindrical shape is shown here
as an example of surrounding the sound source in a three-dimensional manner, it may be
surrounded in a spherical shape, for example. That is, in this case, the recording microphone 71
is disposed for each Direction defined arbitrarily on the spherical surface surrounding the sound
source to perform voice recording. At this time, in the measurement environment 1, the
09-05-2019
56
measurement loudspeakers 72 may be arranged on the same spherical surface at a position
geometrically equivalent to the arrangement position of the recording microphones 71 and the
same impulse response may be measured. . In addition, as the configuration of the reproduction
signal generation apparatus, in the case where the arrangement numbers of the recording
microphone 71 and the measurement microphone 73 (that is, the measurement speaker 72 and
the reproduction speaker 8) are the same, It becomes the same composition.
[0125]
Furthermore, although the case of measuring the impulse response by arranging a plurality of
measuring speakers 72 has been illustrated here, measurement of the impulse response in the
measurement environment 1 is not limited to arranging a plurality of measuring speakers 72
actually, but one measuring It is also possible to perform the measurement speakers 72
sequentially toward each Direction at each position on the outer periphery of each circular plane
70. Also in this case, it is also possible to reduce the number of measurements by interpolating
the transfer function in the adjacent Direction.
[0126]
3−5. Adding ambience data Here, it is effective to add ambiences other than the performance
sounds that occur at the venue, such as cheering of audiences and applause, in order to
reproduce the sense of presence in events such as live more realistically It is. Here, the method in
the case of performing a more realistic sound field reproduction by adding such an ambience will
be described.
[0127]
FIG. 31 schematically shows the state of the measurement environment 1 in the case of
recording about such an ambience. First, in this case, the recording microphones 84a to 84p are
arranged on the first closed surface 10 at the same number and position as when the
measurement of the impulse response is performed. Also as these recording microphones 84a to
84p, directional microphones are used. Although the microphones for recording 84 and the
microphones for measurement 4 have different reference numerals as microphones disposed at
the same position on the first closed curved surface 10 of the same measurement environment 1,
the same microphones are used It may be
09-05-2019
57
[0128]
Then, as shown in the drawing, a plurality of persons as a plurality of extras are arranged at a
required position outside the first closed curved surface 10 to emit predetermined voices as
ambiences such as cheers and applause, and for each recording The voice is recorded by the
microphone 84. As a result, the recording microphones 84 a to 84 p can record ambience in a
form including the spatial information of the measurement environment 1. Here, the recorded
audio signals of the ambience obtained by the respective recording microphones 84a, 84b,... 84p
will be called ambience-a, ambience-b, ... ambience-p.
[0129]
In the reproduction environment 11, the first closed by sound output of ambience-a, ambience-b,
... ambience-p by the reproduction speakers 8a, 8b, ... 8p disposed on the first closed surface 10.
The listener inside the curved surface 10 can feel as if the spectator is outside the first closed
curved surface 10 in the measurement environment 1.
[0130]
FIG. 32 shows the configuration of the reproduced signal generation device 80 in the case of
adding such an ambience.
Note that this figure shows the configuration of the reproduced signal generation device
corresponding to the case of performing sound field reproduction in consideration of the
directivity of the sound source and the sound emission characteristics for each directivity
direction shown in FIG. As shown in this figure, the ambiences -a, ambiences-b ... ambiences-p
recorded in the measurement environment 1 are reproduced and output by the reproduction
units 81a, 81b ... 81p, respectively. In this case, adders 82a to 82p are further provided at the
subsequent stages of adders 62a to 62p provided in a one-to-one relationship with the
reproduction speakers 8a to 8p, and the reproduction units 81a, 81b,. 81p supplies ambience-a,
ambience-b ... ambience-p to these adders 82a, 82b ... 82p.
[0131]
09-05-2019
58
Thus, the ambiences -a, ambiences-b, ..., ambiences-p are added to the supply lines of the
reproduction signals of the reproduction speakers 8a, 8b, ... 8p and output. That is, in the
measurement environment 1, the ambience-a, the ambience-b, and the ambience-p recorded by
the recording microphones 84a, 84b,... 84p are arranged at geometrically equivalent positions in
the reproduction environment 11. The reproduction speakers 8a, 8b,... 8p output to the inside of
the first closed curved surface 10, respectively. As a result, the listener inside the first closed
surface 10 in the reproduction environment 11 can feel as if the spectator in the measurement
environment 1 is outside the first closed surface 10, giving a more realistic presence. Can.
[0132]
Here, the configuration in the case where the addition of ambience data is applied to a
reproduction signal generation apparatus that performs sound field reproduction in
consideration of the directivity of the sound source and the sound emission characteristics for
each directivity direction as shown in FIG. However, such addition of ambience data can also be
suitably applied to a reproduced signal generation apparatus in the case where sound quality
adjustment is simply performed as shown in FIG. Even in that case, each ambience (a to p) may
be added to the supply line of the reproduction signal of each of the reproduction speakers 8a,
8b,... 8p.
[0133]
3−6. Sound Field Reproduction According to the Camera Viewpoint So far, the case of mainly
reproducing only sound in the reproduction environment 11 has been described. For example, as
content containing a live event of an artist, AV (Audio and Video) content It is also conceivable to
That is, in accordance with this, in the reproduction environment 11, the live recorded audio and
the recorded video synchronized with this are reproduced. Here, as AV content recording live
video, there is one in which a subject (artist) is captured not from only one viewpoint (one angle)
from the beginning but from a large number of angles. As described above, when there is an
image for capturing a subject from a plurality of angles, by performing sound field reproduction
corresponding to each angle, it is possible to give a sense of reality corresponding to each
camera angle.
[0134]
09-05-2019
59
FIG. 33 is a diagram schematically showing the method. FIG. 33 shows the state of the
measurement environment 1 as a hall where an event such as live is actually performed, and FIG.
33 (a) shows a state of image recording by the camera 85 when live is actually performed. Is
schematically shown, and FIG. 33 (b) schematically shows the state of measurement according to
the camera angle. Here, it is assumed that there are a plurality of players on the stage 86, and
their positions are indicated by Position 1 to Position 4 shown in the figure. For example, as
shown in FIG. 33A, when the camera 85 captures an artist on the stage 86, the stage 86 at the
same angle in the hole as the same measurement environment 1 shown in FIG. 23B. The impulse
responses at each position on the stage 86 are measured by the measurement microphones 88a
to 88x arranged to capture the. In FIG. 33 (b), as the first closed surface 10 in the measurement
environment 1 in this case, a three-dimensional space is assumed as in the case of FIG. 30 and
microphones for measuring a to x as in the case of FIG. 88 are arranged. Then, the threedimensional space formed by the first closed curved surface 10 is inclined with respect to the
stage 86 at an angle equivalent to the camera angle in FIG. The impulse response of each of the
measurement microphones 88 is measured for the measurement signal TSP output for each of
the speakers 87 (87-1 to 87-4). As a result, x × 4 transfer functions H and transfer functions
omniH corresponding to the measurement speakers 87 to the measurement microphones 88 are
obtained.
[0135]
Then, at the time of reproduction in the reproduction environment 11, the reproduced sound
signal is convoluted using the transfer function H and the synthetic transfer function coefH
generated from the transfer function omniH corresponding to the scene of the angle, and the
reproduction obtained by this The signal may be output from the reproduction speakers 8a to 8x
arranged so as to have a geometrically equivalent positional relationship with the measurement
microphones 88a to 88x in the measurement environment 1. Thus, the viewer in the first closed
surface 10 surrounded by the reproduction speakers 8a to 8x in the reproduction environment
11 is the same when the image captured on the stage 86 at the angle shown in FIG. 33 is
reproduced. It becomes possible to feel the sound field when viewing the stage 86 at an angle.
[0136]
Furthermore, by performing sound field reproduction by such a method for a plurality of camera
angles assumed, it is possible to make the sound field in the case where the stage 86 is viewed at
each angle be perceived for each camera angle. it can. That is, in this case, measurement of the
09-05-2019
60
transfer function H and transfer function omniH is performed on a plurality of assumed angles
by the same method as that described in FIG. Correspondence information with H,
correspondence information with the camera angle and transfer function omniH are created. At
this time, with respect to the video signal, information of the camera angle for each scene is
embedded as, for example, metadata. Then, at the time of reproduction of the recorded video and
audio, based on the correspondence information of the angle / transfer function H and the
correspondence information of the angle / transfer function omniH based on the angle
information embedded in the video signal, The corresponding transfer function H and transfer
function omniH are selected to generate a combined transfer function coefH, which is set as
needed in the calculation unit to calculate the reproduced audio signal and output it from the
reproduction speakers 8a to 8x. Thereby, for each of a plurality of camera angles in the image, it
is possible to perceive a sound field when the stage 86 is viewed at that angle. If sound field
reproduction can be performed according to each camera angle as described above, it is
preferable because entertainment can be increased.
[0137]
Here, in the measurement of the transfer function H and the transfer function omniH for each
camera angle, a solid is assumed as the first closed surface 10, but it may be replaced by a plane.
Further, in FIG. 33 (b), the measurement speaker for outputting the measurement signal TSP and
the measurement microphone disposed on the first closed curved surface 10 are respectively
attached with the measurement speaker 87 and the measurement microphone 88. However,
these are equivalent to the measurement speaker 35 and the measurement microphone 4 (or the
measurement microphone 24), respectively.
[0138]
<4. Sound Field Reproduction System as Embodiment> 4-1. System Configuration Example
Although the method and configuration for realizing each function as the sound field
reproduction system of the present embodiment have been described above, the method for
realizing these functions and the configuration of the whole reproduction system This will be
described below. Here, for convenience of explanation, the directivity of the sound source and the
sound emission characteristics for each directivity direction as described above with reference to
FIGS. 27 to 30 are not considered, and the stereo effector described with reference to FIGS. The
structure in the case where it does not respond to is demonstrated. The additional configuration
in the case of coping with these will be described later. Here, as a reproduction environment for
actually reproducing a sound field, a reproduction environment 20 as a room of a home or the
09-05-2019
61
like is assumed, and a configuration in the case of performing sound field reproduction on the
second closed curved surface 14 will be described. Further, in this case, it is assumed that three
players (Positions) to be presented as virtual sound image positions are Player 1 to Player 3 and
six directions are defined as the directivity directions of the sound source at each position.
[0139]
First, as a premise, the sound field reproduction system according to the present embodiment
includes recording of various audio and video for creating AV content including live video and its
audio, and transmission for reproducing virtual sound image position. It is divided into a
production side that performs measurement of functions and the like, and a user side that
actually reproduces the sound field in the reproduction environment 11. In this case, the
production side records the recorded video and audio, transfer function and the like on a
required medium, and on the user side, a sound field is generated based on the information
recorded on the medium by a reproduction signal generation device described later. It shall be
reproduced.
[0140]
FIG. 34 is a view showing work steps to be performed on the production side in this case, and a
configuration of a recording apparatus 90 for recording information obtained by these work
steps on the medium 98. First of all, the recording apparatus 90 in this case is respectively angle
/ direction / transfer function H correspondence information, angle / direction / transfer
function omniH correspondence information, reproduction environment / transfer function from
the information obtained by the operation steps S1 to S5 in the figure. Correspondence
information, Ambience data, Line recording data of each Player is generated, Angle / Direction ·
Transfer function H correspondence information generation unit 91, Angle / Direction · Transfer
function omniH correspondence information generation unit 92, Reproduction environment ·
Transfer function correspondence information generation The unit 93 includes an ambience data
generation unit 94 and a line recording data generation unit 95 of each player. In addition, an
angle information / direction instruction information adding unit 96 is provided to add angle
information / direction instruction information to the recorded video obtained by the work
process S6 in the drawing. Furthermore, the angle / Direction / transfer function H
correspondence information generation unit 91, the angle / Direction / transfer function omniH
correspondence information generation unit 92, the reproduction environment / transfer
function correspondence information generation unit 93, the ambience data generation unit 94,
Each data obtained by the line recording data generation unit 95 and the video data to which the
09-05-2019
62
angle information / direction instruction information has been added by the angle information /
direction instruction information addition unit 96 are, for example, media 98 as an optical disc
recording medium or the like. , And a recording unit 97 for recording information. The recording
device 90 is realized by, for example, a personal computer.
[0141]
In FIG. 34, first, in the operation process S1, measurement of the transfer function H is
performed for each position while changing the angle / Direction. This is a work necessary to
realize the control of the directivity direction of the virtual sound image described with reference
to FIGS. 21 to 24 and the sound field reproduction according to the camera angle described with
reference to FIG. In this operation step S1, in the measurement environment 1 such as a hole, the
directional measurement speaker 35 is disposed at each Position (in this case, three positions of
Position 1 to Position 3) assumed as virtual sound image positions, and A predetermined number
of measurement microphones 88 (measurement microphones 4) are arranged on the closed
surface 10 in a predetermined arrangement relationship. At this time, the measurement signal
TSP is output from each measurement speaker 35 while changing the direction of the
measurement speaker 35 to Direction 1, Direction 2... Direction 6 for each position. On the other
hand, the measurement of the impulse response based on the detection result of the
measurement signal TSP by each of the measurement microphones 88 corresponds to each of
the assumed camera angles as shown in FIG. The measurement is performed while changing the
angle of the first closed surface 10 on which the measurement microphone 88 is disposed. As a
result, a plurality of transfer functions H corresponding to each of the measurement
microphones 88 can be obtained for each of the Positions, assuming that each Direction · Angle.
That is, in this case, a transfer function H corresponding to each of the measurement
microphones 88 is obtained by the number of Position number × Direction number × the
assumed number of angles.
[0142]
Here, for convenience of explanation, the number of measurement microphones 88
(measurement microphones 4) disposed on the first closed curved surface 10 of the
measurement environment 1 is not a to x shown in FIG. Suppose that there is. Also in this case,
one measurement speaker 35 is disposed for each position, but one measurement speaker 35
may be sequentially disposed at each position to output the measurement signal TSP.
09-05-2019
63
[0143]
In the recording device 90, the angle / Direction / transfer function H correspondence
information generation unit 91 generates an angle / Direction as shown in FIG. 36 based on the
information of each transfer function H obtained by the operation process S1. Transfer function
H correspondence information is generated. That is, as shown in FIG. 36, the information of the
transfer function H obtained corresponding to each of the measurement microphones 88 when
each angle and each Direction are stored for each Position assumed as the virtual sound image
position is stored. It is a thing. Here too, the suffixes (a to p) of the transfer function H indicate
which of the measurement microphones 88 a to 88 p corresponds to. Also, the numbers
following this subscript indicate the position of Position. Furthermore, the following "ang"
numbers indicate the different angles, and the last "dir" numbers indicate the different directions.
[0144]
Further, in FIG. 34, in the operation process S2, measurement of the transfer function omniH is
performed for each position while changing the angle / Direction. As this operation process S2,
measurement similar to the above-mentioned operation process S1 is performed except that the
microphone used as the measurement microphone 88 is used as the nondirectional measurement
microphone 24. As a result, for each position, a plurality of transfer functions omniH when each
direction and angle is obtained.
[0145]
The angle / direction / transfer function omniH correspondence information generating unit 92
of the recording device 90 generates the angle / direction / transfer function omniH
correspondence information as shown in FIG. 37 based on each transfer function omniH
obtained in the operation process S2. Do. Also in this case, the suffixes (a to p) of the transfer
function omniH indicate which of the measurement microphones 24 a to 24 p corresponds, and
the numbers following the suffix indicate the position of the Position. Further following "ang"
numbers indicate different angles, and the last "dir" numbers indicate different Direction.
[0146]
09-05-2019
64
Further, in FIG. 34, in the operation process S3, the measurement of the transfer function E is
performed while changing the number / arrangement of the measurement microphones 13 of
the second closed surface. In this operation step S3, as shown in FIG. 7 above, on the first closed
surface 10 in the reproduction environment 11, each of the measurement microphones 88 (four)
arranged on the first closed surface 10 in the measurement environment 1 Or, the reproduction
speaker 8 is disposed so that the same geometrical relationship as 24) can be obtained. Then, in
the first closed surface 10 in the reproduction environment 11, the arrangement number and
arrangement relation of the reproduction speakers 18 in the actual reproduction environment
(reproduction environment 20) are assumed to be the arrangement number and the arrangement
relation of the reproduction speakers 18. The impulse response of the measurement signal TSP
output for each of the reproduction speakers 8 is measured while changing the arrangement
number and arrangement relationship of the measurement microphones 13 arranged on the
second closed curved surface 14. Thus, the transfer function E corresponding to each of the
measurement microphones 13 is determined for each arrangement number and arrangement
pattern. Also in this operation step S3, it is possible to measure impulse response by using only
one measurement microphone 13 and sequentially arranging it at the assumed arrangement
position on the second closed curved surface 14.
[0147]
The reproduction environment / transfer function correspondence information generation unit
93 generates transfer function E information for each arrangement number and arrangement
relationship of the measurement microphone 13 obtained in this operation step S3 with
information on each arrangement number and arrangement relationship. Generates
corresponding reproduction environment and transfer function correspondence information.
[0148]
Subsequently, in the work process S4, ambience recording is performed.
That is, as shown in FIG. 31 above, the person as the extra is arranged outside the first closed
curved surface 10 in the measurement environment 1 to emit a predetermined voice as an
ambience such as cheers and applause. This voice is recorded by the respective recording
microphones 84 disposed at the same positions as the measurement speakers 88 disposed on the
first closed curved surface 10 in the previous operation process S1. That is, as described above,
each ambience needs to be recorded at the position of each measurement microphone 88
arranged at the time of measurement of the impulse response. Therefore, the same number of
09-05-2019
65
measurement microphones 88 is used as the recording microphone 84. It is necessary to use and
arrange each of the recording microphones 84 at the same position as the respective
measurement microphones 88 arranged at the time of measurement. In this case, since the
measurement microphones 88a to 88p are used as the measurement microphones 88 as
described above, the recording microphones 84a to 84p are also used as the recording
microphones 84. Although the measurement microphone 88 and the recording microphone 84
have different reference numerals, the same microphone can be used.
[0149]
The ambience data generation unit 94 generates ambience data based on the recorded audio
signals of the respective ambiences recorded in the operation process S4. That is, in this case,
ambience data is generated in which the ambience-a to ambience-p respectively recorded by the
recording microphones 84a to 84p are managed as individual data.
[0150]
In the work process S5, line recording of each player is performed. That is, for example, if the
musical instrument played by the player is an electric musical instrument, an audio signal output
electrically is recorded. Alternatively, in the case other than electric musical instruments such as
vocals and drums, voice recording may be performed by a microphone placed close to the sound
source.
[0151]
The line recording data generation unit 95 of each player generates line recording data for each
player based on each recording voice in the work process S5. That is, in this case, the line
recording audio signals of Player 1 to Player 3 generate line recording data for each Player
managed as individual data.
[0152]
In work process S6, video recording is performed. That is, an event performed in the
09-05-2019
66
measurement environment 1 such as a hole actually measured is video-recorded by the video
camera. The angle information / direction instruction information adding unit 96 has angle
information for indicating which angle is to be selected as the transfer function H and the
transfer function omniH for the recorded video data obtained in the operation process S6, and
Similarly, as the transfer function H and transfer function omniH, Direction indication
information for indicating which Direction should be selected for each Player is added as
metadata. In this case, the angle information is determined by a person on the production side
judging which camera angle each scene corresponds to by actually playing back the recorded
video. The angle information / direction instruction information adding unit 96 adds angle
information to recorded video data based on each scene determined in this manner and
information on the corresponding angle. Similarly, as the Direction indication information, when
there is a scene where the player looks back after actually playing back the recorded video,
Direction such that the person on the production side expresses the direction of orientation
according to the movement of the player. Judge and decide. Then, the angle information /
direction instruction information adding unit 96 adds the Direction instruction information to the
recorded video data such that the Direction instruction information determined in this way is
added to the designated scene.
[0153]
The recording unit 97 includes an angle / direction / transfer function H correspondence
information generation unit 91, an angle / direction / transfer function omniH correspondence
information generation unit 92, a reproduction environment / transfer function correspondence
information generation unit 93, an ambience data generation unit 94, and each player. The
respective data obtained by the line recording data generation unit 95 and the video data to
which the angle information / direction instruction information is added by the angle information
/ direction instruction information addition unit 96 are recorded on the medium 98. At this time,
as the ambience data, since there are a plurality of audio signals from ambience-a to ambience-p,
they are recorded on the medium 98 so as to be separately recorded on separate tracks.
Similarly, with regard to the line recording data of each player, the line recording audio signal for
each player is recorded on a separate track.
[0154]
In addition, if it states for confirmation here, the process number attached | subjected to each
operation process in this FIG. 34 does not necessarily show the order which should perform each
process.
09-05-2019
67
[0155]
FIG. 35 shows the configuration of the reproduction signal generation device 100 used for sound
field reproduction in the reproduction environment 20 on the user side.
Although not shown, as the reproduction environment 20 in this case, five reproduction speakers
18 arranged on the second closed curved surface 14 in the reproduction environment 20 shown
in FIG. It can be considered as 18A, 18B and 18C. Further, in this case, since three virtual sound
image positions are assumed to be Position 1 to Position 3, one virtual sound image position
shown as a measurement speaker 3 by a broken line in FIG. 9 is three. Furthermore, in this case,
since AV content recorded on the medium 98 is reproduced to perform video output, a display
device therefor is arranged in the reproduction environment 20, but this display device is located
inside the second closed curved surface 14. Alternatively, it may be disposed at a position on the
second closed curved surface 14 on the virtual sound image position side as viewed from the
viewer (listener). By arranging the virtual sound image side in this way, the positions at which
each player is displayed on the screen can be made to coincide with the direction of the virtual
sound image position, and the display position of each player and the virtual sound image
position reproduced You can increase your sense of unity. In FIG. 35, the display device is not
shown.
[0156]
In FIG. 35, in the reproduced signal generation device 100 in this case, arithmetic units 46a-1 to
46p-1, arithmetic units 46a-2 to 46p-2, and an arithmetic unit 46a similar to those described in
FIG. -3 to 46p-3 are provided. Here, since Player 1 to Player 3 are assumed, three sets up to
Player 3 out of the four sets up to Player 4 in FIG. 22 are provided. And coefH generation part
30-1 for setting synthetic transfer function coefH to these operation parts 46a-1 to 46p-1,
operation parts 46a-2 to 46p-2, and operation parts 46a-3 to 46p-3. , CoefH generator 30-2, and
coefH generator 30-3. Of the four sets up to Player 4 in FIG. 22, the coef H generation unit 30 is
also provided with three sets up to Player 3. Also in this case, a transfer function H and a transfer
function omniH corresponding to each Position are supplied from the controller 103 described
later to the coefH generation units 30-1, 30-2, and 30-2, and the transfer function is accordingly
performed. H, the transfer function omniH, and the delayed dry transfer function dryH generate a
combined transfer function coefH. Also in this case, as coef H 30, the sign after the hyphen
indicates the difference of each position, and coef H 30-1 receives supply of transfer functions H
and omniH corresponding to Position 1, and generates combined transfer function coef H
corresponding to Position 1. It will be. Then, these are set to the arithmetic units 46a-1 to 46p-1.
09-05-2019
68
Further, the coefH generation unit 30-2 receives the supply of the transfer function H and omniH
corresponding to Position 2 to generate a combined transfer function coefH corresponding to
Position 2 and outputs it to the operation units 46a-2 to 46p-2. It is made to set up. Furthermore,
the coefH generation unit 30-3 receives the supply of the transfer functions H and omniH
corresponding to Position 3 to generate a combined transfer function coefH corresponding to
Position 3, and sets this to the operation units 46a-3 to 46p-3. Will be done.
[0157]
Then, in the subsequent stages of the operation units 46a-1 to 46p-1, the operation units 46a-2
to 46p-2, and the operation units 46a-3 to 46p-3 in which the corresponding combined transfer
functions coefH are set in this manner, respectively. , Adders 47a to 47p are provided. As the
adders 47a to 47p, the outputs from the operation units 46 with the same suffix among the
operation units 46 are added as in the case described above with reference to FIG. As a result,
reproduction signals corresponding to the arrangement positions of the reproduction speakers
8a to 8p on the first closed curved surface 10 are obtained.
[0158]
Further, adders 82a to 82p provided so as to be in a one-to-one relationship with these adders
47a to 47p are provided. These adders 82a to 82p are similar to those shown in FIG. 32 and are
provided to add audio signals as ambiences respectively corresponding thereto.
[0159]
Then, at the subsequent stage, operation units 106A-a to 106A-p, operation units 106B-a to
106B-p, and operation units 106C-a to 106C-p are provided. These operation units 106 are
basically arranged on the second closed surface 14 from the reproduction speakers 8 a to 8 p
arranged on the first closed surface 10 in the same manner as shown in FIG. Although the
transfer function E obtained corresponding to each of the measurement microphones 13 is set,
here, the number of the reproduction speakers 18 arranged on the actual second closed surface
14 as the reproduction environment matching process. In order to correspond to the
arrangement relationship, transfer functions E respectively corresponding to the operation units
106 are set from the controller 103 described later.
09-05-2019
69
[0160]
Arithmetic units 106A-a to 106A-p, arithmetic units 106B-a to 106B-p, and arithmetic units
106C-a to 106C-p have the same suffix (a to p) among the above-described adders 82a to 82p.
The output from the added adder 82 is input and processed based on the set transfer function E.
As a result, in the operation units 106A-a to 106A-p, the microphones for measurement 13A on
the second closed curved surface 14 (reproduction speakers 18A) from the reproduction
speakers 8a to 8p on the first closed curved surface 10 in the reproduction environment 11
Reproduction signals (SHEA-a to SHEA-p) corresponding to the first are obtained, and the
operation units 106B-a to 106B-p reproduce signals (SHEB) corresponding to each of the
reproduction speakers 8a to 8p to the reproduction speaker 18B. -a to SHEB-p) are obtained. In
addition, in the calculation units 106C-a to 106C-p, reproduction signals (SHEC-a to SHEC-p)
corresponding to each of the reproduction speakers 8a to 8p to the reproduction speaker 18C
are obtained.
[0161]
The adders 17A, 17B, 17C have a one-to-one relationship with the reproduction speakers 18 (in
this case, 18A, 18B, 18C) disposed on the second closed surface 14 in the same manner as
shown in FIG. It will be provided as The adder 17A inputs and adds the outputs from the
arithmetic units 106A-a to 106A-p, and supplies the result to the reproduction speaker 18A.
Further, the adder 17B inputs and adds the output from each of the arithmetic units 106B-a to
106B-p, supplies the result to the reproduction speaker 18B, and the adder 17C further
calculates the arithmetic units 106C-a to 106C-. The output from each of p is input and added,
and the result is supplied to the reproduction speaker 18C.
[0162]
Then, the reproduction signal generation apparatus 100 in this case reproduces various
information recorded in the medium 98, and performs a control based on the information, the
media reading unit 101, the buffer memory 102, the controller 103, and the like. A memory unit
104, a video reproduction system 105, and an operation unit 107 are provided. The media
reading unit 101 reads various information recorded on the medium 98 loaded in the
reproduction signal generation device 100 and supplies the read information to the buffer
memory 102. The buffer memory 102 buffers read data and reads buffered data under the
09-05-2019
70
control of the controller 103.
[0163]
The controller 103 is configured by a microcomputer and performs overall control of the
reproduced signal generation device 100. A memory unit 104 comprehensively shows a storage
device such as a ROM, a RAM, and a hard disk included in the controller 103. Although not
shown, various control programs are stored here, and the controller 103 is based on the control
programs. The control of each part is performed. Here, as described above with reference to FIG.
34, for the medium 98, angle / direction / transfer function H correspondence information, angle
/ direction / transfer function omniH correspondence information, reproduction environment /
transfer function correspondence information, ambience Recording data, line recording data of
each Player, and video data in which angle information and Direction indication information are
embedded are recorded. The controller 103 causes the media reading unit 101 to read angle /
direction / transfer function H correspondence information, angle / direction / transfer function
omniH correspondence information, reproduction environment / transfer function
correspondence information from among the above information, As shown, the memory unit 104
stores angle / direction / transfer function H correspondence information 104a, angle / direction
/ transfer function omniH correspondence information 104b, and reproduction environment /
transfer function correspondence information 104c.
[0164]
Furthermore, the controller 103 also causes the media reading unit 101 to read the video data in
which the ambience recording data, the line recording data of each Player, and the angle
information and the Direction indication information are embedded, and buffering this in the
buffer memory 102. Let As shown, ambience-a, ambience-b, ... ambience-p as ambience recording
data are supplied from the buffer memory 102 to the adders 82a, 82b, ... 82p described above. It
has become. Similarly, with regard to the line recording data of each Player, the recording audio
signal of Player 1, the recording audio signal of Player 2, and the recording audio signal of Player
3 are calculated by operation units 46a-1 to 46p-1, and operation units 46a-2 to 46p-2 , And is
supplied to the arithmetic units 46a-3 to 46p-3. Furthermore, the video data in which the angle
information and the Direction indication information are embedded is supplied to the video
reproduction system 105.
[0165]
09-05-2019
71
Here, the buffer memory 102 reads out and buffers video data in which all ambience recording
data recorded on the medium 98, line recording data of each player, and angle information and
direction indication information are embedded. It is also conceivable that the controller 103
controls the read operation of the buffer memory 102 so that the buffered data is continuously
supplied to the corresponding units. However, in practice, it takes a very long time to read and
buffer all the data from the medium 98 in this way, so each data is read out from the medium 98
sequentially only the amount of data necessary for time division. Alternatively, the buffer
memory 102 may be configured to control the read operation of the buffer memory 102 so as to
sequentially supply this to each unit.
[0166]
A video reproduction system 105 comprehensively shows the configuration of a reproduction
system such as a compression / expansion decoder and an error correction processing unit for
video data. The video reproduction system 105 performs reproduction processing by the
compression / decompression decoder, the error correction processing unit, and the like on the
video data supplied from the buffer memory 102 to display a video on a display device (not
shown) arranged in the reproduction environment 20. To generate a video signal for performing,
and supplying it to a display device as a video output shown in the drawing. Also, the video
reproduction system 105 in this case is configured to extract angle information and Direction
indication information added as metadata to the video data, and supply these to the controller
103.
[0167]
The controller 103 stores the angle / direction / transfer function H correspondence information
104 a and the angle stored in the memory unit 104 as described above based on the angle
information and the direction instruction information supplied from the video reproduction
system 105 in this manner. Of the transfer function H and transfer function omniH to be
supplied to the coefH generation units 30-1, 30-2, and 30-3 described above among the /
Direction and transfer function omniH correspondence information 104b. Have. As the angle /
direction changing unit 103 a, transfer function H / transfer function omniH specified by the
input angle information and direction instruction information is stored in the memory unit 104
as angle / direction / transfer function H correspondence information 104 a / angle Read out
from the / Direction / transfer function omniH correspondence information 104b, and set this to
09-05-2019
72
the corresponding coefH generation unit 30. For example, when the angle information indicates
“angle 1” and the Direction indication information indicates that Player 1 (Position 1) indicates
Direction 1, Player 2 (Position 2) indicates Direction 2, and Player 3 (Position 3) indicates
Direction 6. , Angle / Direction / Transfer function H correspondence information 104a · Angle /
Direction / transfer function omniH correspondence information 104b, about Player 1 "Ha1ang1-dir1-Hp1-ang1-dir1 and omniHa1-ang1-dir1-omniHp1-ang1- dir1 ”, Player2“ Ha2-ang1dir2 to Hp2-ang1-dir2 and omniHa2-ang1-dir2 to omniHp2-ang1-dir2 ”, Player3“ Ha3-ang1dir6 to Hp3-ang1-dir6 and omniHa3- Read out ang1-dir6 to omniHp3-ang1-dir6 ". Then, the
above “Ha1-ang1-dir1-Hp1-ang1-dir1 and omniHa1-ang1-dir1-omniHp1-ang1-dir1” are
supplied to the coefH generation unit 30-1, and “Ha2-ang1-dir2-Hp2-ang1”. "-dir2 and
omniHa2-ang1-dir2 to omniHp2-ang1-dir2" are supplied to the coefH generating unit 30-2, and
"Ha3-ang1-dir6-Hp3-ang1-dir6 and omniHa3-ang1-dir6-omniHp3-ang1" are further supplied. "dir6" is supplied to the coefH generation unit 30-3.
By the operation of the angle / direction changing unit 103, each of the arithmetic units 46a-1 to
46p-1, arithmetic units 46a-2 to 46p-2, and arithmetic units 46a-3 to 46p-3 has angle
information, Every time a new angle or direction is instructed as the direction indication
information, the combined transfer function coefH corresponding to the angle or direction is set
sequentially. As a result, sound field reproduction according to the change of the angle and
control of the designated directivity direction of the player can be performed.
[0168]
Note that, for confirmation, the angle / direction changing unit 103a is a block showing the
function of the controller 103, and is actually realized by the software processing of the
controller 103. The same applies to the parameter adjustment unit 103b and the reproduction
environment matching processing unit 103c described below.
[0169]
Further, the controller 103 includes a parameter adjustment unit 103 b shown in the figure, and
each balance parameter setting unit in the coef H generation units 30-1, 30-2 and 30-3
according to the operation input from the operation unit 107 shown The values of the balance
parameters to be set to 21a to 21p, 22a to 22p, and 32a to 32p) are individually adjusted. Also in
this case, the operation unit 107 is provided with operators for parameter adjustment such as a
knob operator corresponding to each balance parameter setting unit, and the user operates them
09-05-2019
73
to set each for each balance parameter. It is possible to indicate the value of the balance
parameter to be. Alternatively, adjustment of each balance parameter can be performed using an
operation panel displayed on the screen of a display (not shown). In this case, the operation unit
107 is an operator such as a mouse. The cursor should be moved to the above operation panel by
mouse operation, and drag operation should be performed on the knob operation icon for
parameter adjustment provided on this operation panel, etc. to set each corresponding to each
balance parameter setting unit. It is made possible to indicate the value of the balance parameter.
The parameter adjustment unit 103 b adjusts the value of the balance parameter to be set
corresponding to each balance parameter setting unit according to the instruction based on the
operation input from the operation unit 107. In addition, although the control line from the
controller 103 to each coefH production | generation part 30 was shown only for convenience of
illustration also here, each balance parameter setting part (21a-21p, 22a to 22p and 32a to 32p)
The values of balance parameters can be supplied independently.
[0170]
According to the adjustment operation of the parameter adjustment unit 103b, as described in
FIG. 17 above, at the stage of the arrangement position of each speaker 8 on the first closed
surface 10, the transfer function dryH system increase region It is possible to adjust the sound
quality such that the sound image is divided into an area where the image is sharpened and an
area where the transfer function omniH system is increased to increase the reverberation. And, in
this case, even in the sound field surrounded by the reproduction speakers 18 disposed on the
second closed curved surface 14, the positions of the speakers 8 on the first closed curved
surface 10 are not limited. Since the sound field is reproduced, even in the second closed curved
surface 14, the listener can perceive it as having the same sound quality adjustment. That is, for
example, taking the adjustment in FIG. 17B as an example, the sound image is sharpened on the
front side and perceived as having an increased reverberation on the rear side also in the second
closed curved surface 14.
[0171]
Further, the controller 103 is based on the reproduction environment / transfer function
correspondence information 104c stored in the memory unit 104 and the arrangement pattern
information 104d stored in advance in the same memory unit 104, the actual number of
arrangement of reproduction speakers 18 And the arrangement relationship, and the
reproduction environment adjustment processing unit 103c for performing the reproduction
environment adjustment processing for setting the transfer function E. Here, the arrangement
09-05-2019
74
pattern information 104 d is information indicating the pattern of the arrangement number and
the arrangement relationship of the reproduction speakers 18 which are preset to correspond to
the reproduction signal generation device 100. The reproduction environment matching
processing unit 103c is stored in association with the corresponding pattern in the reproduction
environment / transfer function correspondence information 104c based on the pattern
information of the arrangement number and the arrangement relationship shown in the
arrangement pattern information 104d. Transfer functions E (Ea-A to Ep-A, Ea-B to Ep-B, Ea-C to
Ep-C) are read, and these are set in the corresponding operation units 106, respectively. As a
result, the transfer function E according to the arrangement number and arrangement
relationship of the reproduction speakers 18 in the actual reproduction environment 20 is set in
each operation unit 106, and as a result, the arrangement number of reproduction speakers 18
in the actual reproduction environment 20 -It is possible to perform appropriate sound field
reproduction according to the arrangement relationship.
[0172]
In addition, when the reproduced signal generation device 100 can cope with the arrangement
number and arrangement relationship of a plurality of patterns, an additional operation element
is provided for the operation unit 107, and the user can select a corresponding pattern from
those patterns. It can also be configured.
[0173]
Here, as described above, the configuration of the sound field reproduction system described the
configuration in the case where the directivity of the sound source and the sound emission
characteristics for each directional direction are not considered, and the stereo effector is not
compatible. In the case of the configuration corresponding to these, the recording device 90 and
the reproduction signal generation device 100 may be configured as follows.
Here, as an example, it is assumed that only the Player 1 performs sound field reproduction in
consideration of the directivity of the sound source and the sound emission characteristics for
each directivity direction, and the line recording data of the Player 2 is through the stereo
effector To illustrate.
[0174]
09-05-2019
75
In this case, on the production side, in the work process S5, the sound is recorded by the
recording microphone 57 disposed so as to surround, for example, the six directions of Direction
1 to Direction 6 as shown in FIG. As for Player 2, the line recording data passed through the
stereo effector is input to the recording device 90. That is, in this case, the line recording data
generation unit 95 of each player generates six recording data of Direction 1 to Direction 6 for
Player 1, and generates two recording data of Lch and Rch for Player 2. Be done. Then, the
recording unit 97 is adapted to record the recorded data on the medium 98.
[0175]
In this case, according to the presence of six recorded data of Player 1 corresponding to
Direction 1 to Direction 6 as the reproduced signal generation device 100, the arithmetic unit 46
inputs the recorded data corresponding to Direction 1 of Player 1 respectively. The units 46 a-1
to 1-46 p-1-1 and operation units 46 a-1 to 2-46 p-1-2 which input recording data according to
the same Direction 2 are added. Similarly, with regard to the recorded data of Direction3,
Direction4, Direction5, and Direction6, calculation units 46a-1-3 to 46p-1-3, calculation units
46a-1-4 to 46p-1-4, and calculation units 46a-1 are also included. 5 to 46p-1-5, and operation
units 46a-1 to 6 to 46p-1-6 are added. Further, these operation units 46a-1-1 to 46p-1-1,
operation units 46a-1-2 to 46p-1-2, operation units 46a-1-3 to 46p-1-3, and operation units 46a1 In order to set the corresponding composite transfer function coefH for −4 to 46 p-1-4,
operation units 46 a-1-5 to 46 p-1-5, and operation units 46 a-1-6 to 46 p-1-6, respectively In
addition, as coefH generation unit 30-1 corresponding to Player 1, coefH generation units 30-11, 30-1-2, 30-1-3, 30-1-4, 30-1-5, 30- Provide six of 1-6.
[0176]
In this case, the operation units 46a-1-1 to 46p-1-1, the operation units 46a-1-2 to 46p-1-2, the
operation units 46a-1-3 to 46p-1-3, and the operation unit 46a-. For 1-4 to 46p-1-4, operation
units 46a-1-5 to 46p-1-5, and operation units 46a-1-6 to 46p-1-6, settings are made according to
angle information only. To change the composite transfer function coefH. In other words, “dir1” is given to the operation units 46a-1-1 to 46p-1-1, “-dir2” is given to the operation
units 46a-1-2 to 46p-1-2, and the operation unit 46a-1- 1. “-Dir3” for 3 to 46 p-1-3, “-dir 4”
for operation unit 46 a-1-4 to 46 p-1-4, “-dir 4” for operation unit 46 a-1-5 to 46 p- 1-5 The
synthetic transfer function coefH by "-dir6" is always set in the calculation units 46a-1-6 to 46p1-6. For this purpose, the angle / direction changing unit 103a in the controller 103 includes the
coef H generating units 30-1-1, 30-1-2, 30-1-3, 30-1-4, and 30-1-. For 5, 30-1-6, transfer
functions H and transfer functions omniH of “-dir1”, “-dir2”, “-dir3”, “-dir4”, “-dir5”
09-05-2019
76
and “-dir6” Among them, the transfer function H / transfer function omniH according to the
angle designated by the angle information is sequentially supplied.
[0177]
Calculation units 46a-1-1 to 46p-1-1, calculation units 46a-1-2 to 46p-1-2, calculation units 46a1-3 to 46p-1-3, calculation units 46a-1-4 The same suffixes (a to p) are given to the outputs of
the 46p-1-4, the calculation units 46a-1-5 to 46p-1-5, and the calculation units 46a-1-6 to 46p1-6, respectively. It is configured to be supplied to the adder 47.
[0178]
Also, two sets of operation units 46 (a to p) corresponding to Lch and Rch are provided as the
operation units 46 that respectively input the recorded data of the Player 2.
That is, calculation units 46a-2-L to 46p-2-L and calculation units 46a-2-R to 46p-2-R are
provided. Furthermore, coefH generation corresponding to Player 2 for setting the composite
transfer function coefH corresponding to each of the calculation units 46a-2-L to 46p-2-L and
the calculation units 46a-2-R to 46p-2-R As the unit 30-2, coefH generating units 30-2-L and 302-R are provided. The angle / direction changing unit 103a changes the setting of the transfer
function H / transfer function omniH according to only the angle information for these coefH
generating units 30-2-L and 30-2-R. For example, when Direction 2 is defined as Lch and
Direction 6 is defined as Rch as shown in FIG. 25 above, “-dir 2” for coefH generation unit 302-L and “-dir 6 for coefH generation unit 30-2-R”. Transfer function H and transfer function
omniH are set at all times. Accordingly, “-dir2” and “-dir6” are set as the combined transfer
function coefH set to the operation units 46a-2-L to 46p-2-L and the operation units 46a-2-R to
46p-2-R, respectively. Then, the synthetic transfer function coefH according to the angle
information is variably set. The adders 47 with the same suffixes (a to p) as outputs from the
arithmetic units 46a-2-L to 46p-2-L and the arithmetic units 46a-2-R to 46p-2-R, respectively.
Configure to be supplied to
[0179]
In the description of FIG. 34 to FIG. 37 up to this point, on the premise of the sound field
reproduction system of the present embodiment, the production side sells media 98 recording
various information necessary for sound field reproduction. Sound field reproduction is
09-05-2019
77
performed on the basis of the medium 98 by the user. However, various types of information
necessary for reproducing the sound field can be provided not only to the user side via the
medium 98, but also, for example, via a network. In this case, on the production side, it is
possible to record and hold various information necessary for reproducing the sound field on a
required recording medium, and transmit the held various information to an external device via
the network. An information processing apparatus is provided. On the other hand, the
reproduction signal generation apparatus 100 on the user side is configured to be able to
perform data communication via the network. Thus, by being able to provide various information
for sound field reproduction via the network, the production side can provide the various
information to the user side in real time, and according to this, the reproduction environment 20
can be provided. It is also possible to reproduce the sound field in the measurement environment
1 in real time.
[0180]
In the above description, the reproduction signal to be output from each reproduction speaker
18 is generated on the user side (reproduction signal generation device 100 side), but instead, on
the production side (recording device 90 side) By providing the configuration for generating the
reproduction signal shown in FIG. 35, the reproduction signal to be output from each
reproduction speaker 18 is recorded on the medium 98, and the reproduction on the medium 98
is performed on the user side. It is also possible to configure so that sound field reproduction can
be performed only by reproducing the signal. According to this, the configuration of the device
provided on the user side can be simplified. However, on the other hand, on the production side,
it is necessary to create and sell a plurality of types of media 98 corresponding to the pattern of
the number and layout relationship of the reproduction speakers 18 assumed in the actual
reproduction environment 20. It will be. On the other hand, according to the sound field
reproduction system of this example described above, only one type of media 98 can be created
on the production side, and efficiency can be improved in this respect.
[0181]
Also, in the description of FIGS. 34 and 35, each angle / Direction / transfer function
correspondence information and reproduction environment / transfer function correspondence
information are recorded in the medium 98 together with recorded data and video data for each
Player. , Media 98 records only recorded data and video data for each player, and it is necessary
for sound field reproduction such as providing each angle / Direction / transfer function
correspondence information and reproduction environment / transfer function correspondence
09-05-2019
78
information via a network It may be configured to provide some of the relevant information via a
network. In particular, with regard to reproduction environment / transfer function
correspondence information, all information other than the information set in the calculation unit
106 is unnecessary information. Therefore, for example, the required server device on the
network holds the reproduction environment / transfer function correspondence information,
and the user side first accesses this server device in sound field reproduction, and the
corresponding reproduction speaker It is configured to download the transfer function E
according to the pattern of the arrangement number and arrangement relationship of eighteen.
As a result, the amount of information recorded on the medium 98 can be reduced, and
unnecessary reproduction of information in the reproduced signal generation device 100 is not
required, thereby eliminating unnecessary read operations and reducing the processing load on
the controller 103. .
[0182]
In FIG. 35, although the arithmetic unit 46, the coefH generation unit 30, the adder 47, the adder
82, the arithmetic unit 106, and the adder 17 are configured by hardware, the functions of these
units are the same as those of the controller 103. It can also be configured to be realized by
software processing.
[0183]
Further, although FIG. 35 exemplifies a case where the reproduction signal generation device
100 is configured to include the reading unit of the medium 98, the reproduction signal
generation device 100 inputs each information read from the medium 98 outside. After that, it
can be configured as an AV amplifier that performs the same operation based on the respective
information.
[0184]
In the above description, the medium 98 is an optical disk recording medium, but it may be
another disk medium (a magnetic disk such as a hard disk or a magneto-optical disk).
Alternatively, other than disk media, such as a recording medium using a semiconductor
memory, can be used.
[0185]
09-05-2019
79
Further, in the above description, the reproduction signal generation apparatus generates a
synthetic transfer function coefH obtained by adding each transfer function (H, omniH, dryH),
and then generates a reproduction signal based on the synthetic transfer function coefH.
Although the arithmetic processing is performed, instead of this, the reproduction signals are
individually convoluted with the respective transfer functions (H, omniH, dryH), and those to
which balance parameters are added are added for each of the reproduction speakers 8a to 8p.
The same sound field reproduction can be realized by doing as well.
In the present invention, the same result can be obtained as a method of adding, for each of the
reproduction speakers 8a to 8p, the one in which the reproduction signal is individually
convoluted with each transfer function as described above. Think of it as intrusive.
[0186]
As mentioned above, although embodiment of this invention was described, as this invention, it
should not be limited to this. For example, in the embodiment, although the present invention is
applied to sound field reproduction in the case of reproducing sound in a film live hall or a room
of a home, the case of reproducing the sound in a car audio system is exemplified. It can apply.
Alternatively, the present invention can be suitably applied to virtual reality industrial devices
such as, for example, a sense of presence, an immersive amusement, and a game.
[0187]
Reference Signs List 1 measurement environment 2 signal reproduction unit for measurement 3,
35, 72, 87 speaker for measurement 4, 13, 24, 73, 88 microphone for measurement 5, 15, 19,
28, 37, 50, 60, 80 , 100 reproduction signal generating device, 6 audio reproduction units, 7, 16,
46, 51, 61, 106 arithmetic units, 8, 18 reproduction speakers, 9, 17, 23, 33, 47, 52, 62, 82
adders , 10 first closed curved surface, 11, 20 reproduction environment, 14 second closed
curved surface, 21, 22, 32 balance parameter setting unit, 25, 40, 53, 103 controller, 26, 39, 54,
107 operation unit, 27,, 30 coef H generator, 29, 38, 55, 104 memory 31 waveform energy
calculation and space delay detector 38a Direction / transfer function H correspondence
information 38b Direction / transfer function omniH correspondence information 51 Tereo effect
processing unit, SR sound source recording surface, 56 sound sources, 57, 71, 84 microphones
for recording, 70 circular planes, 81a to 81p playback unit, 85 cameras, 86 stages, 90 recording
devices, 91 angles / Direction, transfer function H Correspondence information generator, 92
angles / Direction, transfer function omniH correspondence information generator, 93
09-05-2019
80
reproduction environment / transfer function correspondence information generator, 94
ambience data generator, 95 line recording data generator of each Player, 96 angle information,
Direction Instruction information addition unit, 97 recording unit, 98 media, 101 media reading
unit, 102 buffer memory, 103 controller, 103a angle / direction changing unit, 103b parameter
adjustment unit, 103c reproduction environment matching processing unit, 104 memory unit,
104a angle / 104a angle / 104a Direction · Transfer function H correspondence information,
104b Ann Le / Direction-transfer function omniH correspondence information, 104c
reproduction environment and the transfer function correspondence information, 104d
arrangement pattern information, 105 a video reproduction system
09-05-2019
81
Документ
Категория
Без категории
Просмотров
0
Размер файла
131 Кб
Теги
jp2010154549
1/--страниц
Пожаловаться на содержимое документа