close

Вход

Забыли?

вход по аккаунту

?

JPH05153688

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JPH05153688
[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a
sound pickup system for recording sound and a reproduction system for reproducing the picked
up sound. In particular, the state of the original sound is reproduced more faithfully as a real
sound image The present invention relates to a possible sound collection method and its
reproduction method.
[0002]
2. Description of the Related Art Various recording methods and reproduction methods have
been proposed and tried as to how to faithfully reproduce (reproduce) sounds such as sounds
and sounds having spatial spread as real sound images. In particular, there is a demand for more
faithful reproduction of sound as well as three-dimensional reproduction of the image in a threedimensional television or the like. For example, “Intensity stereo method, which is a general
sound collection and reproduction method, collects sound using a large number of microphones
and adds information such as level differences and time differences to a plurality of
predetermined channels, for example, N channels. The sound is distributed and recorded, and at
the time of reproduction, a sound image is generated by N speakers arranged at a predetermined
position. In addition, a binaural sound pickup reproduction method and a one-point sound pickup
reproduction method are also known.
[0003]
10-05-2019
1
SUMMARY OF THE INVENTION Since all of the conventional sound collecting and reproducing
methods represented by the above-described examples reproduce a virtual sound image, it is still
possible to achieve the original purpose of generating a real sound image. Can not. As a result,
there is still a problem caused by the virtual sound image, for example, the reproduction position
of the sound is limited, the image of the sound is not formed when the position is shifted, and the
real feeling is not obtained when approaching the position of the virtual sound image.
[0004]
Generally speaking, the generation of a real-sound image is not limited to merely picking up or
reproducing, but naturally it is necessary to consider the overall conditions from the picking up
process to the reproduction process. For this purpose, it is necessary to consider the method of
recording the sound collection and the editing method. An object of the present invention is to
solve the problems in the above-described conventional sound collection and reproduction
method, and to provide a sound collection method and a sound reproduction method in the
process from sound collection to its reproduction in order to generate a real sound image.
[0005]
SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, according to
the present invention, there is provided a sound collecting method comprising: sound detecting
means for detecting sounds from a plurality of sound sources; an arrangement position of the
plurality of sound detecting means; Position information providing means for providing the
position information of the sound source or any one of the position information, and means for
simultaneously multiplexing and recording corresponding position information in addition to the
detected sound signals in a plurality of independent audio channels. . Preferably, the sound
collection system of the present invention further comprises sound source dimension providing
means for providing the sizes of the respective sound sources, and the sound source dimensions
are also multiplexed and recorded on the audio channel together with the sound signal and
position information. Also preferably, the sound collection system according to the present
invention further comprises the sound source and the sound detection means, or the directivity
providing means for providing the directivity of either one, and the directivity is also multiplexed
and recorded.
10-05-2019
2
[0006]
Further, according to the reproduction method of the present invention for reproducing
information collected by the above-described sound collection method, sound signals multiplexed
and recorded in a plurality of independent audio channels, the sound source position of these
sound signals and the arrangement position of sound detection means Or means for reading out
one of the position signals, and means for comprehensively adjusting the amplitude and delay
time of the plurality of read sound signals to generate a real sound image based on the read
position signals. And speaker means for outputting the adjusted sound signal as sound.
Furthermore, according to the reproduction method of the present invention, sound signals
multiplexed and recorded in a plurality of independent audio channels, sound source positions of
these sound signals and arrangement positions of sound detection means or any one position
signal, and the above sound signals Means for reading out the dimensions of the sound source,
and means for comprehensively adjusting the amplitude and delay time of the plurality of read
sound signals to generate a real sound image based on the read position signal and the
dimensions of the sound source And speaker means for outputting the adjusted sound signal as
sound.
[0007]
The reproduction system according to the present invention is characterized in that sound
signals multiplexed and recorded in a plurality of independent audio channels, sound source
positions of these sound signals and arrangement positions of sound detection means or any one
position signal, sound source of the sound signals Means for reading out the dimensions and
directivity of the sound source and the directivity of the sound detection means, and the above
read out to generate a real sound image based on the read position signal, the size of the sound
source and the directivity It has means for comprehensively adjusting the amplitudes and delay
times of a plurality of sound signals, and speaker means for outputting the adjusted sound
signals as sound.
[0008]
Further, according to the present invention, there is provided a method for implementing the
above-described sound collecting method and reproducing method.
That is, according to the sound collection method of the present invention, a plurality of detected
sounds and a position signal indicating the position of the sound source of the detected sound
10-05-2019
3
and the arrangement position of the sound detection means or the position signal of any one
Simultaneously multiplex and record. Further, according to the reproduction method of the
present invention, a sound signal recorded in an independent audio channel and a position signal
indicating a sound source position and / or a sound detection position of the sound signal are
read out, and based on the position signal. In order to reproduce a real sound image, the
amplitude, delay time and the like of the sound signal are adjusted based on the position signal,
and the adjusted sound signal is output as sound.
[0009]
In addition to the recording of the sound signal, the position of the sound source and the
arrangement position of the sound detecting means are also multiplexed and recorded in each
audio channel. Since the sound signal and its positional relationship correspond to each other,
the editing and reproduction of the sound for generating a real sound image in consideration of
the positional relationship of a plurality of sound sources and the arrangement position of the
sound detection means in the editing and reproduction stages. Is possible. Adding the size of the
sound source makes the generation of the real sound image more accurate. If directivity is
further added, generation of a real sound image can be realized more accurately. In the
reproduction method of the present invention, a real sound image is generated based on the
position signal, the sound source size, and the directivity.
[0010]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a block diagram of a
sound collection apparatus as a first embodiment of a sound collection system (system or
apparatus) of the present invention. The sound collection device shown in FIG. 1 will be
described in relation to a specific example, for example, when performing live collection of a
performance at a concert venue.
[0011]
Generally speaking, the processing of sound is, for example, the position, size, sound collecting
microphone position, sensitivity characteristics of a sound source to be picked up and
reproduced, such as a performance sound of a concert, an engine sound in a car stadium, etc.
How can we generate a real-sound image, taking as a whole a series of related items such as
10-05-2019
4
sound collection conditions such as directivity, editing method and its device conditions,
reproduction method, and performance of the device used for sound processing From the point
of view, the conditions in each process will be determined again. This sound collection device
collects sounds from the plurality of sound sources so as to be able to reproduce a real sound
image in consideration of editing and reproduction.
[0012]
In FIG. 1, in addition to a plurality of musical instruments such as a piano 1 and a violin 3 as
sound sources to be collected, sounds from the audience at the concert hall 5 exist in the concert
hall. The sound collection device shown in FIG. 1 detects the sound from the piano 1, the first
microphone 11 that detects the sound from the piano 1, the Mth microphone 12 that detects the
sound from the violin 3, and the sound from the venue 5 (M + 1 ) The microphone 14 to the Nth
microphone 15). Also, the sound pickup device includes a first position detection device 21 that
provides information indicating the position of the first microphone 11 and an Mth position
detection device 22 that provides information indicating the position of the Mth microphone 12.
Have. Furthermore, the sound collection device has a first multiplexer 31, a second multiplexer
32, and a sound collection signal processing storage device 40.
[0013]
The first microphone 11 is disposed in the vicinity of the piano 1, detects a sound mainly using
the piano 1 as a sound source, and outputs the detected sound to the first multiplexer 31.
Similarly, the M-th microphone 12 is disposed in the vicinity of the violin 3 and detects a sound
that mainly uses the violin 3 as a sound source. The first position detector 21 outputs the
position of the piano 1, and the Mth position detector 22 outputs the position of the violin 3. The
position information provided from the first position detecting device 21 and the Mth position
detecting device 22 is, for example, a relative position in the orthogonal coordinate system with
the position of the conductor of the concert hall 5 as the origin of the coordinate position. Or
shown as an absolute position. In addition, these pieces of position information are not limited to
orthogonal coordinates, but may be represented by a polar coordinate system. Musical
instruments such as the piano 1 and the violin 3 in the concert hall are usually disposed at fixed
positions in the concert hall 5. Thus, in this example, the first position sensing device 21 and the
Mth position sensing device 22 provide positioning position signals of the fixed piano 1 and the
violin 3. The position information of the sound from the audience at the concert hall 5 is set in
the sound pickup signal processing storage device 40 as the position information of the whole
hall.
10-05-2019
5
[0014]
The first multiplexer 31 multiplexes (multiplexes) the microphone detection sound signal S1
detected by the first microphone 11 and the microphone position information detection signal
MP1 from the first position detection device 21. Similarly, the second multiplexer 32 multiplexes
the microphone detection sound signal SM from the Mth microphone 12 and the microphone
position information detection signal MPM from the Mth position detection device 22. These
multiplexed signals are input as input multiplexed signals IM1 and IM2 to the pickup signal
processing storage unit 40 and recorded at positions corresponding to the respective audio
channels. As described above, the microphone detection sound signal S and the corresponding
microphone position information detection signal MP are recorded in the same audio channel in
a multiplexed state.
[0015]
The sound signal and position signal are multiplexed in the first multiplexer 31 and the second
multiplexer 32 by, for example, a frequency multiplexing method suitable for analog signal
processing or a time multiplexing method suitable for digital signal processing. . The frequency
multiplexing method will be described with reference to FIG. As is well known, the frequency
band of audible sound is about 16 Hz (or about 20 Hz) to about 2000 Hz. A frequency band is
used for multiplexing the microphone detection sound signal S, and a frequency band outside
this frequency band is used for multiplexing the microphone position information detection
signal MP. As the frequency band of the microphone position information detection signal P, as
indicated by the broken line, a frequency band below the frequency 16 HZ or as indicated by the
solid line, the frequency band of 2000 HZ or more is used. The time multiplexing process will be
described with reference to FIG. The microphone detection sound signal S and the microphone
position information detection signal P are divided in time series and multiplexed for each of a
plurality of audio channels.
[0016]
Although multiplexing in the first multiplexer 31 and the second multiplexer 32 can be easily
time-multiplexed to perform digital processing, the frequency multiplexing is also considered to
be a price factor, the first multiplexer 31 and the second multiplexer 32 It is somewhat difficult
10-05-2019
6
to do individually. Therefore, when frequency multiplexing is performed, the microphone
detection sound signal S and the microphone position information detection signal MP may be
once input to the collected signal processing and storage unit 40 and frequency multiplexed in
the collected signal processing and storage unit 40. . Further, time multiplexing processing may
be performed in the collected signal processing and storage unit 40. In any case, the sound
pickup signal processing and storage unit 40 multiplexes the sound signal and the corresponding
position signal for each sound channel and outputs the multiplexed signal as the output
multiplexed signals OM1 and OMM.
[0017]
In this embodiment, of the N channels of audio channels in total, the M channel is used as the
multiplexed signal, and the remaining (N-M) channels are not multiplexed from the voice signal
processing and storage unit 40. Output. Therefore, the sound pickup signal processing and
storage unit 40 receives the microphone detection sound signals SM + 1 and SN of the (M + 1) th
microphone 14 to the Nth microphone 15, and outputs them without multiplexing as they are.
The (M + 1) th microphones 14 to the Nth microphones 15 are disposed at various places in the
concert hall 5 to detect the sound of the entire audience in the concert hall 5 in this embodiment.
These sounds are usually used to give a sense of reality, but are not particularly associated with
position information, and are used as background sounds.
[0018]
Recording to the N channel audio channel in the collected signal processing storage device 40 is
stored for each independent audio channel on various recording media, such as recording on a
magnetic tape, recording on an optical disk, recording on a semiconductor memory, etc.
Remember as. The stored signal for each audio channel stored in the storage medium in the
collected signal processing storage device 40 is edited in the editing device 50 as needed and
reproduced in the sound reproducing device 100. In the editing process in the editing apparatus
50, since the sound signal and the position signal are multiplexed and stored for each sound
channel, it is possible to perform a voice editing operation to which spatial signal processing is
added. In addition, sound information including the position information stored in the sound
collection device can be directly reproduced by the sound reproduction device 100 without the
editing operation. Alternatively, a signal obtained by multiplexing sound information and position
information for each audio channel and a signal not to be multiplexed are directly output to the
sound reproduction device 100 without storing it in the storage medium in the sound collection
signal processing storage device 40, It is also possible to play directly in the playback device
10-05-2019
7
100. The reproduction process in the sound reproduction apparatus 100 will be described later.
[0019]
In the above-described embodiment, the dimensions (sizes) of sound sources such as the piano 1,
the violin 3 and the concert hall 5 are added to the microphone detection sound signal S and the
microphone position information detection signal MP and multiplexed to obtain more
information. It is suitable for information editing processing and reproduction to form a real
sound image.
[0020]
Furthermore, the directivity of the piano 1, the violin 3 or the like, or the directivity of the first
microphone 11 and the M-th microphone 12, etc. is added to the microphone detection sound
signal S, the microphone position information detection signal MP, the size of the sound source.
Multiplexing is suitable for editing and playback as well as adding source dimensions.
[0021]
As provision of position information in the first position detection device 21 and the M-th
position detection device 22, in addition to providing the sound source position as position
information, the arrangement positions of the first microphone 11 and the M-th microphone 12
Also provide.
Alternatively, as the position information, the arrangement positions of the first position
detection device 21 and the M-th position detection device 22 are provided as position
information.
By storing accurate position information together with sound information in this manner, it is
possible to form a more accurate real sound image through editing processing and reproduction
processing.
[0022]
In this embodiment, the sound is collected at the concert hall 5, the piano 1, the violin 3 and the
10-05-2019
8
like are at fixed positions, and the arrangement positions of the first microphone 11 and the Mth
microphone 12 are also fixed. Therefore, in this embodiment, the position information indicating
the above-mentioned arrangement relationship is set in advance in the collected signal
processing storage device 40 without using the first position detection device 21 and the M-th
position detection device 22. , And the first position detection device 21 and the M-th position
detection device 22 may not be provided. However, the position information set above is
superimposed on the microphone detection sound signal S from the first microphone 11 and the
M-th microphone 12 in the collected sound signal processing storage device 40. Since the
position information is fixed, the method of superimposing the position information may be to
store the information in each voice channel in the head portion or the like without always
multiplexing.
[0023]
FIG. 4 shows a sound pickup apparatus as a second embodiment of the sound pickup system of
the present invention. The sound collection device is particularly adapted for recording when the
sound source is moving. As an example of moving a sound source, there is a case where a singer
having a microphone sings while moving on the stage in a performance hall. As described above,
in sound collection when the singer having the first microphone 11 is moving, it is preferable to
detect the position of the singer using the first position detection device 21 of the wireless
system. .
[0024]
In FIG. 4, the first microphone 11 is not fixed near the piano 1 as shown in FIG. Also, the Mth
microphone 12 is owned by another moving singer. The sound from the piano 1 (not shown) is
detected by the (M + 1) th microphone 14, and the sound from the violin 3 is detected by the Nth
microphone 15. Ultrasonic waves are emitted from the first position detection device 21
integrated with the first microphone 11 held by the moving singer, and the ultrasonic wave
reception devices disposed at various places in the concert hall 5 Receives the ultrasonic wave
and reports it to the microphone position detection device 35 by radio waves or the like. The
microphone position detection device 35 detects the radio wave to detect the position of the first
microphone 11. Similarly, ultrasonic waves are emitted from the Mth position detection device
22 integrated with the Mth microphone 12, and the position of the Mth microphone 12 is
detected through the microphone position detection device 35. it can. As the position detection in
the microphone position detection device 35, other methods such as a method of emitting radio
waves from the first position detection device 21 and positioning the position from the strength
10-05-2019
9
of the received radio waves at two or more distant positions are taken. be able to.
[0025]
In this example, the positions of musical instruments such as piano 1 and violin 3 not shown in
FIG. 4 are fixed. Therefore, the positions of these musical instruments are stored in advance as
fixed position information in the collected sound signal processing storage device 40, and the
position of the first microphone 11 held by the moving singer indicates the microphone position
from the microphone position detection device 35 The information detection signal MP1 and the
microphone detection sound signal S1 from the first microphone 11 are multiplexed in the first
multiplexer 31 or the collected signal processing storage device 40. In this case, as described
with reference to FIG. 1, the microphone detection sound signals SM + 1 to SN from the (M + 1)
th microphone 14 to the Nth microphone 15 are not multiplexed.
[0026]
The multiplexing in the first multiplexer 31 and the second multiplexer 32 or the sound pickup
signal processing storage device 40 is the same as that in the first embodiment. Also in the sound
pickup apparatus of the second embodiment, similarly to the first embodiment, the information
of the sizes of the sound sources such as the singer, the piano 1 and the violin 3, the microphone
or the directivity of these sound sources is added The signal S can be multiplexed.
[0027]
FIG. 5 shows the configuration of a sound reproduction apparatus as an embodiment of the
reproduction system of the present invention. This sound reproducing apparatus comprises a
first sound reproducing system 110, a second sound reproducing system 120 and a third sound
reproducing system 130, and a speaker system 140. Although the case where there are N audio
channels in the above-described sound collecting system has been described, FIG. 5 will be
described only for four independent channels for the sake of illustration.
[0028]
10-05-2019
10
The first sound reproduction system 110 includes a decoder 111, a signal delay circuit 112 and
an amplitude adjustment circuit 113, a signal delay circuit 114 and an amplitude adjustment
circuit 115, a signal delay circuit 116 and an amplitude adjustment circuit 117, a signal delay
circuit 118 and It consists of four parallel sound adjustment circuits consisting of an amplitude
adjustment circuit 119. The circuit configurations of the second sound reproduction system 120
and the third sound reproduction system 130 are also similar to those of the first sound
reproduction system 110. The speaker system 140 includes the signal addition circuit 141, the
power amplification circuit 142 and the speaker 151, the signal addition circuit 143, the power
amplification circuit 144 and the speaker 152, the signal addition circuit 145, the power
amplification circuit 146 and the speaker 153, and the signal addition. It comprises a circuit 147,
a power amplification circuit 148 and a speaker 154.
[0029]
In the first stage of the first sound reproduction system 110, the second sound reproduction
system 120, and the third sound reproduction system 130, each sound channel is used as a
storage medium in the sound collection signal processing storage device 40 illustrated in FIG.
There is provided a circuit for separating out the multiplexed sound signal and the position signal
and separating them into independent position information detection signals P1, P2, P3 and
microphone detection sound signals S1, S2, S3, respectively. , Not shown. Alternatively, in the
case where the multiplexed signal is directly applied to the sound reproduction apparatus 100
from the sound collection signal processing and storage unit 40 shown in FIG. 1, a circuit for
separating the multiplexed signal may be provided. Furthermore, the sound collecting method
and the reproducing method according to the present invention can be integrally configured, in
which case the signals of the first microphone 11 and the Mth microphone 12 and the first
position detection device 21 and the Mth The signal of the position detection device 22 can be
used directly without being multiplexed. In the following description, it will be described how
signal readout separated position information and microphone detected sound signals are used
for reproduction.
[0030]
FIG. 6 shows the arrangement of the speakers of the speaker system 140 shown in FIG. 6 (A)
shows a front view of the speaker system 140, and FIG. 6 (B) shows a cross-sectional view
thereof. In this example, M speakers are arranged in a concave shape. The speaker arrangement
itself is proposed by Olson (e.g., Olson, translated by Nishimaki, "Sound Engineering", 1959). In
this speaker system, if a large number of speakers are arranged in an array and the amount of
10-05-2019
11
delay of the signal to be added is adjusted to create a sound wave focus at one point in space, a
very high sound pressure is synthesized at one point near the listener In this point, a situation
occurs as if an actual sound source exists, and the auditory psychology is also based on the
ground that the position is perceived as a sound image (for example, Komiyama et al., “The
perspective of the sound image for stereoscopic television "Development of control technology",
NHK Giken R & D, February 1991, No. 2, pages 10-14). Although only four speakers 151 to 154
are shown in FIG. 5, generally speaking, M speakers are disposed as shown in FIG.
[0031]
The decoder 111 changes the delay amount of the signal delay circuits 112, 114, 116 and 118
to which the microphone detection sound signal S1 is applied from the actual position
information detection signal P1 multiplexed and inputted. Further, the decoder 111 adjusts the
amplitudes of the microphone detection sound signals delayed in the signal delay circuits 112,
114, 116 and 118 in the amplitude adjustment circuits 113, 115, 117 and 119. The amount of
delay based on the position information in the signal delay circuit 112 is determined based on
the position of the sound source and the position of the microphone, or any one of the position
information. How to use the position information of the sound source and the position
information of the microphone is defined in accordance with the object, conditions, purpose and
the like of sound collection and reproduction. When sound reproduction processing is performed
using actual position information as described above, reproduction sound areas 161, 162, and
163 are generated at positions corresponding to the existence positions of the real sound image.
[0032]
In the above-described sound collecting apparatus, when the sizes of the sound sources are also
multiplexed, the decoder 111 adjusts the amplitude adjustment circuits 113, 115, 117, 119 in
consideration of the position information according to the size of the sound source and as
necessary. Vary the amount of amplitude adjustment for each of This makes it possible to
generate a more accurate real-sound image.
[0033]
Similarly, when the directivity is multiplexed in the sound collection device, the decoder 111
calculates the delay amount and the amplitude adjustment amount based on the directivity to
obtain the signal delay circuits 112, 114, 116 and 118, and the amplitude adjustment circuit.
Adjust 113, 115, 117, 119.
10-05-2019
12
[0034]
In the above-described reproduction method, an example has been described in which the delay
amount and the amplitude amount are adjusted independently for each audio channel, but in the
present invention, the sound signal and position information of each channel, and further From
the overall viewpoint of sound reproduction by adding information such as directivity, the delay
amount of each signal delay circuit in each sound reproduction system 110, 120, 130, and the
amplitude adjustment amount of each amplitude adjustment circuit To define.
This overall adjustment may be performed in the editing apparatus 50 at the editing stage, or
coefficients may be calculated according to position information, the size of a sound source, etc.,
and each system may be adjusted with the coefficients.
[0035]
As described above, according to the sound collection method of the present invention, in
addition to sound collection, at least position information corresponding to the collected sound is
multiplexed for each sound channel. , It becomes possible to generate a real sound image in
editing and reproduction at a later stage. Further, according to the sound collection method of
the present invention, it is possible to realize a real sound image further by multiplexing the size,
directivity, etc. of the sound source to the position information and multiplexing the sound
information. Furthermore, according to the reproduction method of the present invention, since
the sound is reproduced using a plurality of speakers based on the signals collected by the
above-described sound collection method and multiplexed for each audio channel, a real sound
image can be generated. It becomes.
10-05-2019
13
Документ
Категория
Без категории
Просмотров
0
Размер файла
25 Кб
Теги
jph05153688
1/--страниц
Пожаловаться на содержимое документа