close

Вход

Забыли?

вход по аккаунту

?

JPH07107353

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JPH07107353
[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a
compound eye imaging apparatus, and more particularly to a compound eye imaging apparatus
provided with a microphone.
[0002]
2. Description of the Related Art Some image pickup apparatuses such as video cameras have a
microphone for recording sound as well as images. In the case of a VTR integrated video camera
using a zoom lens, for example, stereo is achieved by combining a single directional microphone
and a bidirectional microphone and combining the outputs of both microphones according to the
focal length of the zoom lens. It is designed to get voice. That is, the maximum sensitivity
direction of the unidirectional microphone is directed to the front direction of the imaging device,
and the directivity axis of the bidirectional microphone is disposed in the horizontal plane and
perpendicular to the maximum sensitivity direction of the unidirectional microphone As a result,
the uni-directional microphone outputs the sum signal (L + R) of the left and right voices, and the
bi-directional microphone outputs the difference signal (LR) of the left and right voices. It is
possible to reproduce stereo sound from the sum and difference signals. Furthermore, when the
zoom lens of the imaging device is on the telephoto side, the output of the unidirectional
microphone is emphasized, and when the zoom lens on the wide angle side, the directivity of the
bidirectional microphone is emphasized, so that the directivity according to the change in the
angle of view is An audio signal to be possessed is obtained.
10-05-2019
1
[0003]
By the way, a compound eye imaging apparatus has been developed that captures a common
subject using two imaging systems (for example, two video cameras) and combines two images
obtained by each imaging system to generate one image. There is. In a compound-eye imaging
apparatus, generally, a drive system is provided to rotate each imaging system in order to change
the convergence angle according to the subject distance, but by independently controlling each
imaging system by this drive system It is possible to direct the optical axis to an object that is not
in the front direction of the compound eye imaging device. Furthermore, the optical axes of the
respective imaging devices are made parallel to one another, or the optical axes of the respective
imaging devices are mutually spread on the front side of the imaging device, so that an extremely
wide angle such that one camera can never obtain It is possible to capture an image (panoramic
image) of
[0004]
SUMMARY OF THE INVENTION In the case where a compound-eye imaging apparatus is used by
using two conventional imaging apparatuses with a microphone described above, a panoramic
image can be obtained by simply adding the microphone output of each imaging apparatus.
There is a problem that an audio signal corresponding to the imaging angle of view can not be
obtained.
[0005]
An object of the present invention is to provide a compound eye imaging apparatus capable of
acquiring a sound corresponding to a change in angle of view.
[0006]
According to the present invention, there is provided a compound-eye image pickup apparatus
comprising: first and second video camera units; and light of each of the video camera units by
rotating the first and second video camera units. A compound eye image pickup apparatus
having a drive means for changing the direction of an axis, and a microphone, and an audio
processing means for changing the directivity of the microphone according to the direction of the
optical axis of each video camera unit.
[0007]
Since the audio processing means for changing the directivity of the microphone in accordance
10-05-2019
2
with the direction of the optical axis of each video camera unit is provided, it is possible to
acquire the audio corresponding to the change of the angle of view.
[0008]
In the present invention, the microphone can be commonly provided to the first and second
video camera units.
In addition, as the microphone, one configured by combining a unidirectional microphone and a
bidirectional microphone having a maximum sensitivity direction orthogonal to the maximum
sensitivity direction of the single directional microphone can be used, in this case. The outputs of
the unidirectional microphone and the bidirectional microphone may be combined according to
the crossing angle of the optical axis.
Furthermore, microphone pivoting means for pivoting the microphone may be provided so as to
orient the directional axis of the microphone in the direction of the intersection of the optical axis
of the first video camera unit and the optical axis of the second video camera unit.
[0009]
Next, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is an external perspective view showing a compound eye imaging apparatus according to
an embodiment of the present invention, FIG. 2 is a block diagram showing the configuration of
the compound eye imaging apparatus, and FIG. 3 is a block diagram showing a configuration of
an audio processing unit.
[0010]
In this compound eye imaging apparatus (camera), two left and right video camera units 10R and
10L are stored together in the camera body 13, and a microphone 38 is also attached to the
camera body 13.
10-05-2019
3
The video camera units 10R and 10L are disposed substantially in parallel and in substantially
the same direction, and each of the video camera units 10R and 10L includes an optical unit, a
main unit, an electric circuit unit inside the main unit, and the like. Specifically, the optical unit is
composed of lens groups 1R and 1L constituting a zoom lens. Semiconductor elements using
CCDs are used as the imaging elements 2R and 2L.
[0011]
The camera body 13 further includes terminals 50R and 50L for outputting imaging outputs
corresponding to the video camera units 10R and 10L to a storage device such as a VTR, a
terminal 52 for outputting an audio signal, and the like from the outside Terminals (not shown)
for supplying power and for supplying a remote control signal are provided, and a viewfinder 24
is also provided. The view finder 24 projects an imaging output of one of the video camera units
10R and 10L. The microphone 38 is fixed between the lens groups 1R and 1L of the video
camera units 10R and 10L so as to face in substantially the same direction as the video camera
units 10R and 10L. In addition, the camera body 13 is provided with a master camera selection
switch 25, a camera standby button 27, a zoom operation button 28, a status storage button 31,
a stereoscopic-panorama changeover switch 35, and an initial state selection switch 32 as
operation buttons or switches. It is done. The initial state selection switch 32 initializes the state
of the camera at the time of camera standby or stores the state of the camera at the time when
the status storage button 31 is pressed, and that state is automatically made at the time of
standby It is to return to.
[0012]
Next, the internal configuration of the compound eye imaging apparatus will be described.
[0013]
A right focus motor 8R and a left focus motor 8L are provided to focus the lens groups 1R and
1L of the video camera units 10R and 10L, and the focal lengths of these lens groups 1R and 1L
as zoom lenses are adjusted. A right zoom motor 7R and a left zoom motor 7L are provided on
the rear side.
10-05-2019
4
The lens groups 1R and 1L are respectively provided with apertures 3R and 3L for adjusting the
amount of light received by the imaging elements 2R and 2L. Further, position detection circuits
11R, 11L, 12R, and 12L for detecting the positions of lenses driven by the zoom motors 7R and
7L and the focus motors 8R and 8L are provided. It is supposed to be input. The control unit 15
includes an EEPROM 16 for storing, at the time of manufacture, variations in sensitivity of the
imaging elements 2R and 2L, individual differences between the lens groups 1R and 1L, and
initial values of angles and intervals of the video camera units 10R and 10L. It is connected.
[0014]
A right convergence angle motor 17R and a left convergence angle motor 17L for rotating the
video camera units 10R and 10L in a horizontal plane with the light receiving surfaces of the
imaging elements 2R and 2L as the approximate rotation centers are provided, and each video
camera unit 10R , 10 L are respectively provided with rotation angle detectors 19 R, 19 L, and
the outputs thereof are inputted to the control unit 15. The right video camera unit 10R includes
an adjustment unit 21 that adjusts an interval between the left and right video camera units 10R
and 10L, an interval detection unit 23 that detects this interval and outputs the detected interval
to the control unit 15, and an adjustment unit 21. And an adjusting motor 22 for driving the
motor.
[0015]
A synchronization signal generating circuit 36 for generating a synchronization signal is
provided, and each of the imaging elements 2R and 2L is driven in synchronization with the
synchronization signal. The analog video signals output from the image pickup devices 2R and
2L are input to A / D converters 40R and 40L which respectively convert them into digital video
signals through amplifiers (not shown). These analog video signals are also input to focus
detection circuits 33R and 33L, and detection of the focus state is performed. Specifically, the
focus detection circuits 33R and 33L are for taking out a specific high frequency component (for
example, 1 MHz) of the video signal in a predetermined area in the imaging screen by a band
pass filter, and the amplitude value of the high frequency component Input to section 15.
Focusing is performed by moving the positions of the focusing lenses in the lens groups 1R and
1L by the focusing motors 8R and 8L so that the amplitude of the high frequency component is
maximized.
[0016]
10-05-2019
5
The digital video signals output from the A / D converters 40R and 40L are respectively stored in
the image memories 41R and 41L whose writing and reading are controlled by the
synchronization signal from the synchronization signal generation circuit 36 described above.
The digital video signals stored in the respective image memories 41R and 41L are input to the
image correlation processing unit 46, where correlation calculation of images is performed. An
image combining processing unit 47 that combines the images in the respective image memories
41R and 41L according to the calculation result obtained by the image correlation processing
unit 46 is provided. As described later, this camera (compound eye imaging apparatus) is
provided with a stereoscopic photographing mode and a panoramic photographing mode, and
the image combination processing unit 47 performs panoramic combination of images when
performing panoramic photographing.
[0017]
D / A converters 42R and 42L are provided to convert digital image signals output from the
image memories 41R and 41L or the image synthesis processing unit 47 into analog signals. In
order to switch the input digital image signal between the output of the image synthesis
processing unit 47 and the output of the image memory 41L to the D / A converter 42L
corresponding to the left video camera unit 10L, a stereoscopic / panorama switching switch 35
are connected. The outputs of the D / A converters 42R and 42L are connected to the terminals
50R and 50L, respectively, and are input to the main camera selection switch 25. A viewfinder
24 is connected to the output side of the main camera selection switch 25 so that an image is
displayed on the viewfinder 24 by an image signal output from one of the D / A converters 41R
and 41L. ing. At the time of panoramic photographing, the main camera selection switch 25 is
switched to the left video camera unit 10L side, and the panoramic image synthesized by the
image synthesis processing unit 47 from the signals picked up by the left and right video camera
units 10R and 10L is a viewfinder 24. Can be observed at
[0018]
An audio processing unit 37 that processes an audio signal from the microphone 38 is provided,
and the output of the audio processing unit 37 is connected to the terminal 52. The microphone
38, as shown in FIG. 3, is configured of a unidirectional microphone unit 38M and a bidirectional
microphone unit 38S. Here, the microphone units 38M and 38S operate independently as
microphones, but in order to clarify the distinction from the microphone 38 configured by
10-05-2019
6
combining these, they are called microphone units. The audio processing in the present invention
will be described below.
[0019]
The unidirectional microphone unit has the maximum sensitivity to the sound source at the front
of the microphone, and the sensitivity decreases as the sound source deviates from the front, and
has a directional characteristic such that the sensitivity is theoretically zero at the back There is.
That is, assuming that the front sensitivity of the unidirectional microphone unit is SM and the
angle of the sound source with respect to the front of the microphone unit is α, the sensitivity S
(α) is
[0020]
It is expressed as On the other hand, the bi-directional microphone unit has the maximum
sensitivity to the sound source on the front and back of the microphone, and has the
characteristic that the sensitivity is theoretically 0 in the 90 ° and 270 ° directions. Assuming
that the front sensitivity of the bi-directional microphone unit is SS, and the angle of the sound
source to the front of the microphone unit is δ, the sensitivity S (δ) is
[0021]
It is expressed as There is a case where S (δ) <0, which indicates that the input is a reverse
phase input. FIGS. 4A and 4B show the directivity patterns of the unidirectional microphone unit
38M and the bidirectional microphone unit, respectively.
[0022]
In the microphone 38, the bi-directional microphone unit 38S is disposed at an angle of 90 °
with respect to the unidirectional microphone unit 38M. That is, the maximum sensitivity
directions of both microphone units 38M and 38S are perpendicular to each other. Then, the
front direction of the unidirectional microphone unit 38M is substantially coincident with the
optical axis direction of each of the video camera units 10L and 10R. The directivity pattern of
10-05-2019
7
both microphone units 38M and 38S in the case where the front direction of the unidirectional
microphone unit 38M is the 0 ° direction is shown in FIG. 4 (c).
[0023]
The voice processing unit 37 receives a voice signal from the bidirectional microphone unit 38S
and divides the voice signal into a positive-phase component and a negative-phase component,
and a voice from the unidirectional microphone unit 37M. It is constituted by a gain variable unit
37b which receives a signal and amplifies / attenuates this voice signal. The amplification /
attenuation rate of the gain varying unit 37 b is controlled by a control signal from the control
unit 15. The output of the gain varying unit 37b is added to the positive phase output and the
negative phase output from the phase dividing unit 37a. Then, the positive phase output after
addition becomes the left side output, and the negative phase output becomes the right side
output, and these left side output and right side output are transmitted to the terminal 52.
[0024]
Assuming that the maximum sensitivity directions of both microphone units 38M and 38S are
orthogonal, and assuming that the amplification factor (gain) of the gain variable unit 37b is k
(attenuation if k <1), the right and left outputs are Each
[0025]
It can be expressed as
One directional axis θ (the direction in which the sensitivity is maximized) of the entire
microphone 38 is
[0026]
Can be changed, the pointing axis θ can be changed by changing the amplification factor k.
[0027]
10-05-2019
8
Next, audio processing in an actual camera operation will be described.
As described above, this compound eye imaging apparatus is provided with a stereoscopic
imaging mode and a panoramic imaging mode. First, the stereoscopic shooting mode will be
described.
[0028]
The stereoscopic shooting mode is a mode in which the same subject is shot by the right video
camera unit 10R and the left video camera unit 10L in order to obtain a so-called stereo image.
At this time, as shown in FIG. 5A, optical axes 14R and 14L of both video camera units 10R and
10L intersect in front of the cameras. Further, since the lens groups 1R and 1L are zoom lenses,
the focal length f changes. In this stereoscopic imaging mode, by changing the gain k in the gain
varying section 37b in conjunction with the focal length f, it is possible to obtain a (sound)
pointing axis corresponding to the imaging angle of view. Specifically, the gain k may be
minimized on the telephoto side and may be maximized on the wide angle side, and the gain k
may correspond to the focal distance f in the meantime.
[0029]
When the subject distance changes even if the focal length does not change, it is necessary to
change the direction of the optical axes 14R and 14L so that the intersection position of the
optical axes 14R and 14L coincides with the subject. For example, when the subject approaches
the camera, the video camera units 10R and 10L must be directed inward so that the intersection
angles of the optical axes 14R and 14L become large. Here, the value of the gain k corresponding
to the focal distance f is, for example, in the direction to make the gain k smaller if the subject
distance is smaller than 5 m based on the value of the gain k when the subject distance is set to 5
m. The correction may be made so as to increase the gain k if the subject distance is greater than
5 m. By performing such audio processing, it is possible to obtain audio corresponding to the
imaging screen in the stereo imaging mode.
[0030]
On the other hand, in the panoramic shooting mode, an image with an extremely large angle of
10-05-2019
9
view is to be obtained by combining the images taken by the left and right video camera units
10R and 10L, and in this case, it is shown in FIG. As described above, the optical axes 14R and
14L intersect on the rear side of the camera, and the images at the left and right video camera
units 10R and 10L overlap each other only partially. In the panoramic shooting mode, the gain k
corresponding to the focal length f described above may be corrected so as to increase in
accordance with the intersection angle of the optical axes 14R and 14L on the rear side of the
camera. The interval is ignored because the interval between the video camera units 10R and
10L is sufficiently small compared to the object distance, and the gain corrected according to the
crossing angle is k '. As shown in FIG. 6, the intersection angle of the optical axes 14R and 14L is
γ, and the pointing axis at this time is β. In FIG. 6, dotted lines indicate the front direction of the
camera. すると、
[0031]
となる。 Furthermore, the pointing axis β + γ corrected to the panoramic size is
[0032]
It is expressed as k, SS, and SMh are preset values, and γ is a value changed by the left and right
convergence angle motors 17R and 17L, and is a value obtained from the outputs of the rotation
angle detectors 19R and 19L. Therefore, the corrected gain k 'can be obtained from the above
equation. As described above, even at the time of panoramic imaging, it is possible to obtain a
sound corresponding to the imaging angle of view.
[0033]
The embodiment of the present invention has been described above, but in the above
embodiment, the microphone 38 itself is fixed to the front of the camera, and the pointing axis is
changed by changing the method of combining signals from the microphone units 38M and 38S
having different directivity. The sound corresponding to the angle of view was acquired.
However, in the compound eye imaging apparatus described above, it is also possible to rotate
the left and right video camera units 10R and 10L independently of each other, so each video
camera unit 10R and 10L can be used for an object not located in front of the apparatus. It is
possible to turn. In such a case, the microphone itself may be rotatably attached to the camera
body, and a drive mechanism may be provided to rotationally drive the microphone. In the
10-05-2019
10
stereoscopic shooting mode, the microphones are controlled to be directed in the crossing
direction of the optical axes 14R and 14L of the left and right video camera units 10R and 10L,
and in the panoramic shooting mode The rotation angle of the microphone may be controlled to
be directed to the subject on a line connecting the two.
[0034]
In addition, two microphones may be prepared and attached to the left and right video camera
units 10R and 10L, respectively, to cope with an object not in front of the camera. FIG. 7 is a
block diagram showing the configuration of the audio processing unit 60 when the microphones
38R and 38L are attached to the video camera units 10R and 10L, respectively. Each of the
microphones 38R and 38L is configured by combining a unidirectional microphone unit 38M
and a bidirectional microphone unit 38S, as in the above-described embodiment.
[0035]
The voice processing unit 60 receives two voice signals from the bi-directional microphone units
38S of the microphones 38R and 38L, and separates the voice signal into a positive-phase
component and a negative-phase component. , 61 L and three gain variable parts 62 R, 62 L, 63
whose gains are controlled by the control part 15 respectively. The positive phase output of the
phase division unit 61R corresponding to the right side is input to the gain variable unit 62R, and
the negative phase output of the phase division unit 61L on the left side is input to the gain
variable unit 62L. The third gain variable unit 63 includes an output of the gain variable unit
62R, an audio signal from the unidirectional microphone unit 38M of the right microphone 38R,
an output of the gain variable unit 62L, and a single microphone 38L on the left side. The sum
with the audio signal from the directional microphone unit 38M is input. Then, the output of the
third gain variable unit 63 is divided into two, and one is added with the negative phase output of
the right phase division unit 61R to be the right output, and the other is added with the positive
phase output of the left phase division unit 61L. And left output.
[0036]
The positive phase component from the phase division unit 61R is input to the variable gain unit
62R corresponding to the right side, and the output of the variable gain unit 61R and the voice
from the unidirectional microphone unit 38M of the microphone 38R on the right side are added
10-05-2019
11
Therefore, the directivity axis in the left direction from the front of the right microphone 38R is
variable. As a result, even if the video camera unit 10R on the right side is directed in the
direction away from the subject on the front of the apparatus, the gain of the variable gain unit
62R may be oriented from the rotation angle of the video camera unit 10R on the right With this
gain, it is possible to obtain sound from the front of the device. Similarly, since the signal from
the unidirectional microphone unit 38M of the left microphone 38L is added to the output of the
variable gain unit 62L to which the negative phase component is input from the phase division
unit 61L, the front of the left microphone 38L The pointing axis in the right direction is variable.
Therefore, even when the left video camera unit 10L does not face the front of the apparatus, the
sound from the front of the apparatus can be obtained by setting the gain of the gain varying
section 62L. If the voice from the front of the device is treated as the output of the unidirectional
microphone unit again and input to the gain variable unit 63, the gain of the gain variable unit
63 is changed according to the focal length, and By adding the output of the gain variable unit
63 to each of the negative-phase output of the phase division unit 61R and the positive-phase
output of the left phase division unit 61L, a panoramic image with an extremely wide angle of
view is obtained as in the above embodiment. Even in the case of capturing an image, it is
possible to obtain a voice corresponding to the captured screen.
[0037]
Here, although it is assumed that the microphones 38L and 38R are zoom microphones
combining the unidirectional microphone unit 38M and the bidirectional microphone unit 38S,
each of the video camera units 10R and 10L has a unidirectional microphone unit. The
microphone according to the image pickup angle of view is not used without using the gain
variable unit by rotatably mounting the microphone consisting only of the above and
interlockingly rotating with the crossing angle of the optical axis 14R, 14L of each video camera
unit 10R, 10L. Can be earned.
[0038]
In the above embodiment, the camera is rotated as a means for changing the crossing angle of
the optical axis of each camera, but the crossing angle of the optical axis is also changed by using
an optical element such as a variable apex angle prism. be able to.
In addition, since the mechanical system can be simplified by using the optical element, the
camera can be made smaller and lighter.
10-05-2019
12
[0039]
As described above, according to the present invention, imaging is performed in a compound eye
imaging apparatus by providing a microphone and audio processing means for changing the
directivity of the microphone according to the direction of the optical axis of each video camera
unit. There is an effect that it becomes possible to acquire an audio corresponding to the change
of the angle of view.
10-05-2019
13
Документ
Категория
Без категории
Просмотров
0
Размер файла
24 Кб
Теги
jph07107353
1/--страниц
Пожаловаться на содержимое документа