close

Вход

Забыли?

вход по аккаунту

?

JP2013121000

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2013121000
Abstract: To control the spread of a sound collection range according to the position of a focused
subject. According to one embodiment, a device includes a focusing area identification unit that
identifies an in-focus area focused in a field of view of a lens, and a position of a focusing area
based on the field of view and the position of the focusing area in the field of view. And a sound
collection control unit configured to control the spread of the sound collection range such that
the sound range includes a focusing region within the visual field range. The program is based on
the focusing area identification step of identifying the focusing area focused within the field of
view of the lens, the field of view, and the position of the focusing area within the field of view.
And causing the computer to execute a sound collection control step of controlling the spread of
the sound collection range so as to include the in-focus area. [Selected figure] Figure 3
Device and program
[0001]
The present invention relates to an apparatus and a program.
[0002]
A technique for setting the directivity of sound collection is known (see, for example, Patent
Document 1).
[Prior Art Document] [Patent Document] [Patent Document 1] Japanese Patent Application
03-05-2019
1
Publication No. 2006-287735
[0003]
There is a problem that the spread of the sound collection range can not be controlled according
to the position within the angle of view of the focused subject.
[0004]
In a first aspect of the invention, the device is based on a focusing area identification unit for
identifying a focusing area focused in the field of view of the lens and the position of the field of
view and the focusing area within the field of view. And a sound collection control unit
configured to control the spread of the sound collection range such that the sound collection
range of the sound collection unit includes the in-focus area within the visual field range.
[0005]
In a second aspect of the present invention, the program is based on a focusing area
identification step of identifying a focusing area focused within the field of view of the lens, and
the position of the viewing area and the focusing area within the field of view. And causing the
computer to execute a sound collection control step of controlling the spread of the sound
collection range such that the sound collection range of the sound collection unit includes the infocus area within the visual field range.
[0006]
Note that the above summary of the invention does not enumerate all the necessary features of
the present invention.
In addition, a subcombination of these feature groups can also be an invention.
[0007]
It is a figure which shows an example of the use scene of the imaging device 100 which concerns
on this embodiment.
03-05-2019
2
FIG. 1 is a system configuration diagram of an imaging device 100.
It is a figure which shows typically the directivity of the external microphone 151 and the built-in
microphone 152. FIG. It is a figure which shows an example of the relationship between a focus
control area | region and a sound collection range. FIG. 6 is a diagram showing a series of
operation flows relating to sound collection control by the imaging device 100. It is a figure
which shows the operation | movement flow which selects the microphone used for recording. It
is a figure which shows the example of control of the weighting with respect to a microphone. It
is a figure which shows another example of the relationship between a focus control area |
region and a sound collection range. FIG. 14 is a diagram showing still another example of the
relationship between the angle of view and the focus adjustment area and the sound collection
range. FIG. 8 is a diagram for describing an example of an operation of selecting a microphone
according to the movement of a subject. It is a figure which shows another example of the
relationship between a focusing area | region and a sound collection range.
[0008]
Hereinafter, the present invention will be described through the embodiments of the invention,
but the following embodiments do not limit the invention according to the claims. Moreover, not
all combinations of features described in the embodiments are essential to the solution of the
invention.
[0009]
FIG. 1 is a view showing an example of a usage scene of the imaging device 100 according to the
present embodiment. The imaging device 100 picks up and records sounds around the imaging
device 100 while imaging a subject. The imaging device 100 collects surrounding sound by the
built-in microphone and the external microphone 151 which are different in the range in which
the sound can be collected. The imaging apparatus 100 controls the sound collection range to a
specific range by switching between the built-in microphone and the external microphone 151
and collecting sound according to the position of the focused focus adjustment area. For example,
the imaging device 100 switches between the built-in microphone and the external microphone
151 so as to collect sound from the focused subject.
03-05-2019
3
[0010]
In the present embodiment, the external microphone 151 and the built-in microphone each have
substantial sensitivity in a predetermined fixed angular range centered on the optical axis
direction of the lens of the imaging device 100. That is, it is assumed that the sound collection
range of each microphone is fixed. Also, the external microphone 151 has a stronger directivity
than the built-in microphone. For example, when the focused focus adjustment area corresponds
to the sound collection range of the external microphone 151, the external microphone 151 is
selected and used for recording.
[0011]
According to the imaging device 100, for example, when focusing on a bird, it is possible to
prevent the bark of the bird from being disturbed by the sound generated by the flow of the
river. Therefore, in the angle of view, the sound collection range can be narrowed to the range
where the bird exists. Further, since the sound collection range of each microphone is fixed, the
switching of the sound collection range can be electrically controlled. Thus, no mechanical
switching mechanism is required. For example, it is not necessary to provide a motor or the like
for changing the sound collection range. In addition, since the microphone is automatically
selected in accordance with the focused focus adjustment area, it is possible to prevent the
recording of the operation sound of the operation member and the mechanical drive sound of the
motor and the like.
[0012]
FIG. 2 is a system configuration diagram of the imaging device 100. The imaging device 100
includes an interchangeable lens 120 and a camera body 130. The interchangeable lens 120
comprises a lens mount having a lens mount point 121, and the camera body 130 comprises a
camera mount having a camera mount contact 131. When the lens mount and the camera mount
are engaged and the interchangeable lens 120 and the camera body 130 are integrated, the lens
mount contact 121 and the camera mount contact 131 are connected.
[0013]
03-05-2019
4
The subject image is transmitted through the lens group 122 as a photographing optical system
along the optical axis, and forms an image on the light receiving surface of the imaging element
132. The lens group 122 is controlled by the lens MPU 123. For example, the lens MPU 123
controls the focus lens motor to move the focus lens group constituting the lens group 122. The
imaging element 132 functions as an imaging unit that captures an image of the subject light
that has passed through the lens group 122.
[0014]
The lens MPU 123 is connected to the camera MPU 133 via the lens mount contact 121 and the
camera mount contact 131, and controls the interchangeable lens 120 and the camera body 130
in cooperation with each other while executing communication with each other. The imaging
device 132 as a part of the imaging unit is an element that photoelectrically converts an optical
image that is an object image, and for example, a CCD or a CMOS sensor is used. The subject
image photoelectrically converted by the imaging device 132 is converted from an analog signal
to a digital signal by an A / D converter 134. The exposure control unit 140 outputs control
signals for charge reset and readout timing of the image sensor 132, readout gain and the like
according to the exposure time, exposure cycle and the like given from the camera MPU 133.
[0015]
A subject image as a light reception signal converted into a digital signal is sequentially
processed as image data. The image data converted to a digital signal by the A / D converter 134
is delivered to the ASIC 135. The ASIC 135 is an integrated circuit in which circuits such as an
image processing function and a function of detecting the movement of an object are integrated
into one as described later. The ASIC 135 performs image processing while reciprocating image
data with the SDRAM 136, and stores the image data after image processing in the external
memory 160 such as a memory card. The SDRAM 136 functions as a buffer memory for
temporarily storing image data at the time of image recording and reproduction operations. The
SDRAM 136 is a high-speed readable and writable volatile random access memory. The external
memory 160 is, for example, a non-volatile memory that is detachable from the camera body 130
and is configured by a flash memory or the like.
[0016]
03-05-2019
5
The ASIC 135 converts the image data into image data conforming to the standardized image
format and outputs it. For example, in the case of generating a JPEG file as a still image,
compression processing is performed after image processing such as color conversion
processing, gamma processing, white balance processing and the like is performed and adaptive
discrete cosine conversion is performed. When an MPEG file is generated as a moving image,
intraframe coding and interframe coding are performed on frame image data as continuous still
images generated by image processing, and compression processing is performed.
[0017]
The image data processed by the ASIC 135 generates image data for display in parallel with the
image data processed for storage. The generated image data for display is converted into a
display image signal according to the control of the display control unit 137, and is displayed as
an image on the display unit 138 as a display device such as a liquid crystal display. Further,
various menu items relating to various settings of the imaging device 100 can also be displayed
on the display unit 138 by the control of the display control unit 137 together with or without
displaying the image.
[0018]
The imaging apparatus 100 is controlled by the camera MPU 133 directly or indirectly, including
each element in the image processing described above. The system memory 139 is a non-volatile
memory that can be electrically erased and stored, and is configured of, for example, a flash
ROM. The system memory 139 stores constants, variables, programs, and the like necessary for
the operation of the imaging device 100 so as not to be lost even when the imaging device 100 is
not operating. The camera MPU 133 develops constants, variables, programs, and the like on the
SDRAM 136 as appropriate, and uses them for control of the imaging device 100. The A / D
converter 134, ASIC 135, SDRAM 136, system memory 139, display control unit 137, camera
MPU 133, external microphone 151, built-in microphone 152, external memory 160 in the
camera body 130 are connected by a connection interface 145 including a memory interface. ,
Mutually connected.
[0019]
The camera MPU 133 detects that the operation input unit 141 that receives a user operation
03-05-2019
6
such as a setting operation by the user is operated, and executes an operation according to the
operation. The operation input unit 141 includes a power switch, a release button, various
operation buttons, a touch panel integrally mounted on the display unit 138, and the like. The
camera MPU 133 controls each element of the imaging apparatus 100 to execute the release
operation when the release button is operated. Further, the camera MPU 133 controls each
element of the imaging device 100 to operate according to the menu item displayed on the
display unit 138 and the operation content when the touch panel is operated.
[0020]
The built-in microphone 152 and the external microphone 151 function as a sound collection
unit, convert an electrical signal of sound obtained by collecting surrounding sound into digital
sound data, and output the digital sound data to the connection interface 145. The audio data
generated by the built-in microphone 152 and the external microphone 151 is processed by the
ASIC 135 as audio data corresponding to the image data. The camera MPU 133 records audio
data collected by the microphone in correspondence with image data obtained by imaging, for
example, in the external memory 160.
[0021]
The camera body 130 and the external memory 160 receive power supply from the power
supply 170. The power source 170 is configured of, for example, a secondary battery such as a
lithium ion battery, a household AC power source, etc. that can be attached to and detached from
the camera body 130. The camera MPU 133 controls the power supply to each element by the
power supply 170.
[0022]
The ASIC 135 calculates, from the image data, the contrast amount for one or more image areas,
for example, a plurality of predetermined focus adjustment areas. The position of the focus lens
group is controlled toward the target position determined based on the contrast amount by
control of the camera MPU 133, the lens MPU 123, the focus lens motor and the like. As
described above, with the interchangeable lens 120, the focusing state is detected by the contrast
detection method, and focusing is performed. In addition, with respect to the interchangeable
lens 120, focusing may be performed by detecting a focusing state by a phase difference
03-05-2019
7
detection method. For example, the ASIC 135 detects focus states such as in-focus state, front pin
state, and back pin state in each of a plurality of focus adjustment areas predetermined
corresponding to a specific area of a subject image. In the case of the out-of-focus state such as
the front pin state and the rear pin state, the amount of deviation from the in-focus state is also
detected. Then, the ASIC 135 calculates the movement amount of the focus lens group based on
the deviation amount, and moves the focus lens group by control of the camera MPU 133, the
lens MPU 123, the focus lens motor, and the like. In this way, focusing control is performed on at
least one of the plurality of focusing areas. The functional blocks of the ASIC 135, the camera
MPU 133, and the lens MPU 123 function as a focusing unit for focusing the interchangeable
lens 120 with respect to a focusing area corresponding to a predetermined range in the field of
view of the interchangeable lens 120. . Then, the ASIC 135 for specifying the focus state
functions as a focusing area specifying unit for specifying the focusing area focused in the visual
field range.
[0023]
FIG. 3 schematically shows the directivity of the external microphone 151 and the built-in
microphone 152. As shown in FIG. This figure shows the sensitivity curve when the direction
along the optical axis from the object side is an angle of 0 °. The sensitivity curve 310 shows
the sensitivity curve of the external microphone 151. The sensitivity curve 320 shows the
sensitivity curve 320 of the built-in microphone 152.
[0024]
That is, the external microphone 151 and the built-in microphone 152 have maximum sensitivity
to the sound in the optical axis direction from the object. In addition, the sensitivity decreases as
the angle increases between 0 ° and 90 °, and the sensitivity becomes substantially zero at an
angle of 90 °. Also, in the range of 360 ° to 270 ° corresponding to the angle 0 °, the
sensitivity increases as the angle decreases, and the sensitivity becomes substantially zero at the
angle 270 °. As described above, it is assumed that the external microphone 151 and the builtin microphone 152 have substantially no sensitivity to sound from a position other than the
object side with respect to the imaging direction of the imaging device 100.
[0025]
03-05-2019
8
A line 311 and a line 312 in the figure are lines connecting the position at which the sensitivity is
half the peak value in the sensitivity curve 310 and the microphone position. The size of the
angle formed by the line 311 and the line 312 is used as an index indicating the expansion of the
sound collection range of the external microphone 151. In this example, a sound collection angle
∠ M1 as an index indicating the spread of the sound collection range represents the width of the
sound collection range of the external microphone 151. Similarly, an index indicating the spread
of the sound collection range of the built-in microphone 152 is the size of the angle formed by
the line 321 and the line 322 connecting the position at which the sensitivity is half the peak
value in the sensitivity curve 320 and the microphone position. I assume. In this example, a
sound collection angle ∠ M2 as an index indicating the spread of the sound collection range
represents the width of the sound collection range of the built-in microphone 152.
[0026]
In the drawing, the angle of view ∠ R determined by the interchangeable lens 120 and the
imaging device 132 is shown by the angle between the line 331 and the line 332. In the
description according to the present embodiment, unless otherwise specified, the description will
be made using an angle of view corresponding to the length in the longitudinal direction of the
imaging element 132. The angle of view indicates the field of view range of the interchangeable
lens 120. The angle of view changes depending on the focal length of the interchangeable lens
120. On the other hand, the sound collection range of the external microphone 151 and the
sound collection range of the built-in microphone 152 are fixed. Therefore, the range
corresponding to the sound collection range on the subject image changes according to the angle
of view. On the other hand, focusing of the interchangeable lens 120 is performed in a plurality
of focusing areas set on the subject image. That is, the position of the focus adjustment area on
the subject image does not change according to the angle of view.
[0027]
FIG. 4 shows an example of the relationship between the focusing area and the sound collection
range. The image area 400 is an area of a subject image captured by the image sensor 132. The
subject image in the image area 400 is processed as image data, displayed on the display unit
138, and recorded in the external memory 160. The center of the image area 400 corresponds to
the optical axis of the interchangeable lens 120.
[0028]
03-05-2019
9
AF1 to AF7 correspond to focusing areas set in advance on the subject image. The positions in
the image area 400 of AF1 to AF7 do not change even if the angle of view changes. The ASIC 135
detects the focus state of the focus adjustment areas AF1 to AF7 by a contrast detection method,
a phase difference detection method, or the like. The camera MPU 133 controls the lens MPU
123 to position the focusing lens at a target position determined based on the detected focus
state. By this focusing operation, it is possible to focus on any of the focusing areas of AF1 to
AF7.
[0029]
The external microphone 151 and the built-in microphone 152 have a sound collection angle
centered on the optical axis. A range corresponding to the sound collection angle ∠ M1 of the
external microphone 151 is shown as MA1 in the figure. The external microphone 151 can
collect sound from a subject imaged in the sound collection range MA1. A range corresponding
to the sound collection angle ∠ M2 of the built-in microphone 152 is shown as MA2 in the
figure. The built-in microphone 152 can collect the sound from the subject in the sound
collection range MA2. The radii of MA1 and MA2 change according to the change of the angle of
view.
[0030]
In the angle of view exemplified in this example, MA1 includes AF2 to AF4, AF6 and AF7. That is,
the external microphone 151 can collect the sound from the subject positioned in the direction
corresponding to AF2 to AF4, AF6 and AF7. MA2 includes AF1 to AF7. That is, the built-in
microphone 152 can collect the sound from the subject positioned in the direction corresponding
to AF1 to AF7.
[0031]
The ASIC 135 selects and collects the built-in microphone 152 when it is determined that only at
least one of AF 1 and AF 5 is in focus by the focusing operation. This makes it possible to reliably
record the voice from the focused subject. On the other hand, if the ASIC 135 determines that
neither AF1 nor AF5 is in focus and at least one of AF2 to AF4, AF6 and AF7 is in focus by the
03-05-2019
10
focusing operation, the external microphone 151 is selected. Select and collect sound. As a result,
it is possible to prevent in advance that the sound from the unfocused subject is recorded with a
large sound.
[0032]
In this embodiment, as an index value for selecting any of the external microphone 151 and the
built-in microphone 152, an RM value indicating a value obtained by dividing the sound
collection angle of each microphone by the angle of view 152 R An RF value indicating a value
obtained by dividing the position of the adjustment area by the image width is calculated. For
example, when AF4 is a focus adjustment area in focus, a value obtained by dividing the distance
L1 from the image center to the right end of AF4 by the horizontal width L2 of the image is
calculated as an RF value. If the RF value is smaller than the RM value of the external microphone
151, it indicates that the corresponding focusing area exists inside M1. In this case, the ASIC 135
selects the external microphone 151 to collect sound from the subject corresponding to the
focusing area. Thus, the ASIC 135 determines whether to use the external microphone 151 for
sound collection, based on the comparison result of the RM value and the RF value of the
external microphone 151 having relatively high directivity.
[0033]
As in this example, the built-in microphone 152 includes the sound collection range of the
external microphone 151 and has a sound collection range wider than the sound collection range
of the external microphone 151. When it is determined that only at least one of AF1 and AF5 is
in focus when there is such a relationship of sound collection range, the sound is collected not
only by the built-in microphone 152 but also by the external microphone 151, and the built-in
microphone A sound signal obtained by subtracting the sound signal obtained by the external
microphone 151 from the sound signal obtained at 152 may be used for recording. That is, when
the in-focus area is within the sound collection range of the built-in microphone 152 and outside
the sound collection range of the external microphone 151, the ASIC 135 determines from the
audio signal obtained by the built-in microphone 152 the external microphone 151. The audio
signal obtained in step S may be subtracted. Thereby, it is possible to prevent the sound from the
focused subject from being disturbed by the sound of the subject within the sound collection
range of the external microphone 151.
[0034]
03-05-2019
11
FIG. 5 shows a series of operation flow relating to sound collection control by the imaging device
100. This operation flow is started when the imaging device 100 is ready to start the focusing
operation. The processing of this operation flow operates mainly with the camera MPU 133
unless otherwise described. In step S500, a half-press operation of the release button is waited as
an instruction to start the focusing operation. When the release button is pressed halfway, in step
S502, the focus adjustment operation is started, and shooting of a moving image is started.
Thereafter, the camera MPU 133 controls each part of the imaging apparatus 100 to perform
focus adjustment while capturing an image to be a frame image constituting a moving image at a
predetermined frame rate. In this flow, focusing processing during shooting is mainly described,
and description of the actual shooting operation is omitted.
[0035]
Following the process of step S502, the current focal length of the interchangeable lens 120 is
specified in step S504. In step S506, the ASIC 135 calculates an RM value based on the angle of
view corresponding to the focal length and the sound collection angles of the external
microphone 151 and the built-in microphone 152. Specifically, ∠M1 / ∠R is calculated as the
RM value of the external microphone 151, and ∠M2 / ∠R is calculated as the RM value of the
built-in microphone 152.
[0036]
In step S <b> 508, the ASIC 135 specifies a focused focusing area out of AFs 1 to 7. Specifically,
the ASIC 135 specifies the focused focusing area based on the detection result of the focus state
by the contrast detection method or the phase difference detection method. The ASIC 135 may
specify, as the in-focus area, the plurality of in-focus areas determined to be in-focus based on
the in-focus state detected from each of the plurality of in-focus areas. Then, in step S510, the
ASIC 135 controls the display control unit 137 to cause the display unit 138 to display the infocus area with the frame of the in-focus area, thereby presenting the in-focus area to the user.
[0037]
In step S512, the ASIC 135 selects a microphone to be used for recording from the external
03-05-2019
12
microphone 151 and the built-in microphone 152. Specifically, a microphone to be used mainly
for recording is selected. More specifically, weightings for the external microphone 151 and the
built-in microphone 152 are determined. Details of this process will be described with reference
to FIG. In step S514, the ASIC 135 controls and records the weighting of each microphone
according to the weighting determined in step S512 to generate audio data. The control of
weighting will be described with reference to FIG.
[0038]
In step S516, it is determined whether to end shooting. Specifically, it is determined whether an
operation to end shooting has been performed on the operation input unit 141 or not. If the
operation for ending the shooting has not been performed, the process proceeds to step S504.
The operations from step S504 to step S514 are repeated until an operation to end imaging is
performed. When the shooting end operation is performed, the moving image data obtained by
shooting and the audio data obtained by recording are recorded in the external memory 160 so
as to be reproduced in synchronization with the time of shooting and recording. When the
process of step S518 is completed, the operation flow ends. Note that the camera MPU 133 may
obtain an operation for ending recording as well as the operation for ending shooting. When the
operation of recording end is acquired, the sound collection by at least one of the external
microphone 151 and the built-in microphone 152 may be ended without ending the
photographing.
[0039]
FIG. 6 shows an operation flow of selecting a microphone to be used for recording. That is, the
internal operation of step S512 in FIG. 5 is shown.
[0040]
In step S600, the ASIC 135 determines whether the in-focus area of AF 1 to 7 has changed. For
example, it is determined that the in-focus area is changed when at least one of AFs 1 to 7 has
changed. Specifically, it is determined that the in-focus state is changed when the in-focus state is
changed to the out-of-focus state. In addition, even when the in-focus state is changed to the infocus state, it is determined that the in-focus area has changed. In the subsequent step of this
operation flow, the weighting of the external microphone 151 is set in accordance with the
03-05-2019
13
position of the in-focus area, but in step S600, focusing is performed as compared to when
weighting was previously set It is determined whether the focus adjustment area has changed.
[0041]
If the in-focus area has changed, it is determined in step S602 whether or not a predetermined
time length has elapsed since the in-focus area has been changed. That is, it is determined
whether or not a state in which the focus states of the AFs 1 to 7 have not changed has a
predetermined period of time elapsed.
[0042]
If a predetermined time period has elapsed since the in-focus area changed, the RF value is
calculated based on the position of the in-focus area and the width of the image area in step
S604. If there are a plurality of in-focus areas, an RF value may be calculated for each of the infocus areas.
[0043]
In step S606, the ASIC 135 determines whether the RM value of the external microphone 151 is
larger than the RF value. When there are a plurality of focused focusing areas, the largest RF
value among the plurality of RF values corresponding to each focusing area may be set as the
target of the present comparison.
[0044]
If the RM value of the external microphone 151 is larger than the RF value, the weighting of
recording by the external microphone 151 is set larger than the weighting of recording by the
internal microphone 152 in step S608. If the RM value of the external microphone 151 is equal
to or less than the RF value, the weighting of recording by the built-in microphone 152 is set
larger than the weighting of recording by the external microphone 151 in step S610. When the
processes of step S608 and step S610 are completed, the operation flow ends.
03-05-2019
14
[0045]
If it is determined in step S600 that the in-focus area is not changed, or if it is determined in step
S602 that a certain period has not elapsed, this operation flow ends. As described in this
operation flow, when the focusing state of the focusing area changes, the ASIC 135 focuses on
the focusing area on the condition that the changed focusing state continues for a predetermined
period. Control the spread of the sound collection range so that the sound collection range
includes the range corresponding to. For this reason, it is possible to prevent the weighting of the
recording from changing frequently.
[0046]
FIG. 7 shows an example of weight control for the microphone. The ASIC 135 temporally controls
weighting coefficients for audio signals obtained by the external microphone 151 and the built-in
microphone 152 to temporally control an effective sound collection range and record audio data
for recording. Generate
[0047]
The imaging apparatus 100 performs focus adjustment by detecting the focus state of the
focusing area from the image data at predetermined time intervals. In this example, it is assumed
that the state in which only AF 4 is in focus continues until time t2. Then, after time t3, it is
assumed that only the AF 5 is in focus. That is, it is assumed that the in-focus area is changed
from A4 to AF5. In this case, the weight w1 for the external microphone 151 is controlled to be
larger than the weight w2 for the built-in microphone 152 until time t2. As an example, until
time t2, w1 = 1 and w2 = 0 are controlled.
[0048]
The weighting may be a multiplication value by which the sound signal of each microphone is
multiplied as a gain. For example, assuming that the audio signal obtained from the external
microphone 151 is S1 and the audio signal obtained from the built-in microphone 152 is S2, the
audio signals S1 and S2 are weighted and added by w1 × S1 + w2 × S2. The ASIC 135
03-05-2019
15
generates audio data for recording from the weighted and added audio signal. The ASIC 135 may
generate audio data for recording by obtaining digital audio signals S1 and S2 and performing
weighted addition. The ASIC 135 may perform weighted addition on the analog voice signal. In
this case, the ASIC 135 may obtain an audio signal digitally converted after weighted addition to
generate audio signal data for recording. When w1 = 1 and w2 = 0 as in this example, the sound
obtained by the built-in microphone 152 does not contribute to the sound data for recording, and
the sound obtained by the external microphone 151 is a sound for recording Contribute to data.
[0049]
As described in connection with step S602 and the like in FIG. 6, when the in-focus area is
changed to AF5 at time t3, the ASIC 135 sets a time in which the state in which the AF 5 is in
focus is predetermined. Until elapsed, the weighting factors w1 and w2 are not changed. In the
example of this figure, the value of the weighting coefficient is maintained until time t8. When
the state in which the AF 5 is in focus continues until time t8, the ASIC 135 sets 0 as the target
value of the weighting coefficient w1, and sets 1 as the target value of the weighting coefficient
w2.
[0050]
Then, after time t8, the ASIC 135 changes the weighting coefficients w1 and w2 toward their
respective target values. In this example, the weighting factor w1 is gradually decreased toward
the target value, and the weighting factor w2 is gradually increased toward the target value. As
described above, when the microphone is newly selected as the microphone to collect the sound
according to the change of the position of the in-focus area, the ASIC 135 weights the collection
of the newly selected microphone with respect to the other microphones. Increase the ratio
gradually. The ASIC 135 determines the amount of change per unit time of the weighting factor
so that the weighting factor reaches each target value when a predetermined time length period
has elapsed, and according to the determined amount of change, The weighting factor may be
varied towards the target value. Although the amount of change per unit time of the weighting
coefficient may be changed according to the time elapsed since the start of the change as
exemplified in this example, the amount of change per unit time of the weighting coefficient is a
fixed value It may be The ASIC 135 may change the weighting factors w1 and w2 to satisfy w1 +
w2 = 1.
[0051]
03-05-2019
16
When the weighting factors w1 and w2 reach their respective target values at time t14, the ASIC
135 fixes the weighting factors w1 and w2. By this control, the weighting factor can be
monotonously increased or monotonically decreased. For this reason, it is possible to prevent in
advance that the microphone used for sound collection is switched suddenly when the in-focus
area is changed. Therefore, since it is possible to record audio data such that the sound source
range is gradually switched when reproduced, it is possible to reduce the sense of discomfort
when the user listens to the reproduced sound.
[0052]
FIG. 8 shows another example of the relationship between the focusing area and the sound
collection range. This example shows, for example, the relationship at the TELE end. A sound
collection area 810 shown superimposed on the image area 800 corresponds to the sound
collection angle ∠ M1 of the external microphone 151. In this example, any of the focus
adjustment areas AF1 to AF7 is located within the sound collection range of the external
microphone 151. In this case, the external microphone 151 can be used to record even when any
AF is in focus. In this case, the ASIC 135 selects the external microphone 151 as a microphone to
be used for sound collection. The focus adjustment areas of AFs 1 to 7 are also located within the
sound collection range of the built-in microphone 152 having a wider sound collection range, but
the ASIC 135 is externally attached with a narrower sound collection range as a microphone to
be used for sound collection. The microphone 151 is selected more preferentially.
[0053]
FIG. 9 shows still another example of the relationship between the angle of view and the focus
adjustment area and the sound collection range. This example shows, for example, the
relationship at the WIDE end. A sound collection range 910 shown superimposed on the image
area 900 corresponds to the sound collection angle ∠ M1 of the external microphone 151. The
sound collection range 920 corresponds to the sound collection angle ∠ MR of the built-in
microphone 152. In this example, the focusing areas of AF1 and AF5 are located outside the
sound collection range 920. That is, at angles corresponding to AF1 and AF5, the sensitivity of
the built-in microphone 152 is less than half of the maximum value. In such a case, the ASIC 135
preferentially selects the built-in microphone 152 having a wider sound collection range as a
microphone to be used for sound collection. The ASIC 135 may select a microphone to be used
for sound collection based on the sensitivity to the angle of the external microphone 151 and the
03-05-2019
17
built-in microphone 152. For example, the ASIC 135 may more preferentially select a
microphone that is more sensitive to the angle corresponding to the focused focusing area.
[0054]
FIG. 10 is a diagram for explaining an example of an operation of selecting a microphone
according to the movement of a subject. In the figure, an AF area and a sound collection range
are superimposed on a frame image constituting a moving image.
[0055]
In the frame image 1000, the focusing area of AF 4 is in focus. A sound collection range 1001
and a sound collection range 1002 indicate the sound collection ranges of the external
microphone 151 and the built-in microphone 152, respectively. Since the AF 4 is within the
sound collection range 1001 of the external microphone 151, the ASIC 135 selects the external
microphone 151 having a narrower sound collection range as a microphone to be used for sound
collection.
[0056]
The frame image 1010 is a frame image captured after the in-focus object in the AF 4 starts to
move. A sound collection range 1011 and a sound collection range 1012 indicate the sound
collection ranges of the external microphone 151 and the built-in microphone 152, respectively.
When a motion is detected in the image area in focus, the ASIC 135 selects a microphone to be
used for sound collection according to the motion. Specifically, the ASIC 135 specifies the
position of the in-focus object within the angle of view based on the amount of movement of the
in-focus object, and uses a microphone including the specified position as a sound collection
range as a microphone to be used for sound collection. select. As a motion detection method and
a method of detecting a motion amount, various methods such as a method of detecting a motion
vector between frames of moving image data and between fields, an optical flow method, pattern
matching and the like can be exemplified. The ASIC 135 may detect motion based on at least one
of a color signal and a luminance signal of the image data.
[0057]
03-05-2019
18
In the frame image 1010 of this example, the focused subject is located within the sound
collection range 1011 of the external microphone 151. Therefore, the external microphone 151
including the position of the focused subject as a sound collection range is selected as the
microphone to be used for sound collection. The frame image 1020 is a frame image captured
after the frame image 1010. The sound collection range 1021 and the sound collection range
1022 indicate the sound collection ranges of the external microphone 151 and the built-in
microphone 152, respectively. In the frame image 1020, the in-focus object is located outside the
sound collection range 1011 of the external microphone 151. Therefore, the built-in microphone
152 is selected as a microphone to be used for sound collection.
[0058]
When selecting the microphone according to the movement of the subject, the ASIC 135
calculates an RM value corresponding to the position of the in-focus object in the same manner
as calculating the RM value from the position of the in-focus area. Specifically, the ASIC 135
calculates, as an RF value, a value obtained by dividing the position of the in-focus object by the
width L2 of the image. Then, the ASIC 135 compares the RM value with the RF value in the same
manner as the processing described in connection with step S 606 in FIG. 6 and the like, and
based on the comparison result, either microphone of the external microphone 151 or the builtin microphone 152 is selected. It may be determined whether it should be used for sound
collection. Although the microphone is switched after the predetermined period elapses when the
position of the in-focus area is changed, the predetermined period elapses when the movement is
detected. The microphone used for sound collection may be switched dynamically following the
movement without waiting for
[0059]
As described in the present example, the ASIC 135 functions as a movement specifying unit that
specifies the movement of the subject corresponding to the in-focus area. Then, the ASIC 135
controls the spread of the sound collection range based on the movement of the subject such that
the position of the subject is included in the sound collection range. For this reason, when the infocus object is in motion, sound from an appropriate direction can be collected according to the
motion. Further, even when the subject is not present in any one of the focus adjustment areas
AF1 to AF7, it is possible to collect sound from the direction following the movement of the
subject.
03-05-2019
19
[0060]
FIG. 11 shows still another example of the relationship between the focusing area and the sound
collection range. 1 to 10, for the purpose of describing the invention in an easy-to-understand
manner, both the external microphone 151 and the built-in microphone 152 have been described
as having a sound collection directivity centered on the optical axis. However, at least one of the
external microphone 151 and the built-in microphone 152 may not have directivity of sound
collection centered on the optical axis.
[0061]
In this drawing, a modification using a stereo microphone is shown as an example of a
microphone having no directivity of sound collection centered on the optical axis. Here, in order
to simplify the description, a stereo microphone including two microphones having a single
directivity in a direction parallel to the optical axis will be described. The two microphones are
provided to be separated in the long axis direction of the imaging region. For convenience, these
two microphones are referred to as an L microphone and an R microphone. The L microphone is
located on the left side with respect to the optical axis when the object is viewed from the
imaging device 100, and the R microphone is located on the right side with respect to the optical
axis when the object is viewed from the imaging device 100 It is assumed that
[0062]
In the figure, the sound collection range 1110 of the L microphone and the sound collection
range 1120 of the R microphone are shown superimposed on the image area 1100. For example,
when only the focus adjustment area of AF1 is in focus, the ASIC 135 selects an L microphone
including the position of AF1 in the sound collection range as a microphone to be used for sound
collection. When only the focusing area of AF5 is in focus, the ASIC 135 selects an R microphone
that includes the position of AF5 in the sound collection range as a microphone to be used for
sound collection. In addition, when the focusing area of AF1 and the focusing area of AF5 are in
focus, the ASIC 135 selects the L microphone and the R microphone as microphones to be used
for sound collection. By this control, the position of the sound collection range can be selected.
03-05-2019
20
[0063]
If at least one of the AF3, AF6, and AF7 focusing areas is in focus, the ASIC 135 may select any
microphone. If only the focus adjustment area of AF2 is in focus, the microphone L having high
sensitivity to the sound from the angle corresponding to AF2 may be selected. If only the focus
adjustment area of AF4 is in focus, an R microphone with high sensitivity to sound from an angle
corresponding to AF4 may be selected.
[0064]
In this manner, the ASIC 135 selects one or more microphones so that the focused focusing area
is included in the sound collection range of at least one of the selected microphones. In this
example, by selecting the microphone, it is possible to control the direction of sound collection
directivity within the angle of view. Further, by selecting a plurality of microphones, the width of
the sound collection range can be controlled. When selecting a plurality of microphones, the ASIC
135 may select a combination of microphones in which the superimposed sound collection range
is the narrowest. By controlling at least one of the width of the sound collection range and the
direction of the sound collection directivity in this manner, the spread of the sound collection
range is controlled.
[0065]
This embodiment has been described using a stereo microphone. However, the present control
can be applied to a plurality of microphones provided apart from each other in the direction
orthogonal to the optical axis of the interchangeable lens 120 without being limited to the stereo
microphone. When the in-focus area exists at a position different from the optical axis of the
interchangeable lens 120, the ASIC 135 may select and collect a microphone located on the side
corresponding to the in-focus area among the plurality of microphones.
[0066]
In the above description, the imaging device 100 selects a microphone from the two
microphones, collects the sound, and records the sound. That is, the ASIC 135 controls the
spread of the sound collection range of the sound collection unit including a plurality of
03-05-2019
21
microphones whose sound collection ranges are different from each other and the sound
collection range is fixed. Specifically, the ASIC 135 selects a microphone including a focusing
area in the sound collection range from the two microphones and collects the sound by the
selected microphone. However, the imaging device 100 may select a microphone from among
three or more microphones, collect sound, and record voice. That is, the ASIC 135 collects
focusing areas from among the plurality of microphones in order to control the spread of the
sound collection range of the sound collection unit including the plurality of microphones whose
sound collection ranges are different from each other and the sound collection range is fixed. The
microphone included in the sound range may be selected and collected by the selected
microphone. When there are a plurality of microphones that include the focusing area in the
sound collection range, the ASIC 135 gives priority to selecting a microphone with a narrower
sound collection range. In this manner, the ASIC 135 sets the sound collection range so that the
sound collection range of the sound collection unit includes the in-focus area within the field of
view based on the field of view of the interchangeable lens 120 and the position of the focus area
within the field of view. You can control the spread. Then, when a plurality of focusing areas are
detected, the ASIC 135 may control the spread of the sound collection range by selecting one or
more microphones so as to include the plurality of focusing areas.
[0067]
In the above description, it is assumed that the microphone to be used for sound collection is
selected according to the focused focusing area. However, if the focused focusing area
corresponds to a partial area of the face of the person, the ASIC 135 selects the microphone
including the entire face of the person as the sound collection range as the microphone to be
used for sound collection. Good. That is, when the focused focus adjustment area corresponds to
a predetermined partial area of the subject, the ASIC 135 is a microphone that should use a
microphone including the whole of the predetermined subject as a sound collection range for
sound collection It may be selected as When the predetermined subject is the face of a person,
the ASIC 135 may select a microphone including the person's mouth as a sound collection range
as a microphone to be used for sound collection. The determination as to whether or not it is the
face of a person and the specification of the area of the mouth of the person can be performed by
image recognition such as pattern matching.
[0068]
In the above description, the spread of the sound collection range is controlled in accordance
with the focusing area focused by the automatic focusing. However, in some cases, it is not
03-05-2019
22
necessary to limit the sound collection range to a focused area. For example, when watching a
game such as soccer in a stadium or the like from the spectator seat, even when shooting while
zooming to the shooting player, the stadium is better than the sound from the direction in which
the shooting player is Sometimes you want to collect the sound from the whole. Therefore,
whether to control the spread of the sound collection range according to the focused focus
adjustment area may be set based on the user input. The ASIC 135 may perform the process of
controlling the spread of the sound collection range on the condition that the control of the
spread of the sound collection range according to the focused focus adjustment area is set by the
user operation or the like. Note that whether or not to control the spread of the sound collection
range according to the focused focus adjustment area may be set without depending on the user
input. For example, the ASIC 135 may control the spread of the sound collection range according
to the focused focus adjustment area on condition that the zoom value is less than a
predetermined value. For example, the ASIC 135 controls the spread of the sound collection
range according to the focused focusing area on condition that the zoom value is such that the
sound from the subject within the angle of view substantially reaches the imaging device 100.
May be On the other hand, if the zoom value is so large that the sound from the subject within
the angle of view does not substantially reach the imaging device 100, even if the focused focus
adjustment area is within the range of the external microphone 151. The built-in microphone
152 may be selected as a microphone to be used for sound collection.
[0069]
In the above description, it has not been particularly mentioned that at least one of the position
or the orientation of the imaging device 100 changes. After the user adjusts the focus adjustment
area selected by the user, the user may change the position or the orientation of the imaging
device 100 to take a picture with a composition different from that at the time of focus
adjustment. For example, the user may change the composition by moving the imaging device
100 so that the position of the optical axis changes, changing the orientation of the imaging
device 100 so as to change the direction of the optical axis, or the like. In this case, the ASIC 135
specifies, based on the movement amount including the change in the orientation of the imaging
device 100, which position the focusing area adjusted at the time of focusing corresponds to
within the angle of view after movement. The microphone to be used for sound collection may be
selected so that the specified position is included in the sound collection range. The imaging
device 100 may further include a detector such as a gyro sensor or an acceleration sensor that
detects the amount of movement of the imaging device 100.
[0070]
03-05-2019
23
In the above description, although the imaging device 100 includes the external microphone 151
and the built-in microphone 152 having a wider sound collection range than the external
microphone 151, the imaging device 100 includes the external microphone 151 and the external
microphone 151. The built-in microphone 152 having a narrower sound collection range than
the microphone 151 may be provided. Both the microphones may be built-in microphones, and
both may be external microphones. In addition, although a microphone whose sound collection
range is fixed is used, one or more microphones whose width of the sound collection range is
variable may be used. As a microphone having a variable width of sound collection range, the
zoom characteristic can be obtained by calculating the output signals of a plurality of
microphone units by changing delay or weighting, or the directionality of directivity of a plurality
of microphone units It is possible to apply a zoom microphone of a type that obtains zoom
characteristics by mechanically changing. That is, the imaging apparatus 100 has a microphone
whose width of the sound collection range is variable as the sound collection unit, and the ASIC
135 spreads the sound collection range of the microphone so that the sound collection range
includes the focusing area in the visual field range. May be controlled.
[0071]
In the above embodiment, the imaging device 100 as a single-lens reflex camera, which is an
example of a lens interchangeable type camera, has been described as an example. However, as
the imaging device 100, an interchangeable lens camera other than a single-lens reflex camera, a
non-interchangeable camera such as a compact digital camera, a mirrorless single-lens camera, a
video camera, a mobile phone with an imaging function, and a game device with an imaging
function Etc. can be targeted for application. Further, the processing described in relation to the
imaging device 100 can be realized by the respective units of the imaging device 100, for
example, the camera MPU 133 and the like operating in cooperation with the ASIC 135, the
system memory 139, the SDRAM 136 and the like according to a program. . That is, the
processing can be realized by a so-called computer device. The computer apparatus may load a
program that controls the execution of the above-described processing, operate according to the
read program, and execute the processing. The computer apparatus can load the program by
reading a computer readable recording medium storing the program.
[0072]
Note that the imaging device 100 has been described as an example. That is, the ASIC 135
controls the spread of the sound collection range so that the sound collection range includes the
03-05-2019
24
range corresponding to the focusing area focused by the ASIC 135, the camera MPU 133, and
the lens MPU 123 by focusing. However, the present control is not limited to the imaging device
100, and may be applied to other devices. For example, the control related to the process of
specifying the focusing area described above, the control related to the process of controlling the
expansion of the sound collection area, and the like can be applied as the process of the
binoculars and the telescope.
[0073]
As mentioned above, although this invention was demonstrated using embodiment, the technical
scope of this invention is not limited to the range as described in the said embodiment. It is
apparent to those skilled in the art that various changes or modifications can be added to the
above embodiment. It is also apparent from the scope of the claims that the embodiments added
with such alterations or improvements can be included in the technical scope of the present
invention.
[0074]
The execution order of each process such as operations, procedures, steps, and steps in the
apparatuses, systems, programs, and methods shown in the claims, the specification, and the
drawings is particularly “before”, “preceding” It is to be noted that “it is not explicitly
stated as“ etc. ”and can be realized in any order as long as the output of the previous process
is not used in the later process. With regard to the flow of operations in the claims, the
specification and the drawings, even if it is described using “first,” “next,” etc. for
convenience, it means that it is essential to carry out in this order. It is not a thing.
[0075]
DESCRIPTION OF SYMBOLS 100 imaging device, 120 interchangeable lens, 121 lens mount
contact, 130 camera main body, 131 camera mount contact, 122 lens group, 132 imaging
element, 123 lens MPU, 133 camera MPU, 134 A / D converter, 135 ASIC, 136 SDRAM , 137
display control unit, 138 display unit, 139 system memory, 140 exposure control unit, 141
operation input unit, 145 connection interface, 151 external microphone, 152 internal
microphone, 160 external memory, 170 power supply, 310, 320 sensitivity curve, 311, 312,
321, 322, 331, 332 lines, 400, 1100 image areas, 810, 910, 920, 1001, 1002, 1011, 1012,
1012, 1021, 1022, 1110, 1120 sound collection ranges, 1000, 1010, 10 0 frame image
03-05-2019
25
03-05-2019
26
Документ
Категория
Без категории
Просмотров
0
Размер файла
42 Кб
Теги
jp2013121000
1/--страниц
Пожаловаться на содержимое документа