close

Вход

Забыли?

вход по аккаунту

?

JP2007302155

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2007302155
An on-vehicle microphone device capable of rapidly determining a direction of directivity is
provided. A height h of a headrest 80a detected by a height position sensor 42, an angle θ of a
backrest 80b detected by an angle sensor 43, and an anteroposterior position m of a seat 80
detected by an anteroposterior position sensor 44 Read (S1). The driver's mouth position is
calculated using the height h, the angle θ, and the longitudinal position m (S2). Based on the
calculated mouth position, a microphone element having a directivity direction closest to the
mouth position is specified (S3). Adjust the amplifier in the microphone array processing unit 35
so that the gain of the microphone element having the directivity direction of the intersection
point b5 closest to the mouth position (black circle mark a) becomes higher than the gain of the
other microphone elements (S4) . [Selected figure] Figure 2
In-vehicle microphone device and directivity control method thereof
[0001]
The present invention relates to an on-vehicle microphone device that outputs voice detected by
a microphone mounted on a vehicle, and a directivity control method thereof.
[0002]
Conventionally, a microphone having single directivity is often used as a car-mounted
microphone (hereinafter, also simply referred to as a microphone).
04-05-2019
1
FIG. 14 is a view showing the vicinity in the front of the vehicle on which the conventional invehicle microphone is mounted. In the map lamp section 101 in the front of the vehicle, a
unidirectional microphone 102 whose directivity direction is fixed is installed. FIG. 15 shows the
directivity of the microphone 102. As shown in FIG. The microphone 102 is installed so that the
directivity direction (broken line in the figure) is directed to the driver. In this state, the voice
emitted by the driver is well detected by the microphone 102.
[0003]
There is also known a microphone in which a plurality of microphones are installed and the
directivity direction is narrowed in the direction of the target speaker. FIG. 16 is a diagram
showing directivity direction control in another conventional in-vehicle microphone device. The
on-vehicle microphone device analyzes a voice signal detected by each microphone element
using a microphone array having a plurality of microphone elements. Based on the result of this
analysis, the direction of the speaker is detected, and the directivity of the microphone array is
narrowed so as to follow the direction.
[0004]
Further, as another on-vehicle microphone device, there is known a system in which positions of
speakers are specified by a microphone array, and different voices emitted by a plurality of
speakers are recognized for each speaker (see Patent Document 1). In addition, although not for
use in vehicles, various devices using directional microphones are known (see Patent Documents
2, 3, and 4). JP-A 2003-114699 JP-A 4-240 898 JP-A 5-83 784 JP-A 11-289592
[0005]
However, the above-described conventional in-vehicle microphone device has the following
problems. That is, as in the former case, when the directivity direction is fixed, a level difference
occurs in the audio signal detected by the microphone depending on the position of the speaker.
For this reason, when it used for audio | voice control, the signal input into vehicle equipment
disperse | distributed and audio | voice control became unstable.
[0006]
04-05-2019
2
Also, as in the latter case, when speech signals detected by a plurality of microphone elements
are analyzed, the direction of the speaker is identified based on the result of this analysis, and the
directivity direction is directed to the speaker, the speech It takes a certain amount of time to
detect the position of the person and determine the directivity direction. Therefore, the level of
the output signal became unstable until the directivity direction was determined. Furthermore,
when voice is emitted from another position such as a passenger seat, it is expected that it will
take more time and increase unstable time in order to specify the direction of the required
speaker.
[0007]
Then, this invention aims at providing the vehicle-mounted microphone apparatus which can
determine the directivity direction made into a goal promptly, and its directivity control method.
[0008]
In order to achieve the above object, an in-vehicle microphone device according to the present
invention is an in-vehicle microphone device having a microphone mounted on a vehicle and
outputting a voice detected by the microphone, wherein the seat in the vehicle Mouth position
detecting means for detecting the mouth position of a person seated on the face, and a direction
for aiming at the detected mouth position, and determining directivity direction control for
controlling the directivity direction of the microphone in the determined direction And means.
[0009]
Thus, by detecting the mouth position, it is possible to quickly determine the target directivity
direction.
That is, the directivity direction can be determined from the mechanical positional relationship
without performing processing such as sound source search.
Therefore, stable voice control can be performed. Further, since the driver adjusts the seat
position before driving, the directivity characteristic can be stabilized without changing during
driving.
04-05-2019
3
[0010]
Further, the mouth position detection means is provided with a headrest position acquisition
means for acquiring a position of a headrest provided on the seat, and the mouth position is
detected from the acquired position of the headrest.
[0011]
As described above, since the position of the head of the person is in a fixed positional
relationship with the seat and the headrest, the position of the mouth can be easily detected.
[0012]
Further, the headrest position acquisition means includes a seat position detection means for
detecting a longitudinal position of the seat movable back and forth along a rail, and an angle
detection means for detecting an angle of a backrest of the seat, The position of the headrest may
be calculated using the detected front-rear position and the angle.
[0013]
According to this configuration, the position of the headrest can be easily calculated.
[0014]
Further, the headrest position acquisition means includes height detection means for detecting
the height of the headrest, and calculates the position of the headrest using the detected height
in addition to the longitudinal position and the angle. It is characterized by
[0015]
With this configuration, the position of the headrest can be determined more accurately.
[0016]
Further, the headrest position acquisition means is provided on a member separate from the
signal generation means provided on the headrest and the seat, receives the signal emitted from
the signal generation means, and receives the position of the headrest. And a position detecting
means for detecting.
[0017]
04-05-2019
4
With this configuration, the position of the headrest can be easily detected.
[0018]
The image pickup apparatus may further include a photographing unit for photographing toward
the seat, and the mouth position detection unit may detect the mouth position from the
photographed image.
[0019]
With this configuration, the position of the mouth can be detected without preparing a special
seat.
[0020]
Further, the mouth position detecting means detects the mouth position from an image
photographed at the time of focusing by the photographing means.
[0021]
With this configuration, it is possible to accurately and quickly determine the target directivity
direction.
[0022]
Further, the photographing means comprises a plurality of cameras, and the mouth position
detecting means detects the mouth position based on distance information calculated from stereo
images photographed by the plurality of cameras. .
[0023]
This configuration enables more accurate calculation of the mouth position.
[0024]
In addition, the microphone has a plurality of microphone elements having directivity directions
different from one another, and the directivity direction control means adjusts the magnitudes of
the signals output from the respective microphone elements to obtain It is characterized in that
the directivity direction is controlled.
04-05-2019
5
[0025]
This configuration can improve the responsiveness of directivity control.
[0026]
The directivity control method of a car-mounted microphone device according to the present
invention is a directivity control method of a car-mounted microphone device having a
microphone mounted on a vehicle and outputting a sound detected by the microphone, A mouth
position detecting step of detecting a mouth position of a person seated in the seat, and a
direction for aiming at the detected mouth position, and controlling directivity of the microphone
in the determined direction And a direction control step.
[0027]
According to the in-vehicle microphone device according to the present invention, since the
position of the head of the person is in a fixed positional relationship with the seat or the
headrest, the position of the mouth is detected to quickly determine the directivity direction. it
can.
That is, the directivity direction can be determined from the mechanical positional relationship
without performing processing such as sound source search.
Therefore, stable voice control can be performed.
[0028]
Further, since the driver adjusts the seat position before driving, the directivity characteristic can
be stabilized without changing during driving.
[0029]
Further, since the driver's mouth position is detected in synchronization with the focus (focusing)
information of the in-vehicle shooting camera, the target directivity direction can be determined
accurately and promptly.
[0030]
04-05-2019
6
DETAILED DESCRIPTION OF THE INVENTION Embodiments of the in-vehicle microphone device
and the directivity control method of the present invention will be described with reference to
the drawings.
The in-vehicle microphone device of the present embodiment is applied to a voice control system
mounted on a vehicle.
[0031]
First Embodiment FIG. 1 is a diagram showing a configuration of a voice control system
according to a first embodiment.
The voice control system 1 mainly includes a voice control unit 5 having a CPU unit 7, a D / A
converter 10, an A / D converter 11, a voice recognition unit 13, a hands free unit 14, a device
control unit 15, and the like. .
[0032]
The CPU unit 7 has a known CPU, ROM, RAM, etc., and controls various in-vehicle devices
according to the input audio signal.
A speaker 21 is connected to the D / A converter 10 and outputs an audio signal input from the
D / A converter 10.
An on-vehicle microphone device 20 is connected to the A / D converter 11, and the input audio
signal is output to the A / D converter 11.
[0033]
04-05-2019
7
The voice recognition unit 13 recognizes a voice signal input through the A / D converter 11, and
generates various signals such as a control signal based on the recognized voice signal.
A mobile phone 61 is connected to the hands free unit 14, and the hands free unit 14 provides a
hands free function by the mobile phone 61 in accordance with the control signal generated by
the voice recognition unit 13.
Various in-vehicle devices 51 such as a car navigation system and a car stereo are connected to
the device control unit 15, and the device control unit 15 controls the in-vehicle devices 51
according to the control signal generated by the voice recognition unit 13.
[0034]
FIG. 2 is a view showing the configuration of the in-vehicle microphone device 20. As shown in
FIG.
The in-vehicle microphone device 20 is configured around the voice control unit 30.
The voice control unit 30 has a microphone array processing unit 35 and the like in addition to
the well-known CPU 31, the ROM 32, the RAM 33, and the I / O interface 34 connected via the
bus 36.
[0035]
The microphone array processing unit 35 is connected to a microphone array 41 including a
plurality of microphone elements 41a, 41b,..., 41n having directivity directions different from
each other.
The microphone array 41 is provided in a map lamp portion (not shown) or the like in the upper
front of the vehicle interior.
04-05-2019
8
The plurality of microphone elements 41a, 41b,..., 41n are installed so as to have single
directivity in which the front direction is the maximum detection sensitivity.
[0036]
The microphone array processing unit 35 can individually adjust the gain of the audio signal
detected by each microphone element, and performs directivity control of the microphone array
41 by individually adjusting and combining each gain.
[0037]
The height position sensor 42, the angle sensor 43 and the front and back position sensor 44 are
connected to the I / O interface 34.
FIG. 3 is a view showing a seat on which a driver is seated.
A seat (driver's seat) 80 on which a driver is seated is movable in the front-rear direction along a
frame 81 provided at the lower part thereof.
The front and back position sensor 44 is provided to detect the front and back position of the
seat 80.
[0038]
In addition, the backrest 80b of the seat 80 can be fixed at any angle around the axis 82.
The angle sensor 43 is provided to detect the angle of the backrest 80b of the seat 80.
Further, the height of the headrest 80a of the seat 80 can be switched stepwise.
The height position sensor 42 is provided to detect the height of the headrest 80 a of the seat 80.
04-05-2019
9
[0039]
Next, the positional relationship between the seat and the microphone array is shown.
FIG. 4 is a diagram showing the positional relationship of the seat in an imaginary plane (x-y
plane in FIG. 3) passing through the center in the left-right direction of the seat.
Here, in order to simplify the description, it is assumed that when the driver is seated on the seat
80, the driver's mouth position is approximately at the height 1/2 of the headrest.
[0040]
Of course, it is preferable to calculate the mouth position more strictly from the shape of the
headrest and the like. Assuming that the point O is the origin, the position of the seat 80 in the
front-rear direction is m, the length of the backrest 80b is L, and the height of the headrest 80a is
h, coordinates (x, y) of the mouth position are It can be obtained by equation (1). x = m + (L + h /
2) cos θ y = (L + h / 2) sin θ (1)
[0041]
FIG. 5 is a view showing the relationship between the directivity direction synthesized by the
plurality of microphone elements 41a, 41b,..., 41n constituting the microphone array 41
arranged in the map lamp portion and the virtual plane of FIG. is there. The figure (A) shows the
positional relationship between the microphone array 41 and a virtual plane, and the figure (B)
shows an intersection of directivity directions synthesized by the microphone elements 41a, 41b,.
b1 to b9 are indicated by "x" marks. The coordinates of the intersection points b1 to b9 on the
virtual plane are calculated in advance and stored in the ROM 32 in the voice control unit 30.
Also, the black circle mark a in the virtual plane represents the position of the driver's mouth.
[0042]
04-05-2019
10
The directivity control of the microphone device for vehicles which has the above-mentioned
composition is shown. FIG. 6 is a flowchart showing a directivity control process procedure. The
processing program is stored in the ROM 32 in the voice control unit 30, and is executed by the
CPU 31 at predetermined intervals. First, the height h of the headrest 80a detected by the height
position sensor 42, the angle θ of the backrest 80b detected by the angle sensor 43, and the
longitudinal position m of the seat 80 detected by the longitudinal position sensor 44 are read
Step S1).
[0043]
The driver's mouth position is calculated according to the above-mentioned equation (1) using
the read height h, angle θ, and longitudinal position m (step S2). Based on the calculated mouth
position, a direction in which directivity is synthesized closest to the mouth position is specified
as a direction for aiming the mouth position (step S3).
[0044]
As shown in FIG. 5B, the point in the directivity direction closest to the mouth position (black
circle mark a) is an intersection point b5. Therefore, the amplifier in the microphone array
processing unit 35 is adjusted so that the gain of the microphone element having the directivity
direction at the intersection point b5 becomes higher than the gain of the other microphone
elements (step S4). After this, this processing ends.
[0045]
Here, only the gain of the microphone element having the directivity direction of the intersection
point b5 is set high, but the method of adjusting the gain of each microphone element in the
microphone array processing unit 35 is not particularly limited. For example, a plurality of
microphone elements close to the intersection may be identified, and the microphone element
closer to the mouth position may be set to have a higher gain from these and be set to be
gradually lower as it goes away.
04-05-2019
11
[0046]
Furthermore, the gains of the individual microphone elements may be adjusted more finely in
order to closely approach the directivity direction in a direction that aims at the mouth position
calculated in step S2. These are the same as in the following embodiments.
[0047]
As described above, according to the in-vehicle microphone device of the first embodiment, since
the position of the driver's head is in a fixed positional relationship with the seat and the
headrest, the mouth position is determined from the position of the seat and the headrest. It is
possible to detect and quickly determine the directivity direction closest to the direction of the
mouth position. That is, the directivity direction can be determined from the mechanical
positional relationship without performing processing such as sound source search. Therefore,
stable voice control can be performed. Further, since the driver adjusts the seat position before
driving, the directivity characteristic can be stabilized without changing during driving.
[0048]
In the above embodiment, the mouth position is calculated by the formula (1) using the height h
of the headrest, the angle θ of the backrest, and the front / rear position m of the seat, but a
table created in advance is referred It may be acquired by In the above embodiment, it is
assumed that the driver is seated on the seat, leans on the backrest, and contacts the back of the
head to the headrest, but depending on the angle of the backrest, the back of the head may A
state of being separated from the headrest is also fully assumed. In such a case, it is preferable to
calculate the mouth position further considering the angle of the backrest.
[0049]
Second Embodiment In the second embodiment, a signal from a signal generation source
incorporated in the headrest is received, the position of the headrest is specified from the
received signal, and the position of the driver's mouth is detected. The case of performing
directivity control is shown. The configuration of the voice control system in the second
embodiment is the same as that of the first embodiment, and thus the description thereof is
04-05-2019
12
omitted.
[0050]
FIG. 7 is a view showing the configuration of the on-vehicle microphone device 120 in the second
embodiment. The same components as those in the first embodiment are given the same
reference numerals, and the description thereof will be omitted. A two-dimensional position
sensor 71 is connected to the voice control unit 30, and the two-dimensional position sensor 71
detects the position of the electromagnetic wave generation unit built in the headrest 80a. FIG. 8
is a view showing the arrangement of the headrest 80a and the two-dimensional position sensor
71 as viewed from above in the vehicle. An electromagnetic wave generator 75 is incorporated in
the headrest 80a.
[0051]
On the other hand, the two-dimensional position sensor 71 is formed in a plate shape whose
longitudinal direction is the longitudinal direction, and is provided on the inner side wall on the
right side of the driver's seat so as to face the headrest 80a. Then, the two-dimensional position
sensor 71 detects the position (the position on the xy plane in FIG. 3) by the electromagnetic
wave generated by the electromagnetic wave generation unit 75.
[0052]
FIG. 9 is a flowchart showing the directivity control process procedure. The processing program
is stored in the ROM 32 in the voice control unit 30, and is executed by the CPU 31 at
predetermined intervals. First, the position of the electromagnetic wave generator 75, that is, the
position of the headrest 80a is detected from the signal received by the two-dimensional position
sensor 71 (step S11). Here, in order to simplify the description, it is assumed that the position of
the electromagnetic wave generator 75 incorporated in the headrest 80a is substantially at the
mouth.
[0053]
04-05-2019
13
Then, as in the first embodiment, the microphone element having the directivity direction closest
to the mouth position is specified (step S12). The amplifier in the microphone array processing
unit 35 is adjusted so that the gain of the specified microphone element becomes higher than the
gain of the other microphone elements (step S13). After this, this processing ends.
[0054]
The signal generation source is not limited to the electromagnetic wave generation unit, but may
be a near infrared light emission unit, an ultrasonic wave generation unit, etc. In that case, the
two-dimensional position sensor is capable of detecting the respective signals. A sensor is used.
[0055]
Third Embodiment In the third embodiment, the inside of the driver's seat is photographed using
an in-vehicle photographing camera, and the directivity control is performed by detecting the
mouth position of the photographed driver. Show.
The configuration of the voice control system is the same as that of the first embodiment, so the
description thereof will be omitted.
[0056]
FIG. 10 is a diagram showing the configuration of the on-vehicle microphone device 220 in the
third embodiment. The same components as those in the first embodiment are given the same
reference numerals, and the description thereof will be omitted. The on-vehicle microphone
device 220 is configured around the voice control unit 230. The voice control unit 230 has a
configuration in which an image memory 97 and an image recognition unit 98 are connected via
a bus 36, in addition to the CPU 31, the ROM 32, the RAM 33, the I / O interface 34, and the
microphone array processing unit 35 described above.
[0057]
Further, the in-vehicle imaging camera 95 is connected to the voice control unit 230. An image
captured by the in-vehicle shooting camera 95 is stored in the image memory 97 in the voice
04-05-2019
14
control unit 230, and the image recognition unit 98 performs an image recognition process.
[0058]
FIG. 11 is a view showing the vicinity in the front of the vehicle where the in-vehicle
photographing camera 95 is installed. In the present embodiment, the in-vehicle shooting camera
95 is a fixed point camera, and is installed in the map lamp unit 96. The camera may be installed
in the meter unit 97 instead of or together with the map lamp unit.
[0059]
FIG. 12 is a flowchart showing a directivity control process procedure. The processing program is
stored in the ROM 32 in the voice control unit 230, and is executed by the CPU 31 at
predetermined intervals. First, the zoom lens of the in-vehicle shooting camera 95 is driven (step
S21), and the drive of the zoom lens is continued until focusing is achieved (step S22). Then, the
subject is photographed at the in-focus timing (step S23).
[0060]
The face image is recognized from the image of the photographed subject, and the position of the
mouth is detected (step S24). FIG. 13 shows a photographed image. In the image captured by the
in-vehicle shooting camera 95, which is a fixed-point camera, a microphone element having a
directivity direction is predetermined in each area indicated by a dotted line. For example, the
microphone element 41 a is allocated to the area A, the microphone element 41 b is allocated to
the area B, and the microphone element 41 c is allocated to the area C.
[0061]
Therefore, by the area including the mouth position recognized from the photographed image,
the microphone element having the directivity direction in the area can be specified. Here, the
mouth position is included in the area B, and the corresponding microphone element 41 b is
identified. That is, the microphone element corresponding to the mouth position detected in step
S24 is specified (step S25).
04-05-2019
15
[0062]
Then, the amplifier in the microphone array processing unit 35 is adjusted so that the gain of the
specified microphone element becomes higher than the gains of the other microphone elements
(step S26). After this, this processing ends.
[0063]
As described above, according to the in-vehicle microphone device of the third embodiment,
since the driver's mouth position is detected in synchronization with the focus (focusing)
information of the in-vehicle imaging camera, a special seat is not prepared. Even in this case, the
target directivity direction can be determined accurately and promptly.
[0064]
The present invention is not limited to the configuration of the above-described embodiment, but
may be any configuration that can achieve the function described in the claims or the function of
the configuration of the present embodiment. Is also applicable.
[0065]
For example, in the above embodiment, a microphone array including a plurality of microphone
elements having different directivity directions is used as the microphone, but instead of the
microphone array, a single microphone and this microphone in the pan and tilt directions are
used. A directional drive unit may be provided to perform directivity control by driving the
microphone in the pan and tilt directions.
[0066]
Moreover, in the said embodiment, although the microphone array which consists of several
microphone elements which have mutually different directivity directions was used as a
microphone, you may combine multiple microphones of the same directivity direction.
For example, the configuration may be such that the directivity direction is controlled by
combining two to four microphones having the same directivity direction and performing signal
04-05-2019
16
processing.
[0067]
In the above embodiment, one in-vehicle shooting camera is used. However, a plurality of
cameras are provided, and the distance to the mouth is calculated from the stereo image
photographed by the plurality of cameras and the mouth The position may be specified.
[0068]
Here, the mouth position detecting means described in claim 1 corresponds to the process of
steps S1 and S2 of FIG.
The directivity direction control means corresponds to the processing of controlling the
directivity direction by specifying the microphone element closest to the mouth position in steps
S3 and S4 and adjusting the gain thereof.
The headrest position acquisition means according to claim 2 corresponds to the process of step
S1.
The seat position detection means according to claim 3 corresponds to the front and rear
position sensor 44. The angle detection means corresponds to the angle sensor 43. The height
detection means according to claim 4 corresponds to the height position sensor 42. The signal
generation means according to claim 5 corresponds to the electromagnetic wave generation unit
75. The position detection means corresponds to the two-dimensional position sensor 71. The
photographing means described in claim 6 corresponds to the in-vehicle photographing camera
95.
[0069]
The on-vehicle microphone device according to the present invention performs directivity control
of the microphone in accordance with the position of the driver's mouth seated on the seat,
whereby the driver performs voice control of on-vehicle equipment while sitting on the seat. It is
useful.
04-05-2019
17
[0070]
It is a figure showing the composition of the voice control system in a 1st embodiment.
FIG. 2 is a diagram showing a configuration of a vehicle-mounted microphone device 20. It is a
figure showing the seat where a driver seats. It is a figure which shows the positional relationship
of the seat in the virtual plane which passes along the left-right direction center part of a seat. It
is a figure which shows the relationship between the directivity direction synthesize | combined
by several microphone element 41a, 41b, ..., 41n which comprises the microphone array 41
arrange | positioned at the map lamp part, and the virtual plane of FIG. It is a flow chart which
shows directivity control processing procedure. It is a figure which shows the structure of the
vehicle-mounted microphone apparatus 120 in 2nd Embodiment. It is a figure which shows
arrangement | positioning of the headrest 80a and the two-dimensional position sensor 71 which
were looked from in-vehicle upper direction. It is a flow chart which shows directivity control
processing procedure. It is a figure which shows the structure of the vehicle-mounted
microphone apparatus 220 in 3rd Embodiment. It is a figure which shows near vehicle interior
front in which the camera 95 for in-vehicle photography was installed. It is a flow chart which
shows directivity control processing procedure. It is a figure showing a photography picture. It is
a figure which shows vicinity in the inside of a vehicle by which the conventional microphone for
vehicles was mounted. It is a figure which shows the directivity of the microphone. It is a figure
which shows directivity direction control in another conventional vehicle-mounted microphone
apparatus.
Explanation of sign
[0071]
Reference Signs List 1 in-vehicle control system 20, 120, 220 voice control unit 30, 230 voice
signal processing unit 31 CPU 41 microphone array 41a, 41b, 41n microphone element 42
height position sensor 43 angle sensor 44 front and back position sensor 71 two-dimensional
position sensor 75 electromagnetic wave Generator 95 Camera for in-vehicle shooting
04-05-2019
18
Документ
Категория
Без категории
Просмотров
0
Размер файла
29 Кб
Теги
jp2007302155
1/--страниц
Пожаловаться на содержимое документа