close

Вход

Забыли?

вход по аккаунту

?

JP2002303666

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2002303666
[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a
position detection system, and more particularly to a technology which is effective when applied
to a position detection system for detecting the position of a speaker such as a caster or a
performer.
[0002]
A conventional position detection system detects positions of a plurality of speakers by analyzing
in real time a camera image picked up by a television camera or the like. In position detection
using this image analysis technology, for example, clothes such as castors and performers are
each dressed in a specific color, and the position information detection unit generates each
speaker in real time from an image photographed by a television camera or the like. The color
corresponding to is extracted as an object, and the position information of each speaker is
detected based on the information such as the arrangement position and the angle of view of the
television camera to track the speaker.
[0003]
In addition, in a position detection system using image analysis technology, a background image
without movement is basically removed from an image captured by a television camera or the
like, and a remaining speaker is extracted as an object, or a three-dimensional camera using a
stereo camera. In this case, the speaker is extracted as an object, and the position information of
04-05-2019
1
each speaker is tracked by sequentially specifying the position of the extracted object from the
camera image captured in real time.
[0004]
SUMMARY OF THE INVENTION The present inventors have found the following problems as a
result of examining the prior art.
[0005]
In a position detection system using a camera image, each speaker to be tracked needs to be
always captured in the camera image.
For this reason, for example, when a speaker is hidden behind a set installed in a shooting studio,
it is naturally impossible to catch the speaker hiding in the camera image, so tracking this
speaker is required. It was impossible to continue.
[0006]
In addition, in the method of basically removing a background image without movement from an
image captured by a television camera or the like and extracting the remaining speaker as an
object, the position is tracked while relatively securing the freedom of the speaker. It becomes
possible, but when the speakers cross each other or when they are hidden behind the set, it
becomes impossible to accurately capture the speaker's position information, so the speaker's
tracking is possible. It was impossible to continue.
[0007]
An object of the present invention is to provide a technology capable of detecting speaker
position information.
[0008]
Another object of the present invention is to provide a technique capable of tracking the position
of a speaker.
[0009]
04-05-2019
2
The above and other objects and novel features of the present invention will become apparent
from the description of the present specification and the accompanying drawings.
[0010]
Among the inventions disclosed in the present application, the outline of typical ones will be
briefly described as follows.
[0011]
(1) An audible band signal generating means having a sound receiving part that vibrates by an
acoustic wave in the audible band, and an audible out-of-band signal generation means having a
position detecting sound receiving part that vibrates by a sound wave outside the audible band ,
Microphone device moved with the user.
[0012]
(2) A microphone in which an audible band signal generating means having a sound receiving
part vibrating with an acoustic wave in the audible band and an audible out-of-band signal
generating means having a position detecting sound receiving part vibrating with a sound wave
outside the audible band are integrally disposed. A speaker for outputting sound waves outside
the audible band of different frequencies in the movement range of the microphone moved
together with the user, an electric signal converted from the sound wave picked up by the audio
out-of-band signal generating means, and the speaker Means for calculating the position of the
microphone based on the position information of the position detection system.
[0013]
According to the above-described means, the ultrasonic wave output from the speaker is picked
up by the position detection sound receiving unit of the out-of-band signal generating means
constituting the microphone, and is converted into an electric signal (ultrasound signal).
At this time, the microphone having the audible band signal generating means and moved
together with the subject is configured to include the audible out-of-band signal generating
means.
That is, in the microphone, the audible band signal generating means and the audible out band
04-05-2019
3
signal generating means are integrally arranged.
[0014]
Therefore, based on the ultrasonic signal output from the audible out-of-band signal generation
means and the position information of the ultrasonic speaker, the position of the microphone
calculated by the calculation means is the position of the audible out-of-band signal generation
means uses the microphone Position of the user to
As a result, when the speaker who is the target person carries and moves the microphone of the
present invention, the position of the target person can be grasped, that is, tracked in real time.
At this time, since the voice of the speaker is converted into an electric signal (voice signal) by
the audible band signal generation unit and output, the movement can be tracked without
burdening the speaker.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described in
detail with reference to the drawings together with embodiments (examples) of the invention.
[0016]
Note that components having the same function are denoted by the same reference symbols
throughout the drawings for describing the embodiments of the present invention, and the
repetitive description thereof will be omitted.
[0017]
FIG. 1 is for explaining a schematic configuration of a position detection system according to an
embodiment of the present invention.
In FIG. 1, 101 indicates a microphone device, 102 indicates an ultrasonic speaker, 103 indicates
a position detection device, and 104 indicates a studio.
04-05-2019
4
[0018]
As shown in FIG. 1, in the position detection system of the present embodiment, a microphone
device main body 101 worn by a speaker (a caster, a cast, etc.) (not shown) whose position
information is to be detected It comprises three ultrasonic speakers 102 arranged at different
positions, and a position detection device 103 for supplying ultrasonic signals as drive signals to
each of the ultrasonic speakers 102.
Further, position detection apparatus 103 according to the present embodiment is a signal (audio
signal) in an audible band such as a speaker's voice from an output signal output from
microphone device 101, an ultrasonic wave output from ultrasonic speaker 102, etc. It is
configured to separate from signals (ultrasound signals) other than those in the audible band and
to detect position information of the microphone device 101 from the separated ultrasonic
signals.
However, since the arrangement position of each ultrasonic speaker 102 is required when
detecting the position of the microphone device 101, in the present embodiment, the mutual
positions of the ultrasonic speakers 102 are grasped by measuring in advance or the like. .
The detailed configurations of the microphone device 101 and the position detection device 103
will be described later.
[0019]
FIG. 2 is a view for explaining a schematic configuration of the microphone device of the present
embodiment, and FIG. 3 is a view for explaining a schematic configuration of the position
detection device of the present embodiment.
2 and 3, 201 is an ultrasonic microphone unit (audible band signal generating means), 202 is an
audible sound microphone unit (audible band signal generating means), 203 is an ultrasonic
voice signal multiplexer, and 301 is a voice. Position information detection unit, and 302
indicates an ultrasonic amplification unit.
04-05-2019
5
[0020]
As shown in FIG. 2, the microphone device of the present embodiment includes an ultrasonic
microphone unit 201 including an ultrasonic microphone (not shown) and an audible sound
(voice) microphone unit 202 including a voice microphone including two microphone capsules. A
known ultrasonic / audio signal multiplexer 203 multiplexes electrical signals output from the
ultrasonic microphone unit 201 and the audio microphone unit 202.
[0021]
The ultrasonic microphone unit 201 includes, for example, a known ultrasonic microphone and a
known impedance converter for converting the impedance of the ultrasonic microphone.
On the other hand, the audio microphone unit 202 has a so-called lapel microphone (double
capsule microphone) configuration including, for example, two microphone capsules and a
known impedance converter for converting the impedance of each microphone capsule.
The detailed structure of the microphone device 101 will be described later.
[0022]
The ultrasonic wave / voice signal multiplexing unit 203 outputs the electric signal (ultrasound
signal) output from the impedance converter of the ultrasonic microphone unit 201 and the
electric signal (voice signal output from each impedance converter of the sound microphone unit
202). And the known means for multiplexing. However, in the present embodiment, since the
frequency of the ultrasonic wave collected by the ultrasonic microphone unit 201 is different
from the frequency of the sound collected by the audio microphone unit 202, the ultrasonic wave
/ audio signal multiplexing unit A configuration 203 realizes multiplexing of an ultrasonic signal
and an audio signal by simply combining the ultrasonic signal from the ultrasonic microphone
unit 201 and the audio signal from the audio microphone unit 202.
[0023]
04-05-2019
6
The voice / position information detection unit 301 includes, for example, a known separation
unit (not shown) that separates an ultrasonic signal and an audio signal from a multiplexed signal
input from the microphone device 101, and a reference signal for driving the ultrasonic speaker
102. , And a known detection unit (not shown) for detecting positional information of the
microphone device 101 from the reference signal and the separated ultrasonic signal. However,
in the present embodiment, since the three ultrasonic speakers 102 are driven at different
frequencies, the reference signal generation unit generates three channels of reference signals
and supplies them to the ultrasonic amplification unit 302. Is configured to However, the
detection means of the present embodiment compares the phase of the ultrasonic signal for each
frequency separated by the separation means with the phase of the reference signal to obtain the
distance from each ultrasonic speaker 102 to the microphone device 101. In addition to the
calculation, the position of the microphone device 101 is calculated in real time based on the
attachment position information of each ultrasonic speaker 102.
[0024]
Here, the principle of the position detection method using ultrasonic waves will be briefly
described. The directionality is strong, and ultrasonic waves that propagate in water have been
used for many years in fish finders and sonars for submarines, etc. The distance between the
object is calculated from the phase difference between the emitted (irradiated) direct wave and
the reflected wave, and the time difference. It is used as a measurement method. Recently, it has
been widely used for measurement of living bodies, such as visualization of heart movement
using echo and Doppler effects of the liver. Therefore, it is introduced in various documents, and
the following is the outline.
[0025]
By measuring the distances from the three directions, the three-dimensional position (x, y, z) of
the ultrasonic microphone provided in the microphone device 101 can be determined. The
positions and frequencies of the three ultrasonic sound sources are defined as follows.
[0026]
First, let the position of the sound source 1 be (x1, y1, z1), and let the frequency of the ultrasonic
04-05-2019
7
wave outputted (sent) from the sound source 1 be f1. Similarly, the position of the sound source
2 is (x2, y2, z2), its frequency is f2, the position of the sound source 3 is (x3, y3, z3), and its
frequency is f3. However, when the frequencies of the respective sound sources 1 to 3 are
different, any or all of the sound sources 1 to 3 may output ultrasonic waves in the same period,
or output a pulse with a time difference. You may Further, it is needless to say that when any or
all of the sound sources 1 to 3 have the same frequency, it is necessary to provide a time
difference for each pulse and output.
[0027]
When the sound source 1 is emitted at time t1 and the ultrasonic microphone receives it at time
t2, using the sound velocity v, the distance d1 between the sound source 1 and the ultrasonic
microphone provided in the microphone device 101 is d1 = v × Calculated as (t2-t1). Similarly,
distances d2 and d3 between the sound sources 2 and 3 and the ultrasonic microphones
provided in the microphone device 101 are calculated. When a plurality of ultrasonic pulses are
collected by reflection of a wall surface or the like, in the present embodiment, a signal with the
largest amplitude is selected. However, the present invention is not limited to this. It is also
possible to select the desired signal by combining the signal or the signal with the largest
amplitude and the signal arriving earliest.
[0028]
When a spherical surface is drawn using the distance to the ultrasonic microphone included in
the microphone device 101 determined from each of the sound sources 1 to 3, the position
where the respective spherical surfaces intersect becomes the position of the ultrasonic
microphone, that is, the microphone device 101.
[0029]
In the present embodiment, although the microphone device 101 is configured to include one
ultrasonic microphone, the present invention is not limited to this.
For example, ultrasonic waves utilize a property of high directivity, and a plurality of ultrasonic
microphones having directivity are provided in the microphone device 101 and arranged so that
the directivity of each of the ultrasonic microphones is orthogonal. Here, the attachment
direction of the microphone device 101 to speakers such as castors and performers, that is, the
04-05-2019
8
directivity direction of each ultrasonic microphone is grasped, and the amplitude and arrival time
of the ultrasonic waves collected by each ultrasonic microphone In addition to the position of the
microphone device 101, that is, the ultrasonic microphone, the direction of arrival of the
ultrasonic wave can be grasped by analyzing the above, so that the mounting direction of the
microphone device 101 to the speaker and the direction of arrival of the ultrasonic wave Can
also identify the direction of the speaker. In particular, when the microphone device is attached
to the front of a speaker's chest or the like, it is possible to specify the position of the speaker as
well as the front direction.
[0030]
Also, the ultrasonic amplification unit 302 is a known amplifier that amplifies the three channel
reference signals from the voice / position information detection unit 301 and supplies the
reference signals to the respective ultrasonic speakers 102 as drive signals.
[0031]
Next, the operation of the position detection system according to the present embodiment will be
described based on FIGS.
[0032]
First, the reference signal generation means of the voice / position information detection unit
301 constituting the position detection device 103 supplies the ultrasonic amplification unit 302
with reference signals of frequencies outside the three different audible bands.
The three channels of reference signals are respectively amplified by the ultrasonic amplification
unit 302, and then supplied to the corresponding ultrasonic speaker 102 as a drive signal to
drive the ultrasonic speaker 102 attached to the ceiling portion of the studio 104. .
Therefore, sound waves, that is, ultrasonic waves having frequencies outside of different audible
bands are output from the respective ultrasonic speakers 102.
[0033]
04-05-2019
9
The ultrasonic waves output from the ultrasonic speakers 102 are collected by the ultrasonic
microphone unit 201, and the collected ultrasonic waves are converted into ultrasonic signals
and input to the ultrasonic / voice signal multiplexing unit 203. At this time, the sound
microphone unit 202 picks up sound waves in an audible band such as the voice of a speaker
(not shown), converts the collected sound waves into sound signals, and inputs them to the
ultrasonic wave / sound signal multiplexing unit 203. .
[0034]
The ultrasonic signal and the audio signal input to the ultrasonic wave / audio signal
multiplexing unit 203 are multiplexed, and then output to the audio / position information
detection unit 301 constituting the position detection device 103. At this time, transmission of
the multiplexed signal is performed by so-called wired connection in which the microphone
device 101 and the position detection device 103 are connected by a known signal line, or by
modulating and amplifying the multiplexed signal by a modulation amplifier provided in the
microphone device 101 The radio signal may be received by the voice / position information
detection unit 301 and then demodulated.
[0035]
The multiplex signal input to the position detection device 103 is first separated into an audio
signal and an ultrasonic signal by the separation circuit of the audio / position information
detection unit 301 constituting the position detection device 103, and the audio signal is not
shown. Output to etc. On the other hand, the separated ultrasonic signal is input to the detecting
means, and the sound collecting position based on the phase analysis of each ultrasonic signal
for each frequency and the mounting position of the ultrasonic speaker 102 by this detecting
means, that is, the calculation of the microphone device 101 The obtained position information is
output to an automatic tracking camera or the like connected to the subsequent stage.
[0036]
The output of the ultrasonic wave from the ultrasonic speaker 102 described above and the
position calculation of the microphone device 101 from the ultrasonic wave collected by the
microphone device 101 are executed in real time.
[0037]
04-05-2019
10
In the present embodiment, the number of ultrasonic sound sources, that is, the number of
ultrasonic speakers 102 is three. However, the number of sound sources is not limited to three,
and may be three or more. Needless to say.
Furthermore, the arrangement position of the ultrasonic speaker 102 is not limited to the ceiling
portion of the studio 104, and may be arranged on a wall surface, a floor surface, or the like.
[0038]
FIG. 4 is a view for explaining a schematic structure of the microphone device of the present
embodiment. In FIG. 4, 401 indicates an ultrasonic microphone, 402 a and 402 b indicate sound
wave introduction holes, and 403 a and 403 b indicate vibrating films (sound receiving parts).
[0039]
As shown in FIG. 4, the microphone device according to the present embodiment receives an
ultrasonic wave, which is a sound wave outside the audible band, and converts it into an
electrical signal corresponding to the sound wave outside the audible band. And sound
microphones having vibrating films 403a and 403b for converting the sound waves in the
audible band introduced from the sound wave introduction holes 402a and 402b into electric
signals.
[0040]
In the microphone device of the present embodiment, in order to receive ultrasonic waves output
from a plurality of ultrasonic speakers 102, a known ultrasonic microphone 401 is disposed
above the microphone device 101. .
Further, the directivity which is the sensitivity direction of the ultrasonic microphone 401 with
respect to the direction of the microphone device 101 is set large so that the ultrasonic
microphone 401 can receive the ultrasonic waves output from the plurality of ultrasonic
speakers 102 respectively. . The ultrasonic microphone 401 according to the present
embodiment includes a diaphragm (not shown) for converting a sound wave outside the audible
04-05-2019
11
band into an electric signal (ultrasound signal) and an impedance not shown for converting
impedance. Since it becomes a well-known structure which has a converter, detailed description
is abbreviate | omitted.
[0041]
On the other hand, the voice microphone is a so-called lapel microphone (double microphone
capsule) comprising two microphone capsules: an upper microphone capsule having a diaphragm
403a disposed in the upper stage and a lower microphone capsule having a diaphragm 403b
disposed in the lower It has a configuration of a capsule microphone). The configuration is a socalled condenser microphone provided with a back electrode (not shown) corresponding to the
rectangular diaphragms 403a and 403b. At this time, by arranging the respective vibrating
membranes 403a and 403b such that the longitudinal direction of the rectangular vibrating
membranes 403a and 403b is the extension direction of the microphone device 101, that is, the
longitudinal direction, the areas of the respective vibrating membranes 403a and 403b Since the
area can be sufficient, the sensitivity of the voice microphone can be improved.
[0042]
In particular, in the voice microphone of this embodiment, the upper microphone capsule is
disposed on the upper side of the microphone device 101, that is, the side closer to the ultrasonic
microphone 401, and the lower microphone capsule is far from the lower portion of the
microphone device 101, ie, the ultrasonic microphone 401. It is configured to be placed on the
side. Further, the upper microphone capsule and the lower microphone capsule are arranged to
be targets in the extending direction (longitudinal direction) of the microphone device 101. That
is, the upper vibrating membrane 403a and the lower vibrating membrane 403b are the target
with respect to the extension direction of the microphone device 101, and the sound wave
introducing holes 402a and 402b for introducing sound waves to the vibrating membranes 403a
and 403b are also microphone devices It is arranged in a target with respect to the extension
direction of 101. As a result, in the microphone device 101 according to the present
embodiment, the difference between the sensitivity and the frequency characteristic of the upper
microphone capsule and the lower microphone capsule can be reduced, so that independent
sensitivity and frequency characteristics can be obtained. Outputs of two audible bands can be
obtained.
[0043]
04-05-2019
12
Further, in the microphone device 101 of the present embodiment, the two microphone capsules
targeted by the upper and lower microphone capsules constitute an audio microphone. Even in
the case of arranging the sound waves, sound waves in the audible area such as voice can be
picked up well.
[0044]
As described above, in the position detection system according to the present embodiment, the
ultrasonic waves output from the three ultrasonic speakers 102 disposed on the ceiling of the
studio 104 which is the movement range of the speaker who is the tracking target person Is
picked up by a sound receiving unit (not shown) of the ultrasonic microphone 401 constituting
the microphone device 101, and the vibration of the sound receiving unit is converted into an
ultrasonic signal which is an electric signal by a converting unit (not shown).
At this time, since the microphone device 101 of this embodiment has the voice microphone unit
202, it picks up the voice of the speaker and converts it into a voice signal, and moves along with
the movement of the speaker. That is, the microphone device 101 has the ultrasonic microphone
unit 201 and the audio microphone unit 202, and the ultrasonic signal output from the
ultrasonic microphone unit 201 and the audio signal output from the audio microphone unit 202
are ultrasonic waves. The audio signal multiplexing unit 203 multiplexes and outputs to the
audio / position information detection unit 301.
[0045]
Here, the voice / position information detection unit 301 first separates the ultrasonic signal and
the voice signal, and then the microphone based on the separated ultrasonic signal and the
position information of the three ultrasonic speakers 102. By calculating the position of the
device 101, the position of the microphone device 101 moved with the speaker is identified. As a
result, when the speaker who is the target person moves by carrying or wearing the microphone
device 101 of the present invention, the position of the speaker can be grasped and tracked in
real time. At this time, the voice of the speaker is output from the voice / position information
detection unit 301 after being separated by the voice / position information detection unit 301.
Therefore, since the speaker can track its movement simply by carrying the microphone device
101 of the present invention as usual, it can track the movement without putting a special
burden on the speaker.
04-05-2019
13
[0046]
As described above, by applying the present invention, the performers are intertwined in a
television talk program, and the position of the speaker wearing the microphone device 101 of
the present invention even when detection is difficult in conventional image processing. Can be
followed. Of course, it is possible to detect the position of the speaker wearing the microphone
device 101 even when performing only tracking using the microphone device 101 without using
together with image processing, and there are many performers and images It is particularly
effective when processing is difficult. In particular, when the microphone apparatus 101
equipped with a plurality of ultrasonic microphones having orthogonal directivity is attached to
the speaker, the front direction of the speaker can also be detected. It is possible to take a photo.
When imaging is performed only by the microphone device 101 of the present invention without
using image processing, the distance between the camera and the speaker is calculated by
detecting the position information of the camera and the zoom amount. Even when the speaker
moves in the depth direction, the speaker can be traced with the same shooting size, and it can
also be used to adjust the focus of the camera.
[0047]
The application of the present invention is not limited to the automatic tracking of the speaker,
but can also be used for elucidation of the ecology by attaching it to an animal or the like. In
addition, the microphone device 101 of the present invention is attached to a model airplane,
train or the like, and application to special imaging is also possible. Furthermore, the microphone
device 101 of the present invention is attached to a control device such as a robot controlled by
remote control or a previously set action plan or the like, and application to monitoring the
position of the control device is also possible.
[0048]
In the present embodiment, the microphone device 101 has been described in the case where the
ultrasonic microphone unit 201 for detecting an ultrasonic wave and the voice microphone unit
202 for detecting a voice are integrally formed. Even when the ultrasonic microphone 401 is
attached to the microphone device 101 only when it is necessary to separate the voice
microphone unit 202 and the voice microphone unit 202 and it is necessary to obtain positional
information of the microphone device 101, It goes without saying that the effect of
04-05-2019
14
[0049]
Further, in the present embodiment, although two microphone capsules are arranged in the
vertical direction, the present invention is not limited to this. For example, an ultrasonic
microphone 401 is arranged at an intermediate portion of the microphone device 101, It goes
without saying that microphone capsules may be arranged on the left and right of the ultrasonic
microphone 401, and the microphone device 101 may have a horizontally long shape.
[0050]
As mentioned above, although the invention made by the present inventor was concretely
explained based on the embodiment of the above-mentioned invention, the present invention is
not limited to the embodiment of the above-mentioned invention, The range which does not
deviate from the gist Of course, various modifications are possible.
[0051]
The effects obtained by the typical ones of the inventions disclosed in the present application will
be briefly described as follows.
[0052]
(1) Based on the phase of the ultrasonic wave picked up by the ultrasonic microphone unit of the
microphone device and the position information of the ultrasonic speaker that outputs the
ultrasonic wave, the voice / position information detection unit is arranged with the ultrasonic
microphone unit Since the position of the microphone device to be detected is detected, it is
possible to detect the position information of the speaker moving together with the microphone
device.
[0053]
(2) Since the position of the speaker can be always identified by detecting the position
information of the speaker moving with the microphone device in real time, the movement of the
speaker can be tracked.
04-05-2019
15
Документ
Категория
Без категории
Просмотров
0
Размер файла
26 Кб
Теги
jp2002303666
1/--страниц
Пожаловаться на содержимое документа