close

Вход

Забыли?

вход по аккаунту

?

JP2013243575

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2013243575
Abstract: To provide a technology capable of switching a speaker channel appropriately in
accordance with the position of a listener, regardless of whether the listener is on the front side
(display screen side) or the back side of the portable terminal Do. A person discrimination unit
153 discriminates whether or not there is a person for each of front side imaging data imaged by
the front imaging unit 11 and back side imaging data imaged by the back imaging unit 12. The
Ch allocating unit 17 allocates a channel to the first speaker 19, the second speaker 20, and the
third speaker 21 in association with the side determined to have a person on the front side or the
back side. [Selected figure] Figure 1
Portable terminal
[0001]
The present invention relates to a portable terminal capable of assigning a channel to a speaker
according to the usage state of the device.
[0002]
Conventionally, the posture direction of the portable terminal is detected to determine whether it
is being used vertically or horizontally, and the channel of the speaker is switched according to
the used state (for example, Patent Document) See 1).
[0003]
Japanese Patent Application Laid-Open No. 2003-078601
09-05-2019
1
[0004]
However, in the technology of Patent Document 1, since the emphasis is placed when viewing a
moving image, the viewing direction with respect to the portable terminal is fixed on the display
screen side.
Therefore, for example, when the listener puts the portable terminal face down, the listener is
located on the back side of the portable terminal, but the technology of Patent Document 1
corresponds to the listener on the back side of the portable terminal. Was unable to switch the
speaker channel properly.
[0005]
The present invention has been made in view of the above problems, and the listener is
appropriately on the front side (display screen side) or the back side of the portable terminal in
accordance with the direction of the listener. An object of the present invention is to provide a
technology capable of switching the channel of a speaker.
[0006]
The portable terminal according to the present invention comprises a front imaging unit disposed
on the front, a back imaging unit disposed on the back, and a person discriminating unit for
discriminating a person from image data of the front imaging unit or the back imaging unit.
Channel assignment means is provided for assigning channels to a plurality of speakers in
correspondence with the direction of the person determined by the person determination means.
In addition, a posture determination unit that determines a posture, and a display control unit
that causes the display unit to shift to a power saving mode when the person is not determined
from the imaging data of the front imaging unit and the posture is prone. And may be provided.
In the case where the person is not discriminated from the image pickup data of the front image
pickup means and the image pickup data of the back image pickup means in the first process, the
person judging means is in the prone state. , May be treated as having a person on the back side.
09-05-2019
2
And a change detection unit that detects whether or not there is a change in the previous
attitude, the imaging data, the current attitude, and the imaging data, and the change detection
means detects that there is no change The previously assigned channel may be maintained.
[0007]
According to the present invention, even if the listener is on either the front side or the back side
of the portable terminal, the channel of the speaker can be switched appropriately in accordance
with the direction in which the listener is present.
[0008]
It is a functional block diagram showing composition of a portable terminal of an embodiment
concerning the present invention.
It is an external view of the portable terminal shown in FIG. It is an image figure showing an
example of channel assignment to a state of a personal digital assistant seen from a listener. It is
a flowchart which shows the flow of a process of the portable terminal shown in FIG.
[0009]
Hereinafter, embodiments of the present invention will be described in detail with reference to
the drawings.
[0010]
FIG. 1 is a functional block diagram showing the configuration of the portable terminal 1 of the
present embodiment.
2 is an external view of the portable terminal 1, FIG. 2 (a) is a front view of the portable terminal
1, and FIG. 2 (b) is a rear view of the portable terminal 1. (C) is a bottom view of the portable
terminal 1. Here, a smartphone is shown as an example of the portable terminal 1.
09-05-2019
3
[0011]
The portable terminal 1 includes a front imaging unit 11, a back imaging unit 12, an attitude
detection unit 13, a feature amount extraction unit 14, a switching control unit 15, a display
control unit 16, a Ch (channel) allocation unit 17, a display unit 18, and A first speaker 19, a
second speaker 20 and a third speaker 21 are provided.
[0012]
As shown in FIG. 2A, the front imaging unit 11, the display unit 18, and the third speaker 21 are
disposed on the front side (display unit 18 side) of the portable terminal 1.
The third speaker 21 is disposed above the display unit 18. The third speaker 21 may be a
receiver speaker. Further, as shown in FIG. 2 (b), the back surface imaging unit 12 is disposed on
the back surface of the portable terminal 1. Further, as shown in FIG. 2C, the first speaker 19 is
disposed on the left side of the bottom surface of the portable terminal 1, and the second speaker
20 is disposed on the right side of the bottom surface.
[0013]
The front imaging unit 11 images the front (display unit 18 side) of the portable terminal 1 at
predetermined time intervals. In addition, the back surface imaging unit 12 captures an image of
the back surface of the portable terminal 1 at predetermined time intervals. The imaging process
in the front imaging unit 11 and the rear imaging unit 12 may be performed continuously at all
times, or may be performed, for example, at the switching timing of the music to be reproduced
for power saving. The front imaging data by the front imaging unit 11 and the rear imaging data
by the rear imaging unit 12 are output to the feature amount extraction unit 14 respectively.
[0014]
The feature amount extraction unit 14 extracts a feature amount for each of the front side
imaging data and the rear side imaging data, and outputs the feature amount to the switching
control unit 15.
[0015]
09-05-2019
4
The attitude detection unit 13 includes a three-axis sensor, an acceleration sensor, and the like,
and detects the attitude of the portable terminal 1.
The posture detection unit 13 detects the posture of the portable terminal 1 with respect to the
predetermined reference axis at predetermined time intervals, for example, when the state in
which the portable terminal 1 stands vertically is used as the predetermined reference axis.
When detecting the posture, the posture detection unit 13 outputs a sensor value indicating the
posture to the switching control unit 15.
[0016]
The switching control unit 15 includes a memory 151, a change detection unit 152, a person
determination unit 153, and a posture determination unit 154.
[0017]
The memory 151 stores, as previous detection data, the feature amount of the front side imaging
data and the feature amount of the back side imaging data acquired by the change detection unit
152 last time and the sensor value indicating the previous attitude.
[0018]
The change detection unit 152 compares the current detection data acquired from the posture
detection unit 13 and the feature amount extraction unit 14 with the previous detection data
stored in the memory to detect whether there is a change.
Specifically, when there is a difference between the feature amount of the previous front side (or
back side) imaging data and the feature amount of the current front side (or back side) imaging
data, it is determined that there is a change. If not, it is determined that there is no change.
The change detection unit 152 determines that there is a change when there is a difference
between the sensor value indicating the previous posture and the sensor value indicating the
current posture, and determines that there is no change if there is no difference.
09-05-2019
5
[0019]
If the change detection unit 152 determines that at least one of the change in the feature amount
or the change in the posture is changed, it detects that there is a change, and determines that
neither the feature amount nor the posture change. Detects no change.
[0020]
When the change detection unit 152 detects that there is a change, the person determination
unit 153 and the posture determination unit 154 determine whether the person is on the front
side or the back side of the portable terminal 1 and the attitude of the portable terminal 1
Processing is performed.
In addition, when the change detection unit 152 finishes the process of detecting the presence or
absence of a change, the sensor data indicating the detection data acquired this time, that is, the
feature of the front imaging data, the feature of the back imaging data, and the attitude The
detection data is overwritten and stored in the memory 151.
[0021]
The person determination unit 153 detects whether or not a person is imaged based on the
feature amount of the front side imaging data and the feature amount of the back side imaging
data at this time. Various known techniques may be used as the person detection technique. For
example, the person may be detected based on whether or not the feature amount of the imaging
data matches the feature amount of the shape of the person stored in advance in a memory (not
shown) or the like. Thereby, the person determining unit 153 determines whether or not there is
a person in the front side imaging data of this time and whether or not there is a person in the
back side imaging data of this time. Output.
[0022]
The posture determination unit 154 sets the posture of the portable terminal 1 to the supine
position (the display unit 18 faces the sky) or the prone position (the display unit 18 is
grounded) based on the sensor value indicating the posture acquired from the posture detection
unit 13. Orientation), positive or reverse vertical orientation, or left or right horizontal
orientation.
09-05-2019
6
[0023]
For example, in the state of the portable terminal 1 shown in FIG. 2A, the posture determination
unit 154 determines that the state inclined approximately 90 ° in the right direction in the
drawing (or approximately 270 ° in the left direction) It is determined that the state inclined
approximately 180 ° in the right (or left) direction is the reverse vertical direction, and the state
inclined approximately 270 ° in the right in the drawing (or approximately 90 ° in the left) is
determined as the left lateral, It may be determined that (approximately 0 ° or approximately
360 °) the normal vertical orientation.
Further, in the state of the portable terminal 1 shown in FIG. 2A, the posture determination unit
154 determines that the state inclined approximately 90 ° in the front direction (or
approximately 270 ° in the back direction) is expressed as prone. It may be determined that the
state of being inclined approximately 90 ° in the back direction (or approximately 270 ° in the
front direction in the figure) is facing up.
[0024]
When the posture determination unit 154 determines that the posture of the portable terminal 1
is in the positive or reverse vertical orientation, the display control unit 16 adjusts the display
image in the positive or reverse vertical direction and causes the display unit 18 to display the
adjusted display image. On the other hand, when the attitude determination unit 154 determines
that the attitude of the portable terminal 1 is left or right sideways, the display control unit 16
adjusts the display image to the left or right side and causes the display unit 18 to display it.
[0025]
The display control unit 16 is a case where it is determined by the person determination unit
153 that there is no person in the front side imaging data, and a case where the posture
determination unit 154 determines that the posture of the portable terminal 1 is prone.
Alternatively, the display unit 18 may be switched to the power saving mode so as not to display
an image.
[0026]
09-05-2019
7
The Ch assignment unit 17 assigns channels to the first speaker 19, the second speaker 20, and
the third speaker 21 according to the determination result by the person determination unit 153
and the posture determination unit 154.
For example, the Ch assignment unit 17 may assign a channel as shown in FIG.
[0027]
FIG. 3 is an image diagram showing an example of channel assignment among the first speaker
19, the second speaker 20 and the third speaker 21 with respect to the state of the portable
terminal 1 viewed from the listener (viewer). In the drawing, (a) to (h) are shown as an example
of a state in which the portable terminal 1 is viewed from the listener.
[0028]
As shown in FIG. 3, the Ch assignment unit 17 (a) detects a person from the front side imaging
data, and the posture is normal vertical (approximately 0 °), and (b) back side imaging data
When the person is detected only from the above and the posture is in the reverse vertical
orientation (approximately 180 °), the Lch is output from the first speaker 19 and the Rch is
output from the second speaker 20, and the third speaker 21 is Do not output the channel from.
[0029]
In addition, (c) a person is detected from the front side imaging data, and the Ch allocating unit
17 detects a person from only the back side imaging data when the posture is reverse vertical
orientation (approximately 180 °); In the case where the posture is in the normal vertical
orientation (approximately 0 °), the first speaker 19 outputs the Rch, the second speaker 20 the
Lch, and the third speaker 21 the channel output. I can not let it go.
[0030]
In addition, the Ch assignment unit 17 detects (e) a person from the front side imaging data, and
(f) detects a person from only the back side imaging data when the posture is horizontal
(approximately 270 °). And, in the case where the posture is left sideways (approximately 270
°), the first speaker 19 outputs the Rch, the second speaker 20 does not perform the channel
output, and the third speaker 21 outputs the Lch. .
09-05-2019
8
[0031]
In addition, the Ch assignment unit 17 detects (g) a person from the front side imaging data, and
(h) detects a person from only the back side imaging data when the posture is right-side
(approximately 90 °). And, in the case where the posture is in the right lateral direction
(approximately 90 °), the channel output from the first speaker 19 is not performed, the Lch is
output from the second speaker 20, and the Rch is output from the third speaker 21. .
[0032]
Thereby, even when the listener is not on the front side of the portable terminal 1 but on the
back side, the Ch allocating unit 17 performs channel allocation suitable for the position of the
listener with respect to the portable terminal 1, and the first speaker 19 Audio can be output
from the second speaker 20 and the third speaker 21.
[0033]
Next, the flow of the switching process of the portable terminal 1 will be described with
reference to FIG.
[0034]
Here, in order to simplify the explanation, a case where there is only one listener will be
described as an example.
If there are a plurality of listeners and a person is detected in both front side imaging data and
back side imaging data, the switching process may be performed by giving priority to the person
detected in the front side imaging data. .
[0035]
First, in step S11, the front imaging unit 11 captures the front side of the portable terminal 1, the
back imaging unit 12 captures the back side of the portable terminal 1, and the posture detection
unit 13 determines the posture of the portable terminal 1. To detect.
[0036]
In step S13, the feature amount extraction unit 14 extracts the feature amount of the front side
09-05-2019
9
imaging data and the feature amount of the back side imaging data.
[0037]
In step S15, the change detection unit 152 detects the previous detection data (the feature
amount of the front side imaging data, the feature amount of the rear side imaging data, the
sensor value indicating the posture) stored in the memory 151 and the detection data acquired
this time ( The feature amount of the front side imaging data, the feature amount of the back side
imaging data, and the sensor value indicating the posture are compared with each other to detect
whether or not there is a state change.
[0038]
In step S17, the change detection unit 152 detects that there is no change in any of the feature
amount of the front side imaging data, the feature amount of the back side imaging data, or the
sensor value indicating the posture (No in step S17) , End this process.
That is, in this case, the previous image display direction and channel assignment are maintained.
[0039]
On the other hand, in step S17, the change detection unit 152 detects that there is a change in at
least one of the feature amount of the front side imaging data, the feature amount of the back
side imaging data, or the sensor value indicating the posture ( Yes in step S17), the process
proceeds to step S19.
[0040]
In step S19, based on the sensor value indicating the current posture, the posture determination
unit 154 determines that the posture of the portable terminal 1 is facing up, lying down, normal
vertical, reverse vertical, right horizontal, or left horizontal. Determine if there is.
[0041]
Next, in step S21, the person determining unit 153 determines whether or not there is a person
in the front side imaging data based on the feature amount of the front side imaging data of this
time and the feature amount of the back side imaging data of this time, It is determined whether
09-05-2019
10
or not there is a person in the back side imaging data.
[0042]
When it is determined in step S23 that there is a person in the front side imaging data (Yes in
step S23), in step S25, the display control unit 16 determines that the posture is vertical based
on the determination result of the posture determination unit 154. If there is, the display image
is adjusted vertically, and if the posture is horizontal, the display image is adjusted horizontally
and displayed on the display unit 18.
[0043]
Then, in step S27, the Ch assignment unit 17 causes the first speaker 19 to correspond to the
direction in which the listener is present as shown in FIG. 3 based on the determination result by
the person determination unit 153 and the posture determination unit 154. Channels are
assigned to the second speaker 20 and the third speaker 21, and the process ends.
[0044]
On the other hand, when the display control unit 16 determines that there is no person in the
front side imaging data according to the determination result of the person determination unit
153 in step S23 (No in step S23), the display determination unit It is determined whether the
posture is determined to be prone based on the determination result.
[0045]
In the case of No at step S29, after the process of step S27 is performed, the present process
ends.
[0046]
On the other hand, in the case of Yes in step S29, in step S31, the channel assignment process is
performed in step S27 while the display control unit 16 shifts the display unit 18 to the power
saving mode and video display is not performed. finish.
In this case, the portable terminal 1 is placed on a desk or the like, and it is considered that the
listener is only listening to audio such as a moving image, and there is no need to display an
image.
09-05-2019
11
[0047]
As described above, according to the present embodiment, the relative positional relationship
between the listener and the portable terminal 1 is grasped by the front imaging unit 11 and the
rear imaging unit 12, and the listener moves to the back side of the portable terminal 1. Even if
they are located, channels can be assigned to the first speaker 19, the second speaker 20 and the
third speaker 21 so as to provide a suitable channel arrangement for the listener.
[0048]
In the above-described embodiment, when the person determining unit 153 can not determine
the person in both the front side imaging data and the rear side imaging data because of a dark
place or the like, it is not the first process. It may be determined as identical.
On the other hand, when it is the first process and the posture of the portable terminal 1 is
prone, the person discrimination unit 153 determines that there is a person on the back side, and
the posture of the portable terminal 1 is not prone. When it is, it may be determined that there is
a person on the front side.
Further, the display control unit 16 and the Ch allocation unit 17 determine in the posture
determination unit 154 when the person determination unit 153 can not determine the person in
both the front side imaging data and the rear side imaging data because of a dark place or the
like. Depending on the orientation, the process of image display direction or channel assignment
may be performed.
[0049]
In addition, when the person determination unit 153 can not detect because the listener once
determined is out of the imaging range, the previous channel arrangement may be continued.
[0050]
In the above embodiment, the attitude of the portable terminal 1 is detected by the attitude
detection unit 13 and used to determine the display direction and the channel assignment, but
09-05-2019
12
instead of the attitude detection, it is determined only by the state of the imaged person You may
do it.
That is, the person determination unit 153 may determine the orientation (posture) of the person
with respect to the portable terminal 1 at the time of imaging from the imaging data to determine
the state (direction) of the person with respect to the portable terminal 1.
According to this, it is possible to perform the image display direction and the channel
assignment in correspondence with the direction of the person with respect to the portable
terminal 1.
[0051]
The present invention is not limited to the above-described embodiment, and it goes without
saying that various changes can be made without departing from the spirit of the present
invention.
For example, the portable terminal 1 of the present invention is not limited to a smart phone, and
may be a portable telephone, a portable music player, a tablet type terminal, a thin display device
having a built-in battery, and being portable.
Also, in the above, the channel assignment of 2ch has been described by way of example in the
case of stereo reproduction, but the case of 2.1ch or more can be similarly assigned.
In the said embodiment, the same code | symbol is attached to the structure which shows the
same function.
[0052]
1: Portable terminal 11: Front imaging unit 12: Rear imaging unit 13: Posture detection unit 14:
Feature quantity extraction unit 15: Switching control unit 16: Display control unit 17: Ch
allocation unit 18: Display unit 19: First speaker 20: second speaker 21: third speaker 151:
memory 152: change detection unit 153: person determination unit 154: posture determination
unit
09-05-2019
13
09-05-2019
14
Документ
Категория
Без категории
Просмотров
0
Размер файла
22 Кб
Теги
jp2013243575
1/--страниц
Пожаловаться на содержимое документа