close

Вход

Забыли?

вход по аккаунту

?

JP2013007876

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2013007876
Abstract: To provide an information terminal, an information device, and a system comprising
them that can be synchronized without using a time stamp. SOLUTION: Audio data of an audio
output from an audio output device 2 connected to a network is acquired from the audio output
device 2, and a time difference between an audio output by the audio output device 1 using the
audio data and the audio is measured. An audio output device 1 which adjusts the output time of
the audio and outputs it in synchronization with the audio. [Selected figure] Figure 1
Information terminal, information device and system comprising the same
[0001]
The present invention relates to an information terminal, an information device, and a system
including these.
[0002]
In recent years, usage that links television and mobile terminals has been proposed.
[0003]
As an example, there is a usage such that the user views and listens to the television while
watching at the mobile terminal at hand.
[0004]
In the case of the above example, since the user listens to the audio output from both the
09-05-2019
1
television and the mobile terminal, it is necessary to synchronize the output timings of both
audio and to provide a comfortable viewing environment.
[0005]
In order to solve this, there is a method mentioned in Patent Document 1 as one method.
[0006]
Patent Document 1 describes a synchronous reproduction system of media data packets.
In this system, a media source (e.g. an audio distribution device) sends time stamped media data
packets (e.g. audio data) to a plurality of media sinks (e.g. audio output devices), each media sink
receiving media In order to reproduce the media data packet at the time represented by the time
stamp of the data packet, for example, a plurality of devices can synchronously output audio.
(Refer to paragraph 0039)
[0007]
JP, 2004-104796, A
[0008]
However, in the case where the system of Patent Document 1 is applied to the usage scene of a
television and a mobile terminal, it is necessary to prepare audio data with a time stamp on the
broadcast station side.
Also, it is necessary for the television and the mobile terminal to have the system clocks of their
own devices, which are the basis of time calculation, be exactly the same.
[0009]
Then, an object of this invention is to provide the information terminal which can synchronize
09-05-2019
2
without using a time stamp, an information device, and the system which consists of these.
[0010]
In order to achieve the above object, for example, the configuration described in the claims is
adopted.
[0011]
According to the present invention, it is possible to provide an information terminal, an
information device, and a system including them that can be synchronized without using a time
stamp.
[0012]
Problems, configurations, and effects other than those described above will be apparent from the
description of the embodiments below.
[0013]
FIG. 1 is a system conceptual diagram of a first embodiment.
FIG. 2 is an example of a block diagram of an audio output device 1 according to a first
embodiment.
FIG. 6 is an example of a data flow diagram of the audio output device 1 according to the first
embodiment.
It is an example of the block diagram of the audio | voice output apparatus 2 of Example 1 and
Example 2. FIG.
FIG. 6 is an example of a data flow diagram of the audio output device 2 of the first embodiment
and the second embodiment.
09-05-2019
3
FIG. 7 is an example of a process flow diagram of the audio output device 1 and the audio output
device 2 according to the first embodiment.
FIG. 7 is a system conceptual diagram of a second embodiment.
FIG. 7 is an example of a configuration diagram of an audio output device 1 according to a
second embodiment. FIG. 10 is an example of a data flow diagram of the audio output device 1
according to the second embodiment. FIG. 7 is an example of a process flow diagram of the audio
output device 1 and the audio output device 2 according to the second embodiment. It is an
example of the volume information management database 1211 of the second embodiment. FIG.
14 is a system conceptual diagram of Example 3; FIG. 16 is an example of a configuration
diagram of the audio output device 1 of a third embodiment. FIG. 18 is an example of a data flow
diagram of the audio output device 1 according to the third embodiment. FIG. 16 is an example
of a configuration diagram of the audio output device 2 of the third embodiment. FIG. 16 is an
example of a data flow diagram of the audio output device 2 of the third embodiment. FIG. 14 is
an example of a process flow diagram of the audio output device 1 and the audio output device 2
according to a third embodiment. It is an example of the sound volume information management
database 1211 of the third embodiment.
[0014]
Examples will be described below with reference to the drawings.
[0015]
In this embodiment, an example in which the audio output device 1 outputs audio in
synchronization with the network-connected audio output device 2 will be described.
[0016]
First, the concept of the system in the present embodiment will be described with reference to
FIG.
[0017]
As shown in FIG. 1, the system of this embodiment comprises an audio output device 1 and an
audio output device 2.
09-05-2019
4
The audio output from the audio output device 2 reaches the user and the audio output device 1.
The audio output from the audio output device 1 reaches the user.
The voice output device 1 and the voice output device 2 are connected by a network, and voice
data is transmitted from the voice output device 2 to the voice output device 1. Audio data refers
to information obtained by encoding audio.
[0018]
Next, a schematic configuration of the audio output device 1 according to the present
embodiment will be described with reference to FIG.
[0019]
As shown in FIG. 2, the audio output device 1 of the present embodiment includes a control
device 11, a recording device 12, an audio input device 13, an audio output device 14, a
communication device 15, an operation input device 16, and a display. And an apparatus 17.
[0020]
The control device 11 is a device that executes the processing program held by the recording
device 12 and controls the overall operation of the device.
[0021]
The recording device 12 is a device that records a processing program that controls the
operation of the voice output device 1, a database that manages various information, voice data,
and the like.
Examples of the recording device 12 include a disk, a tape, a semiconductor, and the like.
The processing program held by the recording device 12 includes a device control processing
09-05-2019
5
unit 121, an audio data acquisition processing unit 122, an audio input processing unit 123, a
time difference measurement processing unit 124, a time adjustment processing unit 125, and
an audio output processing. There is a part 126.
Further, the recording device 12 has an audio data buffer 1212 for temporarily storing audio
data.
[0022]
The device control processing unit 121 is a processing unit that causes the devices of the audio
output device 1 to cooperate with each other to operate as an audio output device. For example,
an audio output function that causes the audio output device 14 to output audio data input to the
communication device 15 is realized. The details of the other processing units will be described
later.
[0023]
The voice input device 13 is a device for inputting voice. An example of the voice input device 13
is a sound collection device such as a microphone.
[0024]
The voice output device 14 is a device that outputs voice. An example of the sound output device
14 is a sound emitting device such as a speaker.
[0025]
The communication device 15 is a device that communicates with other devices via a network.
Examples of communication methods include Universal Serial Bus (USB), Institute of Electrical
and Electronic Engineers (IEEE) 1394, Ethernet (registered trademark), Wireless Local Area
Network (LAN), and High-Definition Multimedia Interface (HDMI). .
09-05-2019
6
[0026]
The operation input device 16 is an interface device by which the user operates the voice output
device 1. Examples of the operation input device 16 include a button, a switch, a key, a dial, a
stick, a mouse, a remote controller, and a touch panel.
[0027]
The display device 17 is a device that displays a device operation screen and the like to the user.
Examples of the display device 17 include a liquid crystal panel, a plasma display panel, and an
organic EL panel. Note that the audio output device 1 may not have the display device 17 in the
device, and may output image data so that a desired image is displayed on the display device 17
connected to the outside of the device. .
[0028]
The audio data buffer 1212 may store audio data temporarily or may store it for a long time.
[0029]
Next, the role and data flow of each processing unit of the audio output device 1 according to the
present embodiment will be described with reference to FIG.
[0030]
FIG. 3 is an example of a data flow diagram of the audio output device 1 according to this
embodiment, but the data flow when the device control processing unit 121 causes the
respective devices of the audio output device 1 to cooperate is omitted.
[0031]
The audio data acquisition processing unit 122 receives communication data including audio
data (hereinafter referred to as acquired audio data 101) from the network-connected audio
output device 2 via the communication device 15, and acquires acquired audio data 101.
Processing unit.
09-05-2019
7
Further, the audio data acquisition processing unit 122 passes the acquired audio data 101 to
the time difference measurement processing unit 124 and stores the acquired audio data 101 in
the audio data buffer 1212.
[0032]
The voice input processing unit 123 is a processing unit that converts voice (hereinafter, referred
to as input voice 103) input by the voice input device 13 into voice data (hereinafter, referred to
as input voice data 104).
Further, the voice input processing unit 123 passes the input voice data 104 to the time
difference measurement processing unit 124.
[0033]
The time difference measurement processing unit 124 is a processing unit that measures the
time difference between the time when a certain feature portion in the acquired voice data 101
can be output and the time when the same or similar feature portion of the input voice data 104
appears.
The time difference measurement processing unit 124 passes the time difference information
105 including the measured time difference to the time adjustment processing unit 125.
[0034]
The time adjustment processing unit 125 is a processing unit that reads the acquired voice data
101 from the voice data buffer 1212, adjusts the time by the time difference extracted from the
time difference information 105, and passes the time adjustment to the voice output processing
unit 126.
[0035]
The voice output processing unit 126 is a processing unit that converts the obtained voice data
09-05-2019
8
101 into voice (hereinafter, referred to as output voice 102) and outputs the voice by the voice
output device 14.
[0036]
Note that the audio data acquisition processing unit 122 may pass the acquired audio data 101
directly to the time difference measurement processing unit 124 or may pass via the data buffer.
This data buffer may be an audio data buffer 1212 or another buffer.
[0037]
Further, the voice input processing unit 123 may pass the input voice data 104 directly to the
time difference measurement processing unit 124 or may pass it via a data buffer.
This data buffer may be an audio data buffer 1212 or another buffer.
[0038]
Next, a schematic configuration of the audio output device 2 according to the present
embodiment will be described with reference to FIG.
[0039]
As shown in FIG. 4, the audio output device 2 of the present embodiment includes a control
device 21, a recording device 22, a broadcast receiving device 23, an audio output device 24, a
communication device 25, an operation input device 26, and a display. And an apparatus 27.
The audio output device 2 is the same as the audio output device 1 shown in FIG. 2 except that it
has the broadcast receiving device 23 and the contents of the processing program recorded by
the recording device 22. Detailed descriptions of components other than the receiving device 23
will be omitted.
09-05-2019
9
[0040]
The recording device 22 is a device that records a processing program that controls the
operation of the voice output device 2, a database that manages various information, voice data,
and the like. Examples of the recording device 22 include a disk, a tape, a semiconductor and the
like. The processing programs held by the recording device 22 include a device control
processing unit 221, an audio data acquisition processing unit 222, a time adjustment processing
unit 223, an audio output processing unit 224, and an audio data transmission processing unit
225. Further, the recording device 22 has an audio data buffer 226 for temporarily storing audio
data, and an audio data recording unit 227 for storing audio data for a long period of time.
[0041]
The device control processing unit 221 is a processing unit that causes the respective devices of
the voice output device 2 to cooperate and operates as a voice output device. For example, an
audio output function that causes the audio output device 24 to output audio data included in
broadcast data received by the broadcast receiving device 23 is realized. The details of the other
processing units will be described later.
[0042]
The broadcast receiving device 23 is a device that receives a signal from the connected antenna /
cable and generates video / audio data based on the received signal. It has functions such as a
tuner, a decoder, and a demultiplexer.
[0043]
The audio data buffer 226 may temporarily store audio data or may store it for a long time.
[0044]
The audio data buffer 226 may be a recording unit different from the audio data recording unit
227 or may be the same recording unit.
09-05-2019
10
[0045]
Although the case where the audio data recording unit 227 of the audio output device 2 is
included in the recording device 22 has been described as an example, the audio data recording
unit 227 is another recording medium not included in the recording device 22. It may be an
external recording medium not included in the audio output device 2.
[0046]
Next, the role and data flow of each processing unit of the audio output device 2 according to the
present embodiment will be described with reference to FIG.
[0047]
FIG. 5 is an example of a data flow diagram of the voice output device 2 according to the present
embodiment, but the data flow when the device control processing unit 221 causes the
respective devices of the voice output device 2 to cooperate is omitted.
[0048]
The audio data acquisition processing unit 222 is a processing unit that receives broadcast data
including the audio data 201 via the broadcast receiving apparatus 23 and acquires audio data.
Further, the voice data acquisition processing unit 222 receives communication data including
voice data from another device on the network via the communication device 25 and obtains
voice data.
Further, the audio data acquisition processing unit 222 reads audio data from the audio data
recording unit 227 of the recording device 22 and acquires audio data.
Hereinafter, audio data acquired by the audio data acquisition processing unit 222 will be
referred to as acquired audio data 201.
[0049]
Also, the audio data acquisition processing unit 222 passes the acquired audio data 201 to the
09-05-2019
11
audio data transmission processing unit 225, and stores the acquired audio data 201 in the audio
data buffer 226.
[0050]
The time adjustment processing unit 223 is a processing unit that reads the acquired audio data
201 from the audio data buffer 226, adjusts the time, and passes the acquired audio data 201 to
the audio output processing unit 224.
[0051]
The voice output processing unit 224 is a processing unit that converts the acquired voice data
201 into voice (hereinafter, referred to as output voice 202) and outputs the voice by the voice
output device 24.
[0052]
The voice data transmission processing unit 225 is a processing unit that generates
communication data including the acquired voice data 201 and transmits the communication
data to the voice output device 1 connected via the network via the communication device 25.
[0053]
Note that the audio data acquisition processing unit 222 may pass the acquired audio data 201
directly to the audio data transmission processing unit 225 or may pass it via a data buffer.
This data buffer may be an audio data buffer 226 or another buffer.
[0054]
Further, when the audio data acquisition processing unit 222 acquires broadcast data including
the audio data 201, the broadcast reception device 23 may receive the broadcast data from the
antenna and the cable to acquire the broadcast data, or the broadcast data may be acquired. May
be acquired from the communication device 25 to extract broadcast data.
[0055]
Next, operations of the audio output device 1 and the audio output device 2 according to the
09-05-2019
12
present embodiment will be described with reference to FIG.
[0056]
First, in the audio output device 2, the audio data acquisition processing unit 222 acquires the
audio data 201 and stores the audio data 201 in the audio data buffer 226 (step 1001).
Next, the audio data transmission processing unit 225 transmits communication data including
the acquired audio data 201 to the audio output device 1 (step 1002).
[0057]
Next, in the audio output device 1, the audio data acquisition processing unit 122 receives
communication data including the acquired audio data 201 (acquired audio data 101 for the
audio output device 1) (step 1002), and acquires the audio data 201. And store it in the audio
data buffer 1212 (step 1003).
[0058]
Next, in the audio output device 2, the time adjustment processing unit 223 adjusts the time of
the acquired audio data 201 (step 1004), and the audio output processing unit 224 starts output
of the output audio 202 (step 1005).
In step 1004, the time adjustment processing unit 223 of the audio output device 2 is sufficient
for the audio output device 1 to output the output audio 102 in synchronization with the output
audio 202 (input audio 103 for the audio output device 1). Delay the output of the output speech
202 by a certain amount of time.
By doing this, voice data is transmitted from the device 2 to the device 1 after the output voice,
so that it is possible to prevent the time adjustment of voice output in the device 1 from
becoming impossible, and voice synchronized output can be performed reliably.
[0059]
09-05-2019
13
Next, in the audio output device 1, the audio input processing unit 123 converts the output audio
202 (input audio 103 for the audio output device 1) into audio data (step 1006).
Next, the time difference measurement processing unit 124 measures the time difference from
the acquired voice data 101 and the input voice data 104 (step 1007), and the time adjustment
processing unit 125 adjusts the time of the acquired voice data 101 (step 1008), The voice
output processing unit 126 starts the output of the output voice 102 (step 1009).
[0060]
The timing of transmission of communication data including voice data (step 1002) may be
before the voice data 201 is acquired in step 1001 and before being stored in the voice data
buffer 226.
[0061]
The voice output device 2 may adjust the time (step 1004) and start voice output (step 1005)
after collectively transmitting the communication data including the voice data (step 1002).
While transmitting communication data including audio data as stream data (step 1002), the
time may be adjusted in parallel (step 1004) and audio output may be started (step 1005).
[0062]
Alternatively, the audio output device 1 may store the acquired audio data 101 in the audio data
buffer 1212 (step 1003) and then measure the time difference (step 1007), or store the acquired
audio data 101 in the audio data buffer 1212. The time difference may be measured in parallel
(step 1007) while (step 1003).
[0063]
Further, in the voice output device 1, the time difference is periodically measured again (step
1007), and when the time difference information 105 is changed, the time of the voice output is
adjusted as needed (step 1008).
[0064]
09-05-2019
14
The voice output device 2 according to the present embodiment transmits the acquired voice
data 101 to the voice output device 1 connected to the network.
Further, the output voice 102 is output by adjusting the time of the acquired voice data 101.
[0065]
Further, the voice output device 1 according to the present embodiment obtains the acquired
voice data 101 from the voice output device 2 connected to the network.
Further, the output voice 202 (input voice 103 for the voice output device 1) output from the
voice output device 2 is converted into the input voice data 104, and a time at which a certain
feature portion in the acquired voice data 101 can be output The time difference between the
time when the same or similar feature of 104 appears is measured.
Further, the output voice 101 is output by adjusting the time of the acquired voice data 101 by
the time difference.
[0066]
Thus, it is possible to provide an audio output device, system and method that can be
synchronized without using a time stamp.
For example, the audio output device 1 and the audio output device 2 can synchronously output
audio without processing the acquired audio data 101 and adding a time stamp.
[0067]
For example, when the voice output device 1 is a mobile terminal and the voice output device 2 is
a television, the user does not have the function of processing voice data and adding a time
stamp to both the mobile terminal and the television. While watching TV, you can keep the
mobile terminal at hand and listen to the audio output synchronously from the TV and mobile
terminal.
09-05-2019
15
[0068]
In the present embodiment, the acquired voice data 101 is described using an example in which
the acquired voice data 201 passed to the voice output device 1 by the voice output device 2, but
the acquired voice data 101 is a voice output device. 1 may be voice data acquired uniquely via
the communication device 15 or the like.
In that case, even if the voice output device 2 does not pass the acquired voice data 201 to the
voice output device 1, the same effect as that of the present embodiment can be obtained.
[0069]
For example, when the output audio 202 of the audio output device 2 is a television broadcast
audio and the audio output device 1 includes a broadcast receiving apparatus, the audio output
device 2 outputs the ID of the broadcast from which the acquired audio data 201 has been
acquired. The audio output device 1 can acquire broadcast data by the broadcast receiving
apparatus of the own device and acquire the same audio data as the acquired audio data 201
simply by passing it to the device 1, and a large amount of audio data is transmitted via the
network It is possible to output the output sound 102 in synchronization with the output sound
202 without doing so.
[0070]
Also, for example, in the case where the voice output device 1 includes a matched voice data
acquisition processing unit that extracts features of the input voice data 104 and obtains
matched voice data from another device, the voice output device 2 to voice output device Even if
the data is not transmitted to 1, the voice output device 1 can acquire the same voice data as the
acquired voice data 201 by itself and the voice output device 2 and the voice output device 1 can
output voice without being connected to the network. The output sound 102 can be output in
synchronization with the signal 202.
[0071]
In the present embodiment, in addition to the first embodiment, an example in which the audio
output device 1 adjusts the volume of the output sound 102 in consideration of the volume of
the input sound 103 will be described.
09-05-2019
16
[0072]
First, the concept of the system in the present embodiment will be described with reference to
FIG.
[0073]
As shown in FIG. 7A, the system of the present embodiment comprises an audio output device 1
and an audio output device 2.
The audio output from the audio output device 2 reaches the user and the audio output device 1.
The audio output from the audio output device 1 reaches the user.
The voice output device 1 and the voice output device 2 are connected by a network, and voice
data is transmitted from the voice output device 2 to the voice output device 1.
[0074]
In FIG. 7B, when the volume of the input voice 103 is large, adjustment is made so that the
volume of the output voice 102 is small. In FIG. 7C, when the volume of the input voice 103 is
small. Are respectively adjusted to increase the volume of the output sound 102.
[0075]
Next, a schematic configuration of the audio output device 1 according to the present
embodiment will be described with reference to FIG.
[0076]
FIG. 8 shows an input sound volume measurement processing unit 127, a sound volume
management processing unit 128, an output sound volume adjustment processing unit 129, and
a sound volume information management database 1211 added to the recording device 12 of the
audio output device 1 of FIG. is there.
09-05-2019
17
The other configuration has the same function as the configuration given the same reference
numeral as already described, so the description thereof is omitted.
[0077]
The volume information management database 1211 is a database used by the volume
management processing unit 128 for storing volume information and determining the output
volume.
Details will be described later.
[0078]
The details of the other processing units will be described later.
[0079]
Next, the role and data flow of each processing unit of the audio output device 1 according to the
present embodiment will be described with reference to FIG.
[0080]
9 adds the input sound volume measurement processing unit 127, the sound volume
management processing unit 128, the output sound volume adjustment processing unit 129, the
sound volume information management database 1211, and the data flow related to these to the
data flow diagram of FIG. It is
The other processing units and data flows have the same functions and the same relationships as
the processing units and data flows to which the same reference numerals are given and which
have already been described, and thus the description thereof will be omitted.
[0081]
09-05-2019
18
The device control processing unit 121 is a processing unit that causes the devices of the audio
output device 1 to cooperate with each other.
In the present embodiment, a process of generating the set volume information 107 including
the information of the volume set by the user operating the operation input device 16 and
passing it to the volume management processing unit 128 will be described as an example.
[0082]
The voice input processing unit 123 passes the input voice data 104 to the input volume
measurement processing unit 127 in addition to FIG.
[0083]
The input volume measurement processing unit 127 is a processing unit that measures the
volume of audio data.
The sound volume of the input sound data 104 received from the sound input processing unit
123 is measured, and input sound volume information 106 including information of the
measured sound volume is generated and passed to the sound volume management processing
unit 128.
[0084]
The sound volume management processing unit 128 is a processing unit that uses the sound
volume information management database 1211 to store sound volume information and to
determine the output sound volume.
The set volume information 107 received from the device control processing unit 121 and the
input volume information 106 received from the input volume measurement processing unit 127
are recorded in the volume information management database 1211.
09-05-2019
19
Further, the output volume is determined according to the determination condition of the volume
information management database 1211 and the volume adjustment method.
Further, the output sound volume information 108 including the information of the output sound
volume is generated and passed to the output sound volume adjustment processing unit 129.
The details of the volume information management database 1211 will be described later.
[0085]
The output volume adjustment processing unit 129 is a processing unit that adjusts the volume
of the output sound.
The output sound volume information 109 of the own device is generated from the output sound
volume information 108 received from the sound volume management processing unit 128 and
passed to the sound output processing unit 126.
[0086]
The audio output processing unit 126 further receives the output sound volume information 109
of the own device from the output sound volume adjustment processing unit 129 in addition to
FIG. 3, and adjusts and outputs the sound volume of the output sound 102.
[0087]
The voice input processing unit 123 may pass the input voice data 104 directly to the input
volume measurement processing unit 127 or may pass it via a data buffer.
This data buffer may be an audio data buffer 1212 or another buffer.
[0088]
09-05-2019
20
Further, the process of determining the output volume in the volume management processing
unit 128 may be determined based on the information managed by the volume information
management database 1211 or the condition branch is provided in the program to implement
the determination process, and the database You may decide without using.
[0089]
Next, operations of the audio output device 1 and the audio output device 2 according to the
present embodiment will be described with reference to FIG.
[0090]
First, in the audio output device 1, when the user operates the operation input device 16 to set
the volume, the volume management processing unit 128 sets the set volume information 107
passed from the device control processing unit 121 to the volume information management
database 1211. Save (step 2001).
[0091]
The following steps 2002 to 2009 are the same processes as steps 1001 to 1008 in FIG. 6,
respectively, so the description will be omitted.
[0092]
Next, in the audio output device 1, the input volume measurement processing unit 127 measures
the volume of the input audio data 104 and passes it to the volume management processing unit
128, and the volume management processing unit 128 stores it in the volume information
management database 1211. (Step 2010).
Next, the volume management processing unit 128 determines the output volume information
108 according to the determination condition of the volume information management database
1211 and the volume adjustment method (step 2011).
[0093]
Next, the output volume adjustment processing unit 129 adjusts the volume of the output sound
102 according to the determined output volume information 108 (step 2012), and the sound
output processing unit 126 starts output of the output sound 102 (step 2013) ).
09-05-2019
21
[0094]
The timing of the process of setting the volume by the user operation and the process of storing
the set volume (step 2001) in the audio output device 1 is arbitrary.
For example, it may be performed before, after, or at the same time as conversion into audio data
(step 2007).
Also, it may be after the voice output start (step 2013) in the voice output device 1.
When the set volume is changed, the volume information management database 1211 is updated
as needed (step 2001), and the output volume is redetermined (step 2011).
[0095]
Also, the volume of the input voice data 104 in the voice output device 1 is periodically
measured again (step 2010), and if the input volume information 106 is changed, the volume
information management database 1211 is updated as needed (step 2010) Redetermining the
output volume (step 2011).
[0096]
Also, the process of measuring and storing the input volume (step 2010) and determining the
output volume (step 2011) may be performed after measuring the time difference (step 2008)
and adjusting the time (step 2009). Before, it may be done in parallel simultaneously.
[0097]
In addition, the adjustment of the output volume (step 2012) may be performed before, after, or
simultaneously with the audio output (step 2013).
[0098]
Next, the volume information management database 1211 according to the present embodiment
will be described with reference to FIG.
09-05-2019
22
[0099]
(A) and (c) of FIG. 11 show an example of sound volume information managed by the sound
volume information management database 1211.
The volume information includes setting volume information 12111 (X), input volume
information 12112 (Y) from the external device, output volume information 12113 (Z) of the
own device, and maximum output volume information 12114 (Zmax) of the own device. It
consists of
9. The set volume information 107 of FIG. 9 is stored corresponding to X of FIG. 11, the input
volume information 106 of FIG. 9 to Y of FIG. 11, and the output volume information 109 of its
own device of FIG. 9 to Z of FIG. Be done.
Here, the own device refers to the audio output device 1, and the external device refers to the
audio output device 2.
[0100]
Here, the maximum output sound volume information 12114 (Zmax) of the own device is
information of the maximum sound volume which is permitted from the viewpoint of comfort
when it is outputted by the own device, and in this embodiment, it does not change during use.
An example is given and demonstrated.
The audio output device 14 is generally not comfortable for the user because the sound is broken
or distorted when output at a volume close to the maximum volume that can be output.
For this reason, the user's voice listening environment can be optimized by using the maximum
sound volume permitted from the viewpoint of comfort instead of the maximum sound volume
that can be output.
09-05-2019
23
[0101]
Note that the maximum output volume information 12114 (Zmax) of the own device may be
information of the maximum volume that is acceptable from the viewpoint of comfort when it is
output by the own device, or of the maximum volume that can be output by the own device. It
may be information.
[0102]
(A) is an example of volume information before determination of output volume, and indicates
that X is 13, Y is 3, Z is 9, and Zmax is 15.
(C) is an example of sound volume information after determination of output sound volume, and
indicates that X is 13, Y is 3, Z is 10, and Zmax is 15.
[0103]
(B) of FIG. 11 illustrates an example of output sound volume determination information for the
sound volume management processing unit 128 to determine the output sound volume. The
output volume determination information includes a determination priority 12115 indicating the
order of applying the determination conditions, a determination condition 12116 for deriving the
volume adjustment method of the own device from the current volume information, and the
volume adjustment method 12117 of the own device.
[0104]
For example, in the case where the volume information (a) before the output volume
determination is applied to the output volume determination information (b), the determination is
first made with the determination condition “X> Zmax” of the determination priority 1. Since
the determination result is false, it is determined by the determination condition “X> Y + Z” of
determination priority order 2. Since the determination result is true, the volume of the own
device is increased by 1 according to the volume adjustment method “increase by X-Y-Z”. As a
result, volume information (c) after output volume determination is obtained. Although Z is 9 in
the volume information (a) before the determination of the output volume, as a result of
09-05-2019
24
increasing the volume of the own device by 1, Z is 10 in the volume information (c) after the
determination of the output volume.
[0105]
In the present embodiment, although the case where the user operates to specify the set volume
has been described as an example, the output volume of the audio output device 1 may be
changed regardless of the user's specification of the set volume. good. In this case, for example,
the volume management processing unit 128 sums the input volume (Y) from the external device
and the output volume (Z) of the own device immediately after the user changes the output
volume of the audio output device 1 , Save as setting volume information (X).
[0106]
The audio output device 1 according to the present embodiment, in addition to the embodiment
1, outputs the output sound volume information 108 based on the set sound volume information
107 by user operation and the input sound volume information 106 obtained by measuring the
sound volume of the input sound data 104. Get
[0107]
Therefore, it is possible to provide an audio output device, system and method capable of
synchronously outputting at an appropriate volume without passing time stamps and volume
information between the devices.
For example, the audio output device 1 and the audio output device 2 can synchronously output
voice at an appropriate volume without processing the acquired voice data 101 and adding a
time stamp or volume information.
[0108]
For example, the voice output device 1 is a mobile terminal, the voice output device 2 is a
television, the user places the mobile terminal at hand while watching a television, and listens to
the audio output synchronously from the television and the mobile terminal Assume that
09-05-2019
25
[0109]
When the user leaves the television with the mobile terminal, the volume of the television
reaching the user and the mobile terminal decreases.
At this time, the mobile terminal according to the present embodiment raises the volume of the
output voice to compensate for the reduced volume. Conversely, when approaching a television,
the volume of the television reaching the user and the mobile terminal increases, so the mobile
terminal reduces the volume of the output sound. Therefore, the user can always hear the same
volume of sound regardless of the distance from the television.
[0110]
In this embodiment, in addition to the second embodiment, an example in which the audio output
device 1 controls the audio output device 2 to adjust the volume of the output audio 202 will be
described.
[0111]
First, the concept of the system in the present embodiment will be described with reference to
FIG.
[0112]
As shown in FIG. 12, the system of this embodiment comprises an audio output device 1 and an
audio output device 2.
The audio output from the audio output device 2 reaches the user and the audio output device 1.
The audio output from the audio output device 1 reaches the user. The voice output device 1 and
the voice output device 2 are connected by a network, and voice data is transmitted from the
voice output device 2 to the voice output device 1.
[0113]
09-05-2019
26
Further, volume control information is transmitted from the audio output device 1 to the audio
output device 2.
[0114]
Next, a schematic configuration of the audio output device 1 according to the present
embodiment will be described with reference to FIG.
[0115]
FIG. 13 shows an example in which an external device control processing unit 1210 is added to
the recording device 12 of the audio output device 1 of FIG.
The other configuration has the same function as the configuration given the same reference
numeral as already described, so the description thereof is omitted.
[0116]
The details of the external device control processing unit 1210 will be described later.
[0117]
Next, the role and data flow of each processing unit of the audio output device 1 according to the
present embodiment will be described with reference to FIG.
[0118]
FIG. 14 shows the data flow diagram of FIG. 9 with the external device control processing unit
1210 and the data flow related thereto added.
The other processing units and data flows have the same functions and the same relationships as
the processing units and data flows to which the same reference numerals are given and which
have already been described, and thus the description thereof will be omitted.
09-05-2019
27
[0119]
The output sound volume adjustment processing unit 129 further generates output sound
volume information 110 of the external device in addition to FIG. 9 and passes it to the external
device control processing unit 1210.
[0120]
The external device control processing unit 1210 generates communication data including the
volume control information 111 from the output volume information 110 of the external device
received from the output volume adjustment processing unit 129, and transmits the
communication device 15 to the voice output device 2 connected to the network. Is a processing
unit that transmits data.
The volume control information 111 is information for controlling the volume of the audio
output device 2.
The volume control information 111 may be an amount and direction for changing the volume of
the audio output device 2 or may be a volume set by the audio output device 2.
For example, in the case of changing the volume of the audio output device 2 from 8 to 10 at
present, “increase the volume by 2 units” or “set the volume to 10” may be used.
[0121]
Next, a schematic configuration of the audio output device 2 according to the present
embodiment will be described with reference to FIG.
[0122]
In FIG. 15, an output volume adjustment processing unit 228 is added to the recording device 22
of the audio output device 2 of FIG.
The other configuration has the same function as the configuration given the same reference
09-05-2019
28
numeral as already described, so the description thereof is omitted.
[0123]
The details of the output volume adjustment processing unit 228 will be described later.
[0124]
Next, the role and data flow of each processing unit of the voice output device 2 according to the
present embodiment will be described with reference to FIG.
[0125]
FIG. 16 shows the data flow diagram of FIG. 5 with the output volume adjustment processing unit
228 and the data flow related thereto added.
The other processing units and data flows have the same functions and the same relationships as
the processing units and data flows to which the same reference numerals are given and which
have already been described, and therefore the description thereof is omitted.
[0126]
The device control processing unit 221 is a processing unit that causes the devices of the audio
output device 2 to cooperate with each other.
In this embodiment, communication data including the volume control information 203 (volume
control information 111 for the audio output device 1) is received from the audio output device 1
on the network via the communication device 25, and the volume control information 203 is
extracted. The process will be described by way of example. The device control processing unit
221 passes the extracted sound volume control information 203 to the output sound volume
adjustment processing unit 228.
[0127]
The output sound volume adjustment processing unit 228 generates the output sound volume
09-05-2019
29
information 204 of the own device from the sound volume control information 203 received
from the device control processing unit 221, and passes it to the sound output processing unit
224.
[0128]
The audio output processing unit 224 further receives the output sound volume information 204
of the own device from the output sound volume adjustment processing unit 228 in addition to
FIG. 5, and adjusts and outputs the sound volume of the output sound 202.
[0129]
Next, operations of the audio output device 1 and the audio output device 2 according to the
present embodiment will be described with reference to FIG.
[0130]
Steps 3001 to 3010 are the same as steps 2001 to 2010 in FIG. 10, respectively, so the
description will be omitted.
[0131]
Next, in the audio output device 1, the volume management processing unit 128 determines the
output volume information 109 of the own device and the output volume information 110 of the
external device according to the determination condition of the volume information management
database 1211 and the volume adjustment method (step 3011).
Next, the external device control processing unit 1210 generates communication data including
the volume control information 111, and transmits the communication data to the audio output
device 2 via the communication device 15 (step 3012).
[0132]
Next, in the audio output device 2, the device control processing unit 221 acquires
communication data including the volume control information 203 (volume control information
111 for the audio output device 1) through the communication device 25 (step 3012). The
09-05-2019
30
volume control information 203 is acquired.
Next, the output volume adjustment processing unit 228 adjusts the volume of the output sound
202 according to the volume control information 203 (step 3013).
[0133]
In the audio output device 1, the process of generating communication data including the volume
control information 111 and transmitting it to the audio output device 2 (step 3012) may be
performed after the volume adjustment (step 3014) of the output audio 102, It may be done
before or in parallel.
[0134]
Further, the adjustment of the output volume of the audio output device 1 (step 3014) may be
performed before, after or at the same time as the audio output (step 3015).
[0135]
Further, the voice output device 1 gives the volume control information 111 (volume control
information 203 for the voice output device 2) to the voice output device 2 via the network, and
gives an example in the case of controlling the volume of the voice output device 2. Although
described, the volume of the audio output device 2 may be controlled by another route.
For example, the infrared transmission device transmits the same signal as the infrared signal
transmitted when the voice output device 1 includes the infrared transmission device and the
button for controlling the volume is pressed in the infrared remote controller of the voice output
device 2; The volume of the audio output device 2 may be controlled.
[0136]
Further, the volume control information 203 may be the volume control information 111 or
another volume control information for performing the same control.
[0137]
Next, the volume information management database 1211 according to this embodiment will be
09-05-2019
31
described with reference to FIG.
[0138]
FIG. 18 changes the items and data of the output sound volume determination information (b)
and the data of the sound volume information (c) after the output sound volume determination
with respect to FIG.
The other items and data have the same meanings as the items and data given the same
reference numerals as already described, and thus the description thereof is omitted.
[0139]
The set volume information 107 in FIG. 14 is stored corresponding to X in FIG. 18, the input
volume information 106 in FIG. 14 is stored in Y in FIG. 18, and the output volume information
109 in the own device in FIG. Be done.
[0140]
Volume information (c) after determination of the output volume in FIG. 18 indicates that X is 13,
Y is 0, Z is 13 and Zmax is 15.
[0141]
The output volume determination information (b) of FIG. 18 further includes a volume
adjustment method 12118 of the external device in addition to FIG.
[0142]
For example, when the volume information (a) before the output volume determination is applied
to the output volume determination information (b), the determination is first made based on the
determination condition “X ≦ Zmax” of the determination priority 1.
Since the determination result is true, the volume of the own device is set to 13 in accordance
with the volume adjustment method of the own device “X”.
09-05-2019
32
Also, the volume of the external device is set to 0 according to the volume adjustment method of
the external device “set to 0”.
As a result, volume information (c) after output volume determination is obtained.
In the volume information (a) before determination of output volume, Y is 3 and Z is 9, but as the
volume of the own device is set to 13 and the volume of the external device is set to 0, volume
information after determination of output volume (c) Then Y is 0 and Z is 13.
[0143]
Further, when the determination result in the determination condition of the determination
priority order 2 is true, the volume adjustment method of the external device is “adjust to be X
= Zmax + Y”.
If the volume of the output voice 202 of the external device is raised by the volume control
information 203 (volume control information 111 for the audio output device 1), the volume of
the input voice 103 reaching the device itself is increased Varies depending on the distance
between the device and the external device and the environment.
Therefore, for example, the volume of the external device is slightly changed by the volume
control information 203, the change in volume of the input sound 103 at that time is measured,
and adjustment is performed until the desired input volume is reached.
[0144]
In the present embodiment, the case of “set to 0” is described as an example of the volume
adjustment method of the external device when the determination condition is “X ≦ Zmax”,
but may not be set to 0.
09-05-2019
33
For example, the volume of the own device may be slightly lower than “X”, and the volume of
the external device may be increased accordingly.
[0145]
In addition to the second embodiment, the audio output device 1 according to the present
embodiment determines the volume adjustment method of the external device, transmits volume
control information to the audio output device 2, and controls the volume of the audio output
device 2.
[0146]
For this reason, it is possible to provide an audio output device, system and method capable of
synchronously outputting at an appropriate volume without using time stamps and without
including volume information in audio data.
For example, the audio output device 1 and the audio output device 2 can synchronously output
voice at an appropriate volume without processing the acquired voice data 101 and adding a
time stamp or volume information.
[0147]
For example, the voice output device 1 is a mobile terminal, the voice output device 2 is a
television, the user places the mobile terminal at hand while watching a television, and listens to
the audio output synchronously from the television and the mobile terminal Assume that
[0148]
When the user holds the mobile terminal and is away from the television, the volume of the
television reaching the user and the mobile terminal is small.
At this time, the mobile terminal according to the present embodiment outputs sound at the set
volume, and sets the output volume of the television to zero. Therefore, the user can listen to the
sound of the set volume without causing the television to output the sound at a large volume and
causing trouble to other people around.
09-05-2019
34
[0149]
The embodiments of the present invention have been described above.
[0150]
The present invention is not limited to the embodiments described above, but includes various
modifications.
For example, the embodiments described above are described in detail in order to explain the
present invention in an easy-to-understand manner, and are not necessarily limited to those
having all the configurations described. Also, part of the configuration of one embodiment can be
replaced with the configuration of another embodiment, and the configuration of another
embodiment can be added to the configuration of one embodiment. In addition, with respect to a
part of the configuration of each embodiment, it is possible to add, delete, and replace other
configurations.
[0151]
Further, each of the configurations, functions, processing units, processing means, etc. described
above may be realized by hardware, for example, by designing part or all of them with an
integrated circuit. Further, each configuration, function, etc. described above may be realized by
software by the processor interpreting and executing a program that realizes each function.
Information such as programs, tables and files to realize each function should be placed in
memory, hard disk, recording device such as SSD (Solid State Drive), or recording medium such
as IC card, SD card, DVD, BD etc. it can.
[0152]
Further, control lines and information lines indicate what is considered to be necessary for the
description, and not all control lines and information lines in the product are necessarily shown.
In practice, almost all configurations may be considered to be mutually connected.
09-05-2019
35
[0153]
DESCRIPTION OF SYMBOLS 1 audio output apparatus 11 control apparatus 12 recording
apparatus 13 audio input apparatus 14 audio output apparatus 15 communication apparatus 16
operation input apparatus 17 display apparatus 2 audio output apparatus 21 control apparatus
22 recording apparatus 23 broadcast receiving apparatus 24 audio output apparatus 25
communication apparatus 26 Operation input device 27 Display device
09-05-2019
36
Документ
Категория
Без категории
Просмотров
0
Размер файла
46 Кб
Теги
jp2013007876
1/--страниц
Пожаловаться на содержимое документа