close

Вход

Забыли?

вход по аккаунту

?

JP2013106278

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2013106278
Abstract: [Problem] Indoor and underground space can be used as an operation environment, can
cope with movement by walking of a user of a portable device, and position information etc. can
be transmitted to the portable device without harming the landscape of the operation
environment. provide. SOLUTION: An information providing system has a function of outputting
an acoustic signal utilizing an upper limit range of audio frequencies, and a plurality of acoustic
signal outputs are provided apart from each other so that the reach of each acoustic signal is
different. The apparatus includes at least one management server for specifying data to be
transmitted to each sound signal output device. Each sound signal output device selects one or
more frequencies corresponding to the data designated by the management server from a
predetermined number of frequencies included in the frequency range utilizing the upper limit of
the audio frequency, and is selected Output a sine wave of frequency as an acoustic signal. The
portable device has a function of receiving an acoustic signal utilizing the upper limit of the audio
frequency, detects the frequency of the received acoustic signal, and based on the data
represented by the detected one or more frequencies, Ask for information. [Selected figure]
Figure 1
INFORMATION PROVIDING SYSTEM, ACOUSTIC SIGNAL OUTPUT DEVICE, COMPUTER
PROGRAM, PORTABLE DEVICE PROGRAM, DATA TRANSMISSION METHOD, AND INFORMATION
ACQUIRING METHOD
[0001]
The present invention relates to a technology for providing mobile portable devices with
information (for example, position information etc.) dependent on the current location of the
portable devices.
03-05-2019
1
[0002]
Acquisition of position information using a portable device (for example, a smartphone or the
like) is becoming increasingly important in the fields of augmented reality (AR), navigation,
communication, maintenance work, sales support applications, and the like.
[0003]
Conventionally, position detection using GPS (Global Positioning System) has been mainly used
outdoors, but in recent years estimation by collective intelligence of WiFi (wireless LAN) access
points and position estimation by WiFi received signal strength are also available. (See, for
example, Patent Document 1).
[0004]
GPS is a technology for acquiring position information using radio waves transmitted from a
plurality of GPS satellites.
It is widely used in car navigation systems, outdoor map services, and location games.
However, it is known that errors of more than a dozen meters occur in consumer devices, and the
use of radio signals transmitted from artificial satellites restricts their use in indoor and
underground spaces.
Even in the outdoor, depending on conditions, it may take a long time to obtain location
information. For example, when A-GPS linked with the third generation mobile phone system is
not available, orbit data of GPS satellites is transmitted at a transmission rate of 50 bps with a
period of 30 seconds in GPS specifications, so the time until positioning is It also gets longer.
[0005]
There are two types of position estimation technology using WiFi, a BSSID method and an RSSI
method. The BSSID method is a technology in which BSSID information of a WiFi base station is
accumulated in advance, and a position is estimated by the BSSID detected at a place where the
03-05-2019
2
position is desired to be specified. Positioning accuracy will depend on the degree of integration
of the WiFi base station. The RSSI scheme is a technology for estimating a position by RSSI
(received signal strength) between a target mobile device and a WiFi base station in an available
range. A database for mapping RSSI and position information is constructed in advance, and
Bayesian estimation (probability calculation) is performed based on the RSSI measured when
acquiring the position to determine the position.
[0006]
However, in the case of WiFi, it is generally known that an error of about 3 to 10 meters occurs.
In addition, in particular, in the method of acquiring the received signal strength between the
WiFi access point and the mobile device to estimate the position, it is necessary to perform a
great deal of work to register the received signal strength in advance. Furthermore, when trying
to estimate the position actually, received signal strength with all the access points will be
acquired and estimation will be performed, so assuming 1 to 2 seconds per access point, 5 access
points were used The estimation requires a time of at least about 5 to 10 seconds.
[0007]
As another method, there is a two-dimensional code method of acquiring a position using a
camera incorporated in a general smartphone or the like. Position information is embedded in a
QR code (registered trademark), which is a type of two-dimensional code, and the code is
attached to a passage, a wall, or the like. It is a technique of acquiring position information by
photographing this QR Code (registered trademark) with a camera of a smartphone. It is attached
to the exhibit and is also used for operations such as obtaining stamp location information like a
stamp rally. Two-dimensional codes are considered to be effective for obtaining an absolute
position. However, in order to recognize a two-dimensional code, restrictions in the positional
relationship of the camera and optical adjustment such as focal length are required, and it takes
time until position detection.
[0008]
Furthermore, although it is not built in to a general smart phone etc., it is a technology that
enables location information acquisition by connecting an external device to the smart phone etc
via an external interface (USB, Bluetooth (registered trademark) etc.) Exists.
03-05-2019
3
[0009]
One is the use of RFID, which is a technology that uses a small device that can transmit and
receive wireless as an ID.
An RFID can be identified by a distance of several millimeters to several meters, and is also used
to determine the position of an object. In order to use it on a smartphone, it is necessary to
connect a dedicated reader via an external interface. RFID is considered to be suitable for
obtaining absolute position information.
[0010]
The other is a technology to use for pedestrian autonomous navigation (PDR) using an
acceleration sensor or a gyro sensor. The minute changes detected by the sensor are integrated
to estimate the distance and direction. Some of the latest smartphones are also beginning to ship
with products that include these sensors. There is also a technology that uses a barometric
pressure sensor to estimate altitude, but since there are few products built into smartphones,
they are connected via an external interface. Position detection using a sensor is attracting
attention as a technique for acquiring a relative position.
[0011]
JP 2008-519495 gazette
[0012]
Among the conventional position information acquisition techniques described above, GPS
technology acquires radio waves transmitted from a plurality of GPS satellites on the portable
device side to calculate the position, and therefore, it can be used indoors and underground
spaces where radio waves are difficult to reach There is a problem of being limited.
[0013]
Further, in the above-described prior art, there is a problem that it takes time to detect the
position, and there is a restriction on the target action or operation.
03-05-2019
4
For example, it is difficult in the prior art to perform position detection of the portable device in
real time while the user of the portable device is walking.
[0014]
Specifically, in the case of position information acquisition by GPS, depending on the accuracy to
be obtained, it may take several minutes to perform position detection.
In the case of position estimation based on WiFi reception signal strength, the reception signal
strength with all WiFi base stations available on the mobile device side is acquired, and Bayesian
estimation etc. is performed based on the reception signal strength stored in the database
prepared in advance. It takes about 5 to 10 seconds to calculate position information using it.
Most of this time is the time taken to acquire the received signal strength, and as the number of
available WiFi base stations increases, the time taken for acquisition also increases.
[0015]
In addition, in the method of performing image processing with a camera incorporated in a
smartphone or the like using a two-dimensional code or an AR marker and acquiring position
information, in order to appropriately acquire the two-dimensional code or AR marker, the
smartphone or the like It is also difficult to recognize at walking speed, because it is necessary to
make it stand still and recognize.
[0016]
Among the above-described conventional techniques, the method of acquiring an absolute
position using a two-dimensional code or an AR marker has a problem that the view of the
operation environment is lost.
This is because it is necessary to attach a two-dimensional code or an AR marker to a floor, a
wall, a ceiling or the like. These two-dimensional codes, etc. depend on the expected accuracy,
but it is desirable to install them every few meters, so the number increases, and it may be
pointed out that the facility manager or user may damage the landscape. Is high.
03-05-2019
5
[0017]
Furthermore, in the above-mentioned prior art, there is also a problem that the error is large. It
takes time to acquire position information In the case of position estimation based on GPS and
WiFi reception signal strength, while getting position information on the portable device side,
you have already moved from that place to another place by walking It is thought that the error
will increase as a result. Moreover, in the case of PDR by a sensor such as an acceleration or a
gyro, it is clear that accumulation of a small error causes position information such as distance
and direction to deviate greatly from reality.
[0018]
Among the above-described conventional techniques, a method that requires connection of an
external device is good when limited to a specific user and provided, but there is a problem in
widespread use. It can be expected to be widely used by general consumers if it can be realized
only by the device built into the smartphone etc. from the beginning, but an external device is
separately provided for location information acquisition and connected to the smartphone etc. In
operation, it takes time and cost, and there is a high possibility that cooperation can not be
obtained.
[0019]
In view of the above-described circumstances, the present invention can also be used as an
operation environment in indoor and underground spaces, can cope with movement by walking
of a user of a portable device, and can be portable without harming the landscape of the
operation environment. An object of the present invention is to provide a mechanism capable of
acquiring position information and the like using a function generally incorporated in a device.
[0020]
An example system in accordance with the principles of the present invention provides
information to at least one portable device that is capable of receiving an acoustic signal that
utilizes an audio frequency upper limit.
03-05-2019
6
The present system has a function of outputting an acoustic signal utilizing an upper limit range
of audio frequencies, and a plurality of acoustic signal output devices installed apart from one
another so that the ranges reached by the respective acoustic signals are different; And at least
one management server, which is connected with the audio signal output device in a network,
and for each audio signal output device, the audio signal output device designates data to be
transmitted by the audio signal. Each of the sound signal output devices selects and selects one
or more frequencies corresponding to the data specified by the management server from a
predetermined number of frequencies included in a frequency range using the upper limit range
of audio frequencies. Means for outputting a sine wave of the selected frequency as an acoustic
signal. The portable device detects a frequency of an acoustic signal received from a part of the
plurality of acoustic signal output devices, and obtains the information based on data represented
by one or more detected frequencies. .
[0021]
According to this configuration, since an acoustic marker technology using an acoustic signal in a
high frequency range that is hard to be recognized by human beings is used, it can be operated
indoors or in underground space, detect position information etc. at high speed, and detect errors
also in operation environment It will be possible to make it smaller. Since it is an acoustic signal,
it does not harm the view of the operating environment, and the function of receiving the
acoustic signal is generally incorporated in a portable device.
[0022]
The acoustic marker technology in the present system causes the acoustic signal output device to
transmit the high frequency range sine wave superimposed with one or more frequencies
without modulating and demodulating it, and causes the portable device that has received the
acoustic signal to analyze the signal. Information (position information etc.) is provided to the
portable device based on the extracted data (for example, the acoustic signal identification ID).
Since frequency detection of high-pitched sine waves can be performed at high speed in a
portable device, position detection can be performed in real time, even in a non-stationary state
and walking speed. The position information obtained based on the data represented by the
detected frequency may be used as an absolute position as it is, or to correct relative position
information obtained by pedestrian autonomous navigation (PDR) or the like. You may use.
03-05-2019
7
[0023]
In the above system, the data may be represented by a predetermined number of bits, and the
value of each bit may be represented by the presence or absence of an output of each sine wave
of the predetermined number of frequencies.
[0024]
As a result, the portable device that has detected the sine wave frequency in the high range sets,
for example, a value of 1 for the detected frequency among the predetermined number of
frequencies, and a value of 0 for the undetected frequency. By replacing the bit string, it is
possible to obtain data transmitted from the acoustic signal output device, which enables faster
processing.
[0025]
In the above system, a frequency range using the upper limit range of the audio frequency is
divided into a plurality of sub frequency ranges, and each of the acoustic signal output devices
has a frequency corresponding to the data specified by the management server, The frequency is
selected from the frequencies included in one of the plurality of sub-frequency bands, and the
management server is configured to select the frequencies within different sub-frequency bands
in which two or more acoustic signal output devices overlap in reach of acoustic signals. The
respective sound signal output devices may be instructed to perform the selection of.
[0026]
Thereby, even if the portable device receives acoustic signals from two or more acoustic signal
output devices at the same time, the acoustic signals interfere with each other because the
selected frequency is received in different sub-frequency regions. It will be possible to prevent
[0027]
In the above system, the data is represented by a combination of which one of the frequencies
included in one sub frequency range is selected and which one of the sub frequency ranges is
used. It is also good.
[0028]
By this, while preventing the interference of the acoustic signal, the information amount
transmittable by the acoustic signal is increased by the number of times in the frequency range
from the information amount possessed by the number of bits of the number of frequencies
constituting one sub frequency range. It becomes possible.
03-05-2019
8
[0029]
In the above-described system, the management server may include means for controlling so that
the number of acoustic signal output devices overlapping in the reach of acoustic signals does
not exceed the number of the sub frequency ranges.
[0030]
This makes it possible to ensure that there is no place where interference of the acoustic signal
occurs throughout the system.
Control the arrangement and / or output level of the sound signal output device so that the
number of sound signal output devices with a given number of sub-frequency ranges and the
reach of the sound signal overlap is less than the given number. The number of sound signal
output devices that the sound signals reach may overlap with each other, and the number of sub
frequency ranges may be matched to the given number and controlled to perform frequency
range division. It is also good.
[0031]
In the above system, the management server may be provided with means for specifying an
output level of an audio signal to each of the audio signal output devices based on a report from
a monitor device receiving the audio signal. .
[0032]
This makes it possible to ensure that the range in which the acoustic signal reaches reaches the
range that the system administrator desires to provide information to the portable device that
has entered the range.
In addition, for example, it is possible to prevent the range in which the acoustic signal reaches
overlapping, except in the case where it is permitted to overlap the range in which the acoustic
signal reaches by using the sub-frequency range described above.
03-05-2019
9
[0033]
In the above system, the data is capable of identifying the information, and the portable device is
connected to the management server via a network, and transmits the information identified
using the data. Request to the management server, and the information may be obtained by
receiving the information transmitted in response to the request.
[0034]
Thus, the amount of information that can be transmitted by the acoustic signal has a limit
depending on the number of frequencies included in the frequency range that uses the upper
limit of the audio frequency, and the information identified by the data transmitted by the
acoustic signal By providing again to the mobile device from the management server, it is
possible to increase the amount of information that can be provided without limitation.
[0035]
In the above system, the management server designates the data to be transmitted by each of the
sound signal output devices as sound signals so as to change with the passage of time, and stores
the validity period of each data. And means for rejecting transmission of the information
identified using the data if the time indicated by the request received from the portable device is
not within the valid period for the data relating to the request. It may be provided.
[0036]
This makes it possible to fail an attempt to illegally obtain information by recording an audio
signal without giving information unless the portable device is a request based on data received
within the effective period. become.
Note that the time indicated by the request may be the time when the management server
receives the request from the portable device, or when the portable device transmits the request
to the management server, the acoustic signal, that is, the data that is the basis of the request
May include the time received.
[0037]
In the above system, the management server receives from the portable device a means for
storing data to be transmitted by each of the sound signal output devices by sound signal and
03-05-2019
10
information on the installation position of each sound signal output device. If it is determined
that the position of the portable device indicated by the request is not within the reach of the
acoustic signal from the installation position of the acoustic signal output device that has
transmitted the data relating to the request, using the data And means for refusing transmission
of the identified information.
[0038]
In this way, the information is not given unless the portable device actually receives the data by
receiving the data by the sound signal output device that transmits the data, and the sound signal
from another person while being in another place It is possible to make an attempt to obtain
information illegally fail by having it be sent.
In addition, as a position of the portable device indicated by the request, for example, information
of GPS incorporated in the portable device may be included in the request that the portable
device transmits to the management server.
Since the GPS position information is not accurate as described above, it is determined on the
assumption that the position information is within the reach of the sound signal from the
corresponding sound signal output device.
[0039]
In the above system, the data transmitted by each of the sound signal output devices by sound
signals includes data defined by the location where the sound signal output devices are installed,
and the portable device is configured to calculate the locations from the data. The information
may be obtained by extracting information related to
[0040]
Thereby, the portable device detects a rough position only from the data transmitted by the
acoustic signal, without providing the information identified by the data transmitted by the
acoustic signal from the management server to the portable device again. For example, it is
possible to inform the user of the rough position or to vary the operation of acquiring detailed
information depending on where the rough position is.
03-05-2019
11
[0041]
In the above system, among the plurality of acoustic signal output devices, one part is installed in
another area, another part is installed in another area, and a plurality of frequency bands using
the upper limit of the audio frequency are provided. The audio signal output device is divided
into an individual sub frequency range and one common sub frequency range, and a frequency
corresponding to data identifying the area is selected from the frequencies included in the
common sub frequency range, The frequency corresponding to the data specified by the
management server other than the above is selected from the frequencies included in one of the
plurality of individual sub-frequency bands, and the management server is installed in the same
area. Instructing each of the acoustic signal output devices to perform selection of the frequency
in different individual sub-frequency ranges for one or more acoustic signal output devices It
may be used as the.
[0042]
As a result, the same part of the data to be transmitted utilizes the common sub-frequency band,
and the individual sub-frequency band is used for the different part. Therefore, the number of
frequencies included in the frequency band using the upper limit of the audio frequency
However, it is possible to make effective use of the amount of information that can be
transmitted as much as possible.
[0043]
In the above system, the data transmitted by each of the acoustic signal output devices by
acoustic signals includes data for error correction of data to be transmitted, and the portable
device is detected from the received acoustic signals. The data represented by one or more
frequencies may be subjected to error correction processing to obtain the information.
[0044]
As a result, even if all frequencies can not be detected from a sine wave on which a plurality of
frequencies are superimposed, it is possible to obtain correct data by error correction.
[0045]
In the above system, a frequency range using the upper limit range of the audio frequency is
divided into a plurality of sub-frequency ranges, and each of the audio signal output devices is
also used to correct the frequency corresponding to the data to be transmitted. The frequency
corresponding to the data is also selected from the frequencies included in the same one of the
plurality of sub-frequency bands, and the management server is configured to output two or
more acoustic signal outputs that overlap in reach of acoustic signals. The respective audio signal
03-05-2019
12
output devices may be instructed so that the devices select the frequency in different subfrequency ranges.
[0046]
Thus, in the situation where the portable device simultaneously receives audio signals from two
or more audio signal output devices, both the data to be transmitted and the data for error
correction are received within different sub-frequency regions. As a result, it is possible to
perform error correction while preventing interference of the acoustic signal, and it becomes
possible for the portable device to receive data reliably.
[0047]
In the above system, the management server can communicate with an information server that
stores information about items placed in the vicinity of each of the sound signal output devices,
from the sound signal output devices in the vicinity of the place where the items are placed. The
portable device may be configured to receive information on the item and to provide the portable
device that has received the acoustic signal and transmitted the data transmitted by the acoustic
signal to the management server.
[0048]
This makes it possible to inform a user who carries and moves the portable device in the
operation environment in which various items are arranged, of information about the item
passing by.
[0049]
In the above system, the management server can communicate with an information server that
collects information indicating the user of the portable device has moved through the
neighborhood of which audio signal output device, and the user has passed The information
server receives information about the user and the position of the portable device that has
received an acoustic signal from an acoustic signal output device in the vicinity of the place and
transmitted the data transmitted by the acoustic signal to the management server It is good also
as what is notified.
[0050]
This makes it possible to collect information such as the trajectory of the user moving with the
portable device in the operation environment and to notify the operation manager.
03-05-2019
13
[0051]
The invention of the information providing system described above is an invention of a method
of the whole system, an invention of an acoustic signal output device constituting the present
system, and an invention of a management server (apparatus). Furthermore, as a device
invention, a method invention corresponding to each device, a program for operating a general
purpose computer or a portable device as each device (or a recording medium recording the
program) The invention also holds true.
[0052]
For example, an example audio signal output device in accordance with the principles of the
present invention is an audio system to provide a system for providing information to at least
one portable device capable of receiving an audio signal utilizing an upper limit of audio
frequency. It has a function of outputting an acoustic signal utilizing the upper limit of the
frequency, and other acoustic signal output devices constituting the system are disposed apart
from each other so that the reach of each acoustic signal is different.
Means for communicating with at least one management server for specifying the data to be
transmitted by the acoustic signal output device by means of the acoustic signal for each of the
acoustic signal output devices constituting the system; Select one or more frequencies
corresponding to the data specified by the management server from a predetermined number of
frequencies included in the frequency range that uses the upper limit range of and output a sine
wave of the selected frequency as an acoustic signal And means for
The information may then be determined based on data represented by one or more frequencies
of the acoustic signal received by the portable device.
[0053]
Also, a computer program according to an example in accordance with the principles of the
present invention is a system for providing information to at least one portable device installed in
a computer and having a function of receiving an acoustic signal utilizing an upper limit of audio
frequency. Operate the computer as a management server in
03-05-2019
14
This program has a function of outputting an audio signal using the upper limit of the audio
frequency, and communicates with a plurality of audio signal output devices installed apart from
each other so that the reach of each audio signal is different. And an instruction code for
specifying, for each of the audio signal output devices, data to be transmitted by the audio signal
output device by the audio signal.
Then, each of the acoustic signal output devices selects one or more frequencies corresponding
to the data designated by the management server from a predetermined number of frequencies
included in a frequency range using the upper limit range of the audio frequency. A sinusoidal
wave of a selected frequency can be output as an acoustic signal, and the portable device detects
and detects the frequency of the acoustic signal received from a part of the plurality of acoustic
signal output devices. The information can be determined based on data represented by one or
more frequencies.
[0054]
In addition, a mobile device program according to an example according to the principle of the
present invention is installed in a mobile device to cause the mobile device to acquire information
provided from a system.
The system has a function of outputting an audio signal using an upper limit range of audio
frequencies, and a plurality of audio signal output devices installed apart from each other so that
the reach of each audio signal is different; And at least one management server for designating
data to be transmitted by the acoustic signal output device by the acoustic signal.
Each of the sound signal output devices selects and selects one or more frequencies
corresponding to the data specified by the management server from a predetermined number of
frequencies included in a frequency range using the upper limit range of audio frequencies.
Means for outputting a sine wave of the selected frequency as an acoustic signal.
Then, the portable device program causes the portable device to receive an acoustic signal using
the upper limit range of the audible frequency, and detects the frequency of the acoustic signal
received from a part of the plurality of acoustic signal output devices. And the information is
determined based on the data represented by the detected one or more frequencies.
03-05-2019
15
[0055]
An example data transmission method according to the principles of the present invention is a
method of transmitting data to at least one portable device having a function of receiving an
acoustic signal utilizing an upper limit range of audio frequencies, the upper limit range of audio
frequencies being A plurality of acoustic signal output devices having a function of outputting an
acoustic signal to be used are disposed apart from each other so that the reach of each acoustic
signal is different, and the acoustic signal output to each acoustic signal output device At least
one management server is connected for the device to specify the data to be transmitted by
means of acoustic signals, wherein each acoustic signal output device is a predetermined number
included in a frequency range using the upper limit of the audio frequency Select one or more
frequencies corresponding to the data specified by the management server from the frequencies
in the above, and output a sine wave of the frequency as an acoustic signal So, the plurality of the
part of the audio signal output device to a portable device that has received the acoustic signals,
thereby detecting the data represented by the one or more frequencies the acoustic signal
includes.
[0056]
An information acquiring method according to an example according to the principle of the
present invention is a method of causing at least one portable device having a function of
receiving an acoustic signal utilizing an upper limit range of an audio frequency to acquire
information, A plurality of acoustic signal output devices having a function of outputting an
acoustic signal to be used are disposed apart from each other so that the ranges to which the
respective acoustic signals can reach are different, the portable device can be connected, and the
respective acoustic signals At least one management server holding information identified by
data transmitted by the output device by the acoustic signal is in operation, and each of the
acoustic signal output devices is included in a frequency range that uses the upper limit range of
the audio frequency From the predetermined number of frequencies, one or more frequencies
corresponding to the data to be transmitted are selected, and a sine wave of the frequency is
output as an acoustic signal, The portable device which has received the acoustic signal from a
part of the acoustic signal output device of the present invention detects data represented by one
or more frequencies included in the acoustic signal, and the information identified using the data
Are requested to the management server to transmit, and the information transmitted in
response to the request is received.
[0057]
As described above, according to the present invention, indoor and underground spaces can be
used as an operation environment, and it is possible to cope with movement by walking of a user
03-05-2019
16
of a portable device, and it is possible to carry the mobile device without harming the landscape
of the operation environment. It becomes possible to acquire position information etc. using the
function generally incorporated in an apparatus.
[0058]
BRIEF DESCRIPTION OF THE DRAWINGS The figure which shows the whole structure of the
acoustic marker system which concerns on an example of embodiment of this invention.
The figure which shows an example which allocated the frequency (kHz) to the bit string of
acoustic signal according to the range group.
The figure which shows an example which made acoustic signal identification ID the list for every
range group.
FIG. 2 is a block diagram showing an internal configuration of a management server in the
present example.
The figure which shows an example of a sound marker management table (management server).
The figure which shows an example of a sound signal management table (management server).
The figure which shows an example of an incidental information management table
(management server).
The flowchart which shows an example of the allocation process of the acoustic signal by a
management server.
FIG. 7 is a flow diagram showing an example of acoustic signal re-allocation processing by the
management server.
03-05-2019
17
FIG. 7 is a flow diagram showing an example of adjustment processing of a transmission range by
the management server.
FIG. 7 is a flow diagram showing an example of processing for providing location information
and the like by the management server.
The block diagram which shows the internal structure of the acoustic marker in this example.
The flowchart which shows an example of the output processing of the acoustic signal by an
acoustic marker.
The flowchart which shows an example of adjustment processing of the output level by an
acoustic marker.
FIG. 2 is a block diagram showing an internal configuration of a device in the present example.
The flowchart which shows an example of the process from the acoustic signal input by a device
to the positional information etc. acquisition.
The figure which shows an example of the error detection and correction | amendment by error
correction code. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using four range groups in the area (room etc.) where a cell spreads in two
dimensions. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using three range groups in the area (room etc.) where a cell spreads in two
dimensions. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using two range groups in the area (room etc.) where a cell spreads in two
dimensions. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using one range group in the area (room etc.) which a cell spreads in two
dimensions. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using four range groups in the area (passage etc.) in which a cell extends in
one dimension. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using three range groups in the area (passage etc.) in which a cell extends
in one dimension. The figure which shows the example of arrangement | positioning of an
03-05-2019
18
acoustic marker at the time of using two range groups in the area (passage etc.) in which a cell
extends in one dimension. The figure which shows the example of arrangement | positioning of
an acoustic marker at the time of using one range group in the area (passage etc.) in which a cell
extends in one dimension. The figure which shows the example of arrangement | positioning of
an acoustic marker at the time of using four sound area groups in the place divided | segmented
into several area. The figure which shows the example of arrangement | positioning of an
acoustic marker at the time of using three range groups in the place divided | segmented into
several area. The figure which shows the example of arrangement | positioning of an acoustic
marker at the time of using two range groups in the place divided | segmented into several area.
The figure which shows the example of arrangement | positioning of an acoustic marker at the
time of using one range group in the place divided | segmented into several area. A figure for
explaining an example of a system which performs entering and leaving determination in
pedestrian navigation service. The figure which shows one example which arrange | positioned
the sound marker in the shop in pedestrian navigation service. The figure which shows another
example which arrange | positioned the acoustic marker in the shop in pedestrian navigation
service. A flow figure showing an example of processing for a device to acquire present position
in pedestrian navigation service. The flowchart which shows an example of the process for a
device to perform the display to the present area map in a pedestrian navigation service. A flow
figure showing an example of processing for a device to display item (goods, contents)
information in pedestrian navigation service. The flowchart which shows an example of the
processing for a device to perform entrance and exit management in pedestrian navigation
service. The flowchart which shows an example of the processing for a device to search goods
information in pedestrian navigation service.
The flowchart which shows an example of the process for a device to perform walk guidance to
goods in a pedestrian navigation service. The block diagram which shows the internal structural
example of the management server in pedestrian navigation service. The figure which shows an
example of the acoustic marker management table (management server) in pedestrian navigation
service. The flowchart which shows an example of the shop information request | requirement
process by the management server in pedestrian navigation service. The block diagram showing
the internal configuration example of the store information management server for pedestrian
navigation service. The figure which shows an example of an item position management table
(store information management server). The figure which shows an example of an item
management table (store information management server). The figure which shows an example
of an item information management table (store information management server). The figure
which shows an example of an item classification management table (store information
management server). The figure which shows an example of the in-store map management table
(store information management server). The figure which shows an example of a flow line
management table (store information management server). FIG. 10 is a flowchart showing an
example of shelf position registration processing by the store information management server. A
03-05-2019
19
flow figure showing an example of map registration processing by store information
management server. FIG. 7 is a flowchart showing an example of item information registration
processing by the store information management server. FIG. 7 is a flowchart showing an
example of entrance registration processing by the store information management server. The
flowchart which shows an example of the shop information request | requirement process by a
shop information management server. FIG. 7 is a flow chart showing an example of entrance
status acquisition processing by the store information management server. FIG. 7 is a flow
diagram showing an example of item information acquisition processing by the store information
management server.
[0059]
Hereinafter, an information providing system according to an embodiment of the present
invention will be described with reference to the drawings for the purpose of illustration.
[0060]
The information providing system according to this example is an outline of the following
technology.
From the "acoustic marker" composed of a computer connected to a network and an audio output
device, an audio signal of high range which is hard to be heard by the human ear (hereinafter
referred to as an acoustic signal) is output. The acoustic signal is input to a microphone
incorporated in the device, and the management server is inquired via the network based on the
acoustic signal identification number (ID) extracted as a result of analyzing the acoustic signal,
etc. Information (all of which are information desired to be provided to a device that has received
an acoustic signal from each acoustic marker, and hereinafter referred to as position information
etc.).
[0061]
The acoustic signal uses an upper limit range (also referred to as ultrasonic sound) of audio
frequencies in the range of 15 kHz to 22 kHz. The sound in this range is a range that can not be
heard by ordinary people, and can emit a signal without being aware of the surroundings. Of
course, because it does not appear in photos and videos, it does not damage the landscape of the
operating environment. Further, by using this frequency band, it is possible to divert not a
03-05-2019
20
dedicated device for ultrasonic waves but an audio output device such as a speaker that is
usually marketed.
[0062]
For example, as shown in FIG. 1, a system to which the present technology is applied (hereinafter,
also referred to as an acoustic marker system) includes a management server 10, N acoustic
markers 20-1 to 20-N, and M devices ( For example, portable information devices such as
smartphones) 30-1 to 30-M. Among these, since the device is used by each user who uses
information, for example, the system 60 including the management server and the acoustic
marker may be called an information providing system.
[0063]
The management server 10 manages each acoustic marker 20 connected by a network (for
example, an internet protocol (IP) network or the like) 40, and allocates an acoustic signal
identification ID. Also, it provides information requested by the device 30 connected by a
network (for example, an internet protocol (IP) network or the like) 50.
[0064]
Since the device 30 is used in a form in which the user moves while holding the device, the
network 50 is preferably a network such as a wireless LAN or a cellular phone network. The
network 40 may use a fixed communication network installed at the place where the acoustic
markers are installed. The network 40 and the network 50 may be mutually independent
networks, or the network 40 and the network 50 may form one network.
[0065]
The sound marker 20 reproduces the sound signal including the sound signal identification ID
specified from the management server 10 at the specified volume. A plurality of (N) acoustic
markers 30 can be installed and operated simultaneously, and the number thereof may be
determined according to the content of the information service that the operator of the
03-05-2019
21
information providing system wants to apply.
[0066]
The device 30 voice-inputs an acoustic signal, extracts an acoustic signal identification ID using
fast Fourier transform (FFT), sends it to the management server together with acquisition date
and time information and the like, and requests provision of position information and the like. A
plurality (M) of devices 30 can be simultaneously accommodated in the information providing
system 60, and the number can be increased by the number of users who want to use the service,
as long as the network 50 is not congested.
[0067]
The basic structure of the acoustic signal used in the present technology is, for example, as
follows. In order to manage the placement of acoustic markers, the concepts of location, area and
cell are provided, and each is given a unique ID and managed so as to be identifiable.
[0068]
The smallest unit is a cell, which is a unit for installing one acoustic marker. The same space
containing a plurality of cells is called an area. An area indicates an aisle, a living room, a
common space, etc. in the case of indoors. The concept encompassing multiple areas is a
location, which refers to the same building, etc.
[0069]
The location is assumed to be explicitly specified on the application side to be used, and it is
possible to enable multi-tenant use by changing the location ID.
[0070]
One acoustic signal is configured, for example, using a total of 12 sine waves, and one sine wave
is defined as one bit without performing modulation and demodulation.
03-05-2019
22
The spacing of each sine wave is 200 Hz, eliminating the interference in the analysis by the fast
Fourier transform. The reason for not performing modulation and demodulation is to acquire a
signal at high speed and analyze it.
[0071]
In this technology, in order to transmit signals of 12 bits at a time without performing
modulation / demodulation, for example, even if the user moves 80 m (1.33 m / sec) per minute
while walking, the acoustic signal emitted from the acoustic marker There is no restriction on the
behavior or behavior of the person holding the device as long as it can be received by the device.
[0072]
In this example, the 12-bit acoustic signal is composed of three parts: area ID, unique ID, and
error correction.
For each of the 12 bits, when the bit value is 1, a sine wave of the frequency corresponding to
that bit is output, and when the bit value is 0, the sine wave of the frequency corresponding to
that bit is not output.
[0073]
The area ID secures 4 bits (0 to 15 in decimal) in binary. As a result, for example, the device can
recognize that it has moved from one room to another.
[0074]
The unique ID is an identification number that is unique within the area ID, and secures 4 bits (1
to 15 in decimal) in binary. Although 8 bits obtained by adding a unique ID to this area ID is a
basic acoustic signal identification ID, since it is transmitted through free space, there may be a
loss of signal or the like.
03-05-2019
23
[0075]
In order to prevent such an accident, 4 bits are added for error correction and used for error
detection and correction. For this error detection and correction, an error detection and
correction code method is used, and 2-bit error detection and 1-bit error correction are adopted.
[0076]
Also, in consideration of the occurrence of interference caused by using a plurality of acoustic
signals adjacent to each other, the frequency band of ultrasonic sound is divided into, for
example, four sound range groups. The area ID unit uses a common frequency band, and the
unique ID unit and the error correction code unit use different frequency bands for each sound
range group. In adjacent cells, acoustic signals are assigned not to use the same range group.
However, the lower the frequency band is from the sound range group A to the sound range
group D, some people may feel the sound signal by hearing.
[0077]
FIG. 2 shows an example in which the frequency (kHz) of the sine wave is assigned to the bit
string of the acoustic signal for each sound range group. The range column indicates an example
in which the range is divided into four groups A to D. (1) is regarded as a leading bit, and (12) is
arranged and recognized as an acoustic signal.
[0078]
For example, the frequency of the first bit of the sound range group A is 22.0 kHz, and the 12th
bit is 19.8 kHz. The frequency from the first bit to the fourth bit of the sound range group B is
the same as that of the sound range group A, the 5th bit is 19.6 kHz, and the 12th bit is 18.2
kHz. As described above, the unique ID and the error correction code section are assigned such
that frequencies used do not overlap between different sound range groups.
[0079]
03-05-2019
24
If the device can acquire the component of the frequency as a result of the FFT, it recognizes that
bit as 1, and if the frequency component can not be acquired, it recognizes the bit as 0 and forms
a bit array.
[0080]
FIG. 3 shows an example in which the acoustic signal identification ID is listed for each sound
range group.
An area ID and a unique ID are designated for each sound range group. One sound range group
is divided into 16 areas, and 15 unique IDs exist for each area ID.
[0081]
When the frequency of ultrasonic sound is divided into four range groups A to D and all range
groups are used, the cells that can be divided within the same area ID are up to 60 cells with 4
range groups × 15 unique IDs . When using three range groups A to C, a maximum of 45 cells
can be identified by three range groups × 15 unique IDs. When using two range groups A to B,
up to 30 cells can be identified by 2 range groups × 15 unique ID, and when only A range
groups are used, up to 15 cells can be identified .
[0082]
When requesting information from the device to the management server, the acoustic signal
identification ID is specified to identify three elements of area ID, unique ID, and pitch group.
[0083]
FIG. 4 shows an example of the internal configuration of the management server 10.
The management server 10 manages the sound marker 20 and the sound signal, and has a
function of transmitting an adjustment instruction of the transmission range of the sound signal
and an answer to a request for position information and the like by the device 30.
03-05-2019
25
[0084]
The management server 10 includes an acoustic marker registration unit 100, an acoustic signal
identification ID selection unit 105, and an acoustic signal instruction unit 110 in order to
manage the acoustic marker and assign an acoustic signal identification ID. Further, in order to
reselect the acoustic signal identification ID, the acoustic marker changing unit 120 and the
acoustic signal identification ID reselecting unit 125 are provided.
[0085]
The management server 10 also has a transmission range adjustment request acquisition unit
140 and an output level change instruction unit 145 in order to adjust the transmission range
between the acoustic marker and the device. Furthermore, in order to transmit position
information etc. in response to a request from the device, it has position information etc request
acquisition section 160, position information etc request confirmation section 165, position
information etc extraction section 170, position information etc transmission section 175.
[0086]
In order to realize these functions, the management server 10 includes a database, and has an
acoustic marker management table 150 (FIG. 5), an acoustic signal management table 130 (FIG.
6), and an incidental information management table 180 (FIG. 7).
[0087]
The management server 10 and the sound markers 20 are connected by a network 40, and the
management server 10 and the devices 30 are connected by a network 50, so that mutual
communication is possible.
[0088]
FIG. 8 shows an example of the flow of processing for managing the acoustic markers 20-1 to 20
-N and giving the acoustic signal identification ID to each of the management servers 10.
[0089]
03-05-2019
26
First, in the acoustic marker registration unit 100 of the management server, with respect to the
acoustic marker management table 150, ID of the acoustic marker, name, area ID, X, Y, Z
coordinates in the area, latitude / longitude of the acoustic marker, etc. Perform registration
(800).
[0090]
Then, after the acoustic marker is registered, the acoustic signal identification ID selection unit
105 refers to the acoustic signal management table 130 to check whether there is an unused
acoustic signal identification ID to which the designated area ID belongs (805 ).
If there is an unused acoustic signal identification ID, it is confirmed whether there is an unused
unique ID (810).
[0091]
If there is an unused unique ID, the acoustic signal identification ID is extracted as a candidate,
and one ID is selected from the candidates (815).
At this time, the sound range group may be automatically selected so as not to be identical to the
sound range group of the adjacent sound marker, or may be arbitrarily selected by the registrant
(such as the administrator of this system). .
[0092]
Subsequently, the acoustic signal identification ID selection unit 105 determines expiration date
information (820), changes the in-use flag from 0 to 1 in the acoustic signal management table
130, and registers the acoustic marker ID and the expiration date. .
[0093]
If there is no unused acoustic signal identification ID or there is an unused acoustic signal
identification ID but there is no unique ID in the area, an error is returned (840).
03-05-2019
27
[0094]
Then, the acoustic signal instructing unit 110 instructs the acoustic marker 20 -K of the acoustic
signal identification ID and the output level through the network 40.
[0095]
FIG. 9 shows an example of a process flow for the management server 10 to re-assign an acoustic
signal identification ID to a designated acoustic marker.
For example, this re-allocation process is performed when it is desired to send another acoustic
signal identification ID from the same acoustic marker after expiration of a certain acoustic signal
identification ID.
[0096]
First, the acoustic marker change unit 120 of the management server receives an acoustic
marker change request from the program of the corresponding service operated by the
administrator of the system, the management server, etc. (900), the acoustic marker and the
acoustic signal identification ID Check if it is registered (905).
The acoustic marker change request includes the ID of the acoustic marker, the acoustic signal
identification ID, and the sound range group information of the adjacent acoustic marker.
[0097]
The acoustic signal identification ID reselection unit 125 belongs to the same area ID as the
currently selected acoustic signal identification ID, and the sound range group is empty (910)
and the unique ID is unused (915) acoustic signal identification ID Groups are extracted and one
ID is selected from them (920).
At this time, the sound range group may be automatically selected so as not to be identical to the
sound range group of the adjacent sound marker, or may be arbitrarily selected by the registrant
03-05-2019
28
(such as the administrator of this system). .
[0098]
Subsequently, the acoustic signal identification ID reselection unit 125 determines the expiration
date information again (925), and the in-use flag is set to 0 for the record of the acoustic signal
identification ID newly selected for the acoustic signal management table 130. Change to 1 and
register the sound marker ID and the expiration date.
Furthermore, the in-use flag of the record of the acoustic signal identification ID allocated so far
is changed from 1 to 0, the acoustic marker ID and the expiration date are deleted, and then the
record is updated (930).
If the acoustic marker or acoustic signal identification ID that is the target of the change request
does not exist, or if a new acoustic signal identification ID can not be allocated, an error is
returned (950).
[0099]
Then, the acoustic signal instruction unit 110 instructs the acoustic marker 20-J again the
acoustic signal identification ID and the output level through the network 40 (940).
[0100]
FIG. 10 shows an example of a process for the management server 10 to adjust the output level
(transmission range) of the acoustic signal of each acoustic marker.
The adjustment of the transmission range is performed from each device 30-1 to 30-N
monitoring the acoustic signal at a position where it is desired that the acoustic signal from each
acoustic marker 20-1 to 20-N be transmitted. It can be done based on the information. A plurality
of monitoring devices for one acoustic marker may be dispersed (for example, three 30-C, five
30-E, etc.), and from the acoustic markers of a plurality of cells adjacent to one device The
acoustic signal of may be monitored.
03-05-2019
29
[0101]
First, the transmission range adjustment request acquisition unit 140 of the management server
10 acquires a transmission range adjustment request from the device 30 through the network 50
(1000). The request includes the ID of the sound marker and information on increase and
decrease of the output.
[0102]
The output level change instruction unit 145 refers to the acoustic marker management table
150 to check whether the ID of the received acoustic marker is correct (1005), and when the
acoustic marker is present, outputs according to the received request (1010) The level is
increased (1015) or decreased (1020), the output level included in the record of the sound
marker in the sound marker management table 150 is updated, and the sound marker 20-K is
instructed via the network 40 (1025) .
[0103]
Further, the output level change instructing unit 145 acquires (1040) the change result in the
instructed acoustic marker 20-K through the network 40 from the acoustic marker 20-K, and
sends it to the requesting device 30-K through the network 50. The result may be notified
(1060).
If the ID of the received acoustic marker is not correct, an error is returned (1050).
[0104]
FIG. 11 shows an example of processing for the management server 10 to provide position
information and the like in response to a request from a device.
[0105]
The position information etc. request acquisition unit 160 of the management server 10 receives
an acquisition request for position information etc. from each device 30 through the network 50
03-05-2019
30
(1100).
The request includes the acoustic signal identification ID and the latitude / longitude information
of the device.
[0106]
The position information etc. request confirmation unit 165 refers to the sound signal
management table 130, and confirms the validity of the sound signal identification ID included in
the received request (1105). If the sound signal identification ID is present and the in-use flag is
1, it is determined whether the date and time of the received request is within the expiration date
of the record of the sound signal identification ID (1110). The date and time related to the
request may be the acoustic signal reception date and time that the device included in the
request, but it is more secure if the management server receives the request as the date and time.
[0107]
If the date / time of the request is within the expiration date, the record of the acoustic marker
shown in the acoustic signal management table 130 is extracted from the acoustic marker
management table 150. Then, it is checked whether the latitude / longitude information of the
device included in the received request matches the latitude / longitude information registered in
the extracted acoustic marker record (1115). Note that both or one of the matching of the
expiration date and the matching of the latitude and longitude may be omitted.
[0108]
The position information extraction unit 170 extracts area ID, X, Y, Z coordinates from the
extracted record of the acoustic marker (1120). When X, Y, Z coordinates are defined in the
coordinate system in the area, they are extracted together with the area ID, but when the position
can be uniquely identified from only X, Y, Z coordinates, only X, Y, Z coordinates May be
extracted.
03-05-2019
31
[0109]
When incidental information is associated with the extracted position information in the
incidental information management table 180 (1125), the position information etc. extracting
unit 170 also extracts incidental information (1130). Depending on the content of the incidental
information, various information services related to the position can be provided (various
application examples will be described later). The provided information itself may be attached
information, or the URL where the provided information is placed may be attached information.
[0110]
The position information transmission unit 175 transmits the extracted position information
(area ID, X, Y, Z coordinates) and / or incidental information to the request source device 30-I
through the network 50 (1150). If the validity of the received request can not be confirmed, an
error is returned (1040), and a notification indicating that the request processing can not be
performed is also returned to the request source device.
[0111]
FIG. 12 shows an example of the internal configuration of each acoustic marker 20. As shown in
FIG. The acoustic marker 20 cooperates with the management server 10 and has a function of
outputting an acoustic signal.
[0112]
The acoustic marker 20 includes an acoustic signal identification ID acquisition unit 200, an
acoustic signal file selection unit 210, an acoustic signal output management unit 220, and a
speaker unit 230 in order to output an acoustic signal. The speaker unit 230 can output a high
frequency range signal of approximately 15 kHz to 22 kHz. The acoustic marker 20 also includes
an output level adjustment instruction acquisition unit 240 and an acoustic signal identification
ID confirmation unit 250 in order to perform output level adjustment.
[0113]
03-05-2019
32
The sound marker 20 is connected to the management server 10 by the network 40, and can
communicate with each other. However, without using the network 40, the acoustic marker 20
itself may be instructed individually on the acoustic signal identification ID, the output level, and
the like.
[0114]
FIG. 13 shows an example of the flow of processing for the acoustic marker 20 to output an
acoustic signal.
[0115]
The acoustic signal identification ID acquisition unit 200 of the acoustic marker 20 acquires the
acoustic signal identification ID, the output level, and the output or stop instruction from the
management server 10 through the network 40 (1300).
[0116]
The acoustic signal file selection unit 210 selects a file corresponding to the received acoustic
signal identification ID from among the acoustic signal files stored in advance (1305).
However, an acoustic signal file may be newly created based on the received acoustic signal
identification ID information.
[0117]
When the received instruction does not include the stop instruction (1310), the acoustic signal
output management unit 220 reproduces the selected acoustic signal file based on the instructed
output level (1315) (1320), Output from the speaker unit 230.
If the received instruction includes a stop instruction, the reproduction of the sound signal file
currently being reproduced is stopped (1330). Then, the management server 10 is notified of the
result of processing the instruction (1340).
03-05-2019
33
[0118]
As described above, the management server 10 transmits the output level adjustment instruction
to the acoustic marker 20 through the network 40 based on the output level adjustment request
acquired from the device 30 via the network 50.
[0119]
Therefore, the device 30-K is placed at a position (for example, 1 m distance) where it is desired
to obtain an acoustic signal from the acoustic marker 20-K, and an attempt is made to detect the
acoustic signal.
At this time, if the signal can not be detected, the device 30 -K requests the management server
10 to adjust the output level increase. This output level increase request can be repeated until
the acoustic signal can be detected.
[0120]
Next, for example, the device is moved to a position at which the transmission of the acoustic
signal (from which the acoustic signal should not be transmitted) and the detection of the
acoustic signal is attempted. At this time, if a signal is detected, the device 30 -K requests the
management server 10 to reduce the output level. This output level reduction request can be
repeated until the acoustic signal can not be detected.
[0121]
The above-mentioned increase request and decrease request can be made by the device itself as
well as being manually operated by the user of the device.
[0122]
FIG. 14 shows an example of a process flow for the acoustic marker 20 to adjust the output level
of the acoustic signal.
03-05-2019
34
[0123]
The output level adjustment instruction acquisition unit 240 of the sound marker 20 acquires an
output level adjustment instruction from the management server 10 through the network 40
(1400).
[0124]
The acoustic signal identification ID confirmation unit 250 confirms whether the acoustic signal
identification ID included in the received instruction is the same as the identification ID in use
(1405).
If not, an error is returned (1450).
[0125]
When the acoustic signal identification ID is properly designated, the designated acoustic signal
file is selected by the acoustic signal file selection unit 210 unless the acoustic signal file of the
identification ID is already selected (1410). Choose (1415).
[0126]
Then, the acoustic signal output management unit 220 compares the current output level with
the instructed output level (1420), and increases (1425) or decreases (1430) the output level to
reproduce the acoustic signal file ( 1440), output from the speaker unit 230, and notify the
management server 10 of the result of processing the instruction (1460).
[0127]
FIG. 15 shows an example of the internal configuration of each device 30.
The device 30 cooperates with the management server 10 and has a function of acquiring
position information (for example, three-dimensional coordinates in an area) and the like based
on the acoustic signal acquired from the acoustic marker 20.
03-05-2019
35
[0128]
The device 30 is a portable terminal (for example, a smart phone) having a communication
function, and the acoustic signal input unit 300, the acoustic signal extraction unit 310, the
range group detection unit 320, and the acoustic signal identification ID in order to acquire
position information and the like. The acquisition unit 330, the position information etc. request
unit 340, and the position information etc. acquisition unit 350 are included.
Further, in order to perform output level adjustment, an output level adjustment request unit 370
may be provided.
[0129]
The device 30 is connected to the management server 10 by the network 50 and can
communicate with each other.
[0130]
FIG. 16 shows an example of the flow of processing for the device 30 to acquire position
information and the like.
[0131]
The acoustic signal input unit 300 of the device 30 receives an analog acoustic signal emitted by
the acoustic marker 20 via free space (1600).
[0132]
When an acoustic signal is input (1605), the acoustic signal extraction unit 310 performs digital
sampling (1610) of the received analog signal using a sampling rate of 44.1 kHz, for example,
and performs conversion into a digital signal.
Subsequently, fast Fourier transform is performed (1615) to extract frequency components.
The extracted frequency components are replaced with a bit array based on FIG.
03-05-2019
36
[0133]
Among the frequency components, the highest 22.0 kHz is used as the first bit of the area ID
part, the second bit is 21.8 kHz, the third bit is 21.6 kHz, and the fourth bit is 21.4 kHz.
[0134]
Next, the first bit of the unique ID part of the range group A is 21.2 kHz, the second bit is 21.0
kHz, the third bit is 20.8 kHz, and the fourth bit is 20.6 kHz.
Subsequently, the first bit of the error correction code part of the same sound range group A is
20.4 kHz, the second bit is 20.2 kHz, the third bit is 20.0 kHz, and the fourth bit is 19.8 kHz.
[0135]
In any bit, when the frequency component is present, the value of the bit is set to 1, and when no
frequency component is present, the value of the bit is set to 0.
[0136]
Similarly, the first bit of the unique ID portion of the range group B is 19.6 kHz, the second bit is
19.4 kHz, the third bit is 19.2 kHz, and the fourth bit is 19.0 kHz.
Subsequently, the first bit of the error correction code part of the same range group B is 18.8
kHz, the second bit is 18.6 kHz, the third bit is 18.4 kHz, and the fourth bit is 18.2 kHz.
[0137]
Similarly, the first bit of the unique ID portion of the range group C is 18.0 kHz, the second bit is
17.8 kHz, the third bit is 17.6 kHz, and the fourth bit is 17.4 kHz.
03-05-2019
37
Subsequently, the first bit of the error correction code section of the same tone range group C is
17.2 kHz, the second bit is 17.0 kHz, the third bit is 16.8 kHz, and the fourth bit is 16.6 kHz.
[0138]
Similarly, the first bit of the unique ID part of the range group D is 16.4 kHz, the second bit is
16.2 kHz, the third bit is 16.0 kHz, and the fourth bit is 15.8 kHz.
Subsequently, the first bit of the error correction code part of the same sound range group D is
15.6 kHz, the second bit is 15.4 kHz, the third bit is 15.2 kHz, and the fourth bit is 15.0 kHz.
[0139]
By this conversion, a bit array of the sound range groups A to D is generated, and an area ID
portion is added as a prefix of the array of A to D, thereby arranging bit types of four types of
acoustic signals (area ID portion + unique ID Section + error correction code section = 12 bits) is
completed.
[0140]
In this way, since the bit array of the acoustic signal and information as to which acoustic range
group the acoustic signal is obtained can be obtained from the frequency component obtained by
the fast Fourier transform, the range group detection unit 320 of the device 30 , Detect a sound
range group (1620).
[0141]
The acoustic signal identification ID acquisition unit 330 acquires an acoustic signal
identification ID from the detected range group and the 12-bit bit array (1625).
At this time, an error correction code is calculated from the area ID part which is a part of the 12bit bit array obtained and the unique ID part, and the error correction part which is the
remaining part of the 12-bit bit array obtained. The error detection and the error correction are
performed on the area ID part and the unique ID part by comparing with the bit array (the error
correction method will be described later) (1630).
03-05-2019
38
[0142]
If it is confirmed that the acoustic signal identification ID has been normally obtained after the
error correction (1635), the request unit 340 for the position information of the device 30 makes
a request for the position information etc. to the management server 10 through the network 50
(1640) ).
The request sent to the management server 10 includes the obtained acoustic signal
identification ID (range group + area ID + unique ID), and in the case where the device 30
includes the GPS latitude and longitude acquisition unit 360, the latitude and longitude of the
device. Information may be included.
[0143]
The location information etc. acquiring unit 350 of the device 30 acquires location information
etc. from the management server 10 through the network 50 as a response to the sent request
(1650).
The response that the device 30 receives from the management server 10 includes location
information and / or incidental information, or a notification that the request can not be
processed. As the location information, since the area ID is obtained in the device 30, at least
three-dimensional coordinate information (X, Y, Z) in the area is sent from the management
server 10.
[0144]
FIG. 17 shows an example of the error correction method. The bit values of the data part from
the head to the 8th bit of the obtained 12-bit bit array are D1, D2, D3, D4, D5, D6, D7, D8, and
the error correction part of the 9th to 12th bits Assuming that the bit values are H1, H2, H3 and
H4, and if the error detection / correction code to be calculated is H1 ′, H2 ′, H3 ′, H4 ′,
then H1 ′ = D1 XOR D2 XOR D3 H2 ′ = D4 XOR D5 XOR D6 H3 '= D1 XOR D4 XOR D7 H4' =
D2 XOR D5 XOR D8.
03-05-2019
39
[0145]
For example, if H1 and H3 of the four bits (error correction part) H1 and H3 after the obtained
12-bit bit arrangement and H1 ≠ H1 'and H3 ≠ H3', then D1 Is an error, and the error can be
corrected by inverting the bit of D1. Similarly, when an error is detected according to FIG. 17, the
bit is inverted.
[0146]
In the case of the pattern not shown in FIG. 17, since the error can not be corrected, it is
interpreted as an error as it is. That is, an error is returned (1660) on the assumption that a
normal acoustic signal identification ID has not been obtained.
[0147]
The bit array (area ID + unique ID) after error correction is converted from binary to decimal.
Sounds obtained by adding a decimal area ID part and a unique ID part to the detected range
group name (A to D) (for example, "A-0-1", "B-9-14", etc.) As signal identification ID, you may use
at the time of the request | requirement of the positional information etc. to the management
server 10. FIG.
[0148]
Note that the device 30 described above acquires location information and / or incidental
information by sending a request to the management server 10 based on the acoustic signal
identification ID included in the acoustic signal received from the acoustic marker 20. However,
for the area ID included in the acoustic signal received from the acoustic marker 20, it is possible
to identify the area where the device is now within the device 30, without querying the
management server 10.
[0149]
03-05-2019
40
That is, the device 30 inquires of the management server 10 in order to know the detailed
position in the area, but the rough position of which area it is in can be known only by receiving
the acoustic signal. .
Therefore, for example, an application in which different application programs are started in the
device 30 depending on the area based on the area ID detected by the device 30 is also possible.
[0150]
Further, in the example of the system described above, although the same management server 10
doubles as the server that manages the sound marker and the server that causes the device to
acquire the position information and the like, it may be realized by separate servers.
Furthermore, a server for causing the device to acquire location information and the like is
provided for each area, and the device 30 is included in the acoustic signal identification ID with
respect to the information providing server identified by the area ID in the acoustic signal
identification ID. The position information and the like may be requested by sending the range
group name and the unique ID part.
[0151]
Below, with reference to FIGS. 18-29, the example of arrangement | positioning of an acoustic
marker is demonstrated. The acoustic markers are arranged in cell units in the area.
[0152]
FIG. 18 shows that acoustic markers can be arranged without gaps if there are four types (A to D)
of usable sound range groups of acoustic signals when cells spread in two dimensions in a single
area (for example, a room etc.) Is shown. In order to prevent interference, adjacent cells are
arranged not to use the same range group. If there are four tone range groups that are assigned
not to overlap in frequency (for example, using a frequency of 200 Hz frequency from 15.0 kHz
to 21.2 kHz and securing 4 groups of 8 bits), 60 in one area The cells can be identified. In this
example, although the area is logically divided into 6 × 6 cells, there are also four types of
division into N × M (N and M are arbitrary natural numbers that fall within the identifiable
number), It can be arranged similarly without gaps. In this case, when moving while carrying the
03-05-2019
41
device, it is possible to continuously obtain information according to the position.
[0153]
19, 20 and 21 respectively show two types (for example, A to A) in the case where there are
three types (for example, A to C) of sound range groups of acoustic signals that can be used in an
area where cells similar to FIG. In the case of B), in the case of one type (for example, only A), an
example of the arrangement of acoustic markers possible under the restriction that adjacent cells
do not use the same tone range group is shown. As the number of usable sound range groups
decreases, the number of cells where acoustic markers can not be placed (devices there can not
receive acoustic signals) increases, and even while moving a device while carrying, only
intermittently, depending on the position. Information can not be obtained.
[0154]
In FIGS. 22, 23 and 24, four types (A to D) and three types (for example A If there are two types
(e.g., A to B) of (C), acoustic markers can be arranged without gaps, and it is shown that
information can be continuously acquired while the device is moving. In order to prevent
interference, adjacent cells are arranged not to use the same range group. In this example,
although the area is logically divided into 1 × 6 cells, the same applies to the case where it is
divided into 1 × N (N is an arbitrary natural number falling within the identifiable number).
[0155]
FIG. 25 shows that, in the area where cells similar to FIGS. 22 to 24 extend in one dimension, the
same range group is not used in adjacent cells when the range group of acoustic signals that can
be used is one type (for example, only A). It shows an example of the possible placement of
acoustic markers under the limitations of: Since the cells that can receive the acoustic signal are
scattered, information acquisition while the device is moving is also intermittent.
[0156]
FIGS. 26, 27, 28, and 29 show the cases where there are four types (A to D) and three types (for
example, A to C) of sound range groups of acoustic signals that can be used at a location
consisting of a plurality of areas. In the case of two types (for example, A to B), in the case of one
03-05-2019
42
type (for example, only A), an example of arrangement of acoustic markers possible under the
restriction that adjacent cells do not use the same range group is shown.
[0157]
In the example of FIGS. 26-29, the location to which three areas of 2x6, 1x2, 2x6 were connected
is taken up.
In the connection part, since there are different areas but adjacent cells, they are arranged so as
to use different range groups even between them.
[0158]
Using the acoustic marker system described in detail above, it is possible to obtain, for example,
the position information of a smartphone user while walking indoors or underground space as
well as outdoors, in real time and with high accuracy (minimum 1 m or so) .
[0159]
A common smart phone is equipped with a microphone and a communication device, and does
not require connection of an additional device, so it can be used simply by installing an
application program without the need for a special external device.
On the other hand, an acoustic marker to be installed can be diverted from a normal acoustic
device, so it is easy to obtain, and the landscape is not damaged as in the case where a twodimensional code is attached.
[0160]
Furthermore, while position estimation based on WiFi reception signal strength takes 5 to 10
seconds, this method can acquire the position in almost real time, so the position information can
be provided with high accuracy even if the device moves. it can. In addition, since an operation
such as calibration on the strength of the WiFi reception signal in advance is not necessary, the
03-05-2019
43
installation time can be shortened.
[0161]
Also, in this system, on the premise that sound signals (sound waves) are simultaneously emitted
and transmitted from a plurality of sound sources, allocation is performed so that sound signals
of different sound range groups flow from the sound sources to be adjacent places. Although the
sound wave is used as the transmission medium, there is no problem of the information
restoration failure due to the interference of the frequency component. As a result, it is possible
to use the sound source densely to provide position information (coordinates) and the like.
[0162]
Although the application which applies the positional information acquisition technique by the
acoustic marker system which demonstrated an example above may be various, a representative
example is demonstrated below.
[0163]
By constructing a position estimation base using acoustic markers in indoor and underground
spaces, navigation while walking in places where GPS can not reach can be achieved, which was
difficult to realize so far.
[0164]
As an example of indoor, by installing an acoustic marker in the store, it is possible to check the
current position in real time while holding the terminal without holding it up, and guides you to
the products you are looking for when you enter the store and recommended products In-store
guidance service etc. can be realized.
In addition, when used at a store, it can be used for entry / exit management and flow line
grasping.
[0165]
03-05-2019
44
Furthermore, this service is characterized in that even if there are situations where multiple
acoustic markers can be heard simultaneously, each can be recognized.
For example, it is considered basic to use an acoustic marker as a location information by linking
it to the location of a shelf on which goods are placed, but by separately attaching an acoustic
marker to an entrance, an accounting place, a toilet, etc. Even if the acoustic signal from the
marker is acquired, it can be distinguished and recognized. Furthermore, even when the signal
output from the acoustic marker can be obtained simultaneously when placed on the shelf, both
can be recognized and distinguished.
[0166]
The system for the above service comprises an acoustic marker, a device, a management server,
and a store information management server. The following six points are listed as functions.
[0167]
i) Present position provision: When an application is activated by a device such as a smartphone
(hereinafter referred to as a device), acoustic signal acquisition becomes possible, and the
coordinate of the current device is inquired of the management server every time the acoustic
signal is recognized. Can understand. It is not necessary to stop to grasp the acoustic signal and
hold the terminal over the sound source, and can be passively recognized while walking. The
current position is always displayed as a point on the area map on the application acquired from
the store information management server through the management server. Since the device
alone can recognize the change of the area, when the change of the area ID is detected, the
server can request and acquire the map of the new area, and the current location is always drawn
on the map of the current area. When a plurality of acoustic signal identification IDs can be
recognized simultaneously, coordinates corresponding to the respective acoustic signal
identification IDs are acquired, and an intermediate point of all the coordinates is set as the
current position.
[0168]
03-05-2019
45
ii) Product information search (product position acquisition, route search): When the application
is activated on the device and the current position is recognized, product search becomes
possible. When the product information (item code) is input, the position of the product is
requested to the store management server through the management server, and the coordinates
of the product are acquired. When the coordinates of the current location and the searched
product are acquired, the store information management server calculates a route from the
current position to the product shelf, draws it on the entire area map in the store, and displays it
on the application. Here, the map on which the route is displayed is always displayed in the
entire area until the end of the navigation separately from the area map displaying the current
position.
[0169]
iii) Provision of goods and content information: When the application of the device acquires the
current position, it inquires of the store information management server via the management
server about item (goods and content) information linked to the coordinates and acquires the
information. All products and contents linked to the recognized acoustic signal identification ID
can be displayed in real time. In addition, what is displayed can be controlled by the store, such
as for each campaign.
[0170]
iv) Walking guidance to goods: Since the current position of the device can always be obtained by
ii), the user walks based on the route displayed in ii) while grasping the current position. When
the sound signal of the sound marker placed on the shelf on which the product is placed is
recognized, a guidance end message is displayed.
[0171]
v) Entry and exit management: By installing an acoustic marker at the entrance, if the application
of the device has already been activated, the acoustic signal identification ID of the entrance
acoustic marker is recognized, and the management server is inquired and entered. Recognize
stores and exits. At the entrance, output speakers of the acoustic marker are installed from the
center of the entrance toward the outside and inside of the store. The acoustic signal
identification ID used by each acoustic marker is linked to the entrance at the store information
03-05-2019
46
management server.
[0172]
An example of a system for performing entry / exit determination is shown in FIG. When the
application of the device is activated at the time of entering the store, first the acoustic marker
signal of A is recognized and then the acoustic marker of B is recognized. If the application is
activated after entering the store, there is no record of entering the store, but acquisition of the
current location is started from the activated point. At the time of leaving the store, after the
acoustic marker signal of B is acquired, the acoustic marker signal of A is acquired to recognize
the exit. Details will be described later. In addition, when it is not recognized that the store has
been left, processing may be performed so that the store is regarded as the store when the sound
signal is not detected even after a predetermined time has elapsed.
[0173]
Since information on these entering and leaving stores is managed by the store information
management server for each customer (hereinafter referred to as a user), the frequency of visits
to the store, the time spent in the store, the area in which the user stayed for a long time etc. It
can be recorded as a log for analysis by an intelligence (BI) system or the like.
[0174]
As an application example, it is also possible to present a product that the user searched last time
when entering the store, a product that has been checked before coming to the store, and the
like.
[0175]
vi) Flow line management: User information is managed by the store information management
server, and a log is accumulated in the store information management server each time the user
acquires the current position.
By looking at the log for each user, it is possible to grasp the flow line when the user visits the
store.
03-05-2019
47
By searching logs by time, it is possible to obtain detailed information such as which department
has many people in which time zone. The product / content display terminal can display the
information of the content at the position linked to the sound signal identification ID acquired at
the time of walking or the information of the product when arriving at the shelf of the searched
product.
[0176]
When constructing a system for the above service, GPS can not be used to acquire current
position information because indoors and underground spaces can not acquire radio waves from
GPS satellites. In WiFi, high-accuracy identification within the same floor is difficult in the
position estimation method using BSSID (identification name of wireless LAN base station), and in
the position estimation method using RSSI (received signal strength of wireless LAN), it has
stopped for a fixed time Without it, it is impossible to give guidance while walking because the
position can not be estimated. Even in the case of a two-dimensional code, it can not be used
unless it is stopped to recognize, and the device is stopped and a camera reads a two-dimensional
code (marker). As such, it is considered that the in-store guidance service at a detailed level such
as product guidance can not be realized by other existing technologies, and can only be realized
by using this technology.
[0177]
The acoustic markers in the system for the service are as described above as acoustic markers in
the acoustic marker system. 31 and 32 show two installation examples of the acoustic marker in
the above service. The installation of the acoustic marker assumes almost the entire area in the
store, and the present position can be confirmed in any place in the store.
[0178]
According to the above-mentioned example, the acoustic marker can be used up to 15 areas (one
department in the store) in one store, and when the sound range group is divided into four, the
maximum is 60 per one area. You can set points. In other words, when installing in a store that
has three floors and two counters on each floor, it is thought that there are a total of six areas,
and the shelf location information, specific locations, recommended items, etc. in each area are
03-05-2019
48
60 points in total You can use sound markers up to.
[0179]
In one area, the acoustic markers of the same range group are arranged not to be adjacent to the
acoustic markers of each of the range groups A, B, C, and D. The following is an example of
installation of acoustic markers in one area. When sound is emitted from the wall or shelf toward
the aisle by the speaker of the sound marker, the sound shall be emitted only in the aisle ahead.
If the acoustic signal is of a different range group, up to the number of range groups (four) can
be identified simultaneously. For example, in FIG. 31, three acoustic signals will be heard at the
position of 1 in the circled numbers. In that case, the signals of A-0-8, B-0-8, and D-0-8 are
simultaneously recognized, and respective coordinates can be acquired.
[0180]
As an example of use of acoustic markers, basically any acoustic marker is linked to position
information, but it is also possible to provide information of content, not for coordinate
recognition. That is, even if an acoustic signal for providing content information is acquired while
walking, it is possible to display only the content of the content without reflecting it on the
current location. We think that it is suitable to provide information to a range larger than cells
from various angles, and to provide information such as posters. Referring to FIG. 32, when it is
desired to provide campaign information around the crossroads, a speaker is placed on the
center shelf and an acoustic signal (D-1-1) is emitted at 360 degrees. D-1-1 does not provide
location information, only campaign information. When the position is 2 in the circled numbers
in FIG. 32, the position information of D-1-1 is not used, and the middle point of the coordinates
of A-1-3 and C-1-2 becomes the current position.
[0181]
As an application example, if the adjacent acoustic markers are also recorded in the management
server in addition to the position information of the respective acoustic markers, the acoustic
signal identification ID to be recognized next can be predicted, so the other acoustic signal
identification IDs are If acquired, it can be determined as an error, and the accuracy of the
correction method can be increased.
[0182]
03-05-2019
49
The device in the system for the service has an application for in-store guidance service installed
in addition to the basic function described above as the device in the acoustic marker system.
The application has a graphical user interface (GUI) that allows product information retrieval,
walking guidance to a product, current position grasping, browsing of product / content
information, and the like.
[0183]
As the configuration of the device, in addition to the above-mentioned basic unit, it has a position
information analysis unit that analyzes the acquired position information for position information
acquisition, and further, a product input unit for product search, a product information request
unit, a product position information acquisition unit, Route information request unit for route
search to the specified product, route information acquisition unit, route display unit, current
area map selection unit for in-store map acquisition, current area map request unit, current area
map acquisition unit, current area map display unit, item Content) an item information request
unit related to display and selection, an item information acquisition unit, an item information
analysis unit, and an item information display unit.
[0184]
An operation example of the device is shown in FIGS.
[0185]
FIG. 33 shows a process of acquiring the current position.
The portion for acquiring the acoustic signal identification ID and acquiring the position
information is the same as the basic structure.
Thereafter, the acquired position information is analyzed to determine whether one position
information is recognized or a plurality of position information is recognized. When one position
information is acquired, if the position flag is 0, it is recognized as the coordinates of the current
position as it is. If the flag is 1, it recognizes that it is not position information, and does not use
03-05-2019
50
the coordinates of the current position. When a plurality of pieces of position information are
acquired, the coordinates of all the position flags of 0 are summed, and the value of the middle
point divided by the number of pieces of position information is recognized as the current
position. When the current position is recognized, the product search flag is changed to true if
false, and the product can be searched on the application.
[0186]
FIG. 34 shows a process of displaying the acquired current position on the current area map.
After acquiring the coordinates of the current position, if the previous area ID is nil or different
from the current area ID, it is considered that the current area is reached for the first time, and
the area ID is sent to request the current area map from the management server. If acquisition of
the current area map is successful, the current position is displayed on the current area map.
[0187]
FIG. 35 shows a process of displaying item (product, content) information. After acquiring the
current position, item information linked to the position information is acquired. Send current
position coordinates to the management server and request all item information linked to the
coordinates. If the acquired item information number is not 0, an item list is created. At that time,
only items having an item type of 3 (product) or 4 (content) are targeted for the list.
[0188]
FIG. 36 shows a process of entering and leaving store management. When the current position is
acquired, item information linked to it is acquired. At that time, if the item type is 1 (outside the
entrance) and 2 (inside the entrance), it is considered that the entrance is near the entrance, and
the entry and exit are discriminated. When the first item type is 1, when the item type linked to
the next acquired position information is 2, it is determined that the store has been entered. If
the first item type is 2, and if the item type associated with the next acquired position
information is 1, it is determined that the store has been left. When entry and exit are recognized,
the store information management server is requested to register a log through the management
server (see “flow of entry processing for store management server acquisition process”
described later).
03-05-2019
51
[0189]
FIG. 37 shows a process of performing product information search (product position acquisition,
route search). Once the current position is known, product search becomes possible. When the
product information is input, the store information management server searches for products
and acquires location information through the management server. When the coordinates of the
product are acquired, the coordinates of the product are sent to the store information
management server through the management server to request route search to the product and
drawing on the in-store map. When the in-store map in which the route to the searched product
is drawn is displayed on the application.
[0190]
FIG. 38 shows a process of providing walking guidance to a product. When a product is searched,
the product route and the current location are displayed on the in-store map and the current area
map, respectively, and it is possible to provide a walking guide to the product based on that.
While walking, always get an acoustic signal and display the current location. When the current
location matches the coordinates of the retrieved item, the end of the guidance is notified on the
device application.
[0191]
The management server in the system for the service has a function of acquiring a request and a
response to the store information management server, in addition to the contents described
above as the management server in the sound marker system. Specifically, in order to inquire of
the store information management server when acquiring store-specific information, it has a
store information management server request unit, a store information management server
response acquisition unit, and a data creation unit for the store information management server
response.
[0192]
An example of the configuration of the management server in the system for the above service is
03-05-2019
52
shown in FIG. In FIG. 39, the configuration of a portion that acquires an acoustic signal from a
device and provides position information and the like is the same as that of FIG. When a request
is received from the device for service-specific functions such as entry / exit management,
product information search (product position acquisition, route search), product / content
information display, walk guidance to products, flow line identification, etc. In order to request
the store information management server to acquire data, the management server includes a
store information request creation unit 190, a store information request unit 192, a store
information data acquisition unit 194, a store information data check unit 196, and a store
information transfer unit It has 198.
[0193]
Although the management server basically has the above-mentioned table structure (FIGS. 5 to 7)
as it is for the above service, as shown in FIG. 40, the sound marker management table uses the
position of the sound marker. A flag is added to indicate whether the item (0) or the product or
other content information is included.
[0194]
The processing flow of providing position information and the like performed by the
management server for the above service is the same as that shown in FIG.
However, since the position flag is added to the sound marker management table, when
providing position information and the like to the device (1150), the position flag is also
transmitted in addition to the coordinates and additional information.
[0195]
For the above service, the management server plays a role of relay for making a request to the
store management server when receiving a request to obtain store-specific information from the
device. The store information request processing flow by this management server is shown in
FIG.
[0196]
FIG. 42 shows a configuration example of a store information management server installed for
03-05-2019
53
the above service.
[0197]
The store information management server 50 holds and manages store-specific information.
An item information registration unit 510 and an item information search unit 520 are provided
to manage products. In order to manage the position of a shelf or the like, a shelf position
information registration unit 530, an entrance / exit information registration unit 540, and a
shelf position information search unit 550 are provided. A store map information registration
unit 560, a store map information search unit 570, and a route search unit are provided to
manage store map information. In addition, in order to manage information on recommended
products, a recommended product registration unit and a recommended information search unit
may be provided.
[0198]
The store information management server 50 further includes a store information request
acquisition unit 500 for communicating with the management server 10, and a store information
response notification unit 580. Also, it has a user position management unit 590 that manages
the flow line of each user.
[0199]
The store information management server 50 has a database for realizing these functions, and an
item position management table 515 (FIG. 43), an item management table 525 (FIG. 44), an item
information management table 535 (FIG. 45), an item type management table (FIG. 46), the instore map information management table 545 (FIG. 47), and the flow line (user position
information) management table 555 (FIG. 48).
[0200]
FIG. 49 shows an example of the shelf position registration process flow performed by the store
information management server.
03-05-2019
54
When the shelf position information registration unit 530 acquires the shelf position information
registration request based on the coordinates and the shelf number, the shelf position
information registration unit 530 determines whether the coordinates are correct, and registers
the coordinates and the shelf number in the item position management table 515 if the
coordinates are correct. Then, associate the in-store coordinates with the shelf number. As shown
in FIG. 43, as the item type of the table, 3 which means a product is registered (when a shelf
number is registered, the product is displayed there). The meaning of the item type is shown in
the item type management table of FIG. If the coordinates are incorrect, error processing is
performed to display the result that registration can not be performed. If a shelf number or entry
/ exit information is already registered in the same coordinates, the new item identification and
shelf number are registered after deleting the old item identification and shelf number. When the
registration process is completed, the shelf position information registration result is displayed.
[0201]
FIG. 50 shows an example of the map registration processing flow performed by the store
information management server. When the map information registration request is acquired
based on the area ID and the map data, the store map information registration unit 560
determines whether the area ID is correct or not, and registers the map data in the map
information management table 545 if correct. And associate the area ID in the store with the map
data. As shown in FIG. 47, the map data may be a URL for referring to image data of the map. If
the area ID is invalid, error processing is performed to display the result that registration can not
be performed. If map data is already registered in the same area ID, new map data is registered
after deleting old map data. When the registration process is completed, the map information
registration result is displayed.
[0202]
FIG. 51 shows an example of an item information registration process flow performed by the
store information management server. If the item information registration unit 510 acquires an
item information registration request based on the shelf number, item code, and item
information, it determines whether the shelf number is correct, and if it is correct, the item
management table 525 (FIG. 44) The item code is registered, the item information is registered in
the item information management table 535 (FIG. 45), and the shelf number is linked to the item
code (such as a product code). If the shelf number is invalid, error processing is performed to
03-05-2019
55
display the result that registration can not be performed. If the same item code is already
registered in the same shelf, the new item code is registered after deleting the old item code.
Multiple item codes can be registered to the same shelf number. If there is no item code in the
item information management table, item code and item information are newly registered. When
the registration process is completed, the item information registration result is displayed.
[0203]
FIG. 52 shows an example of the entrance registration process flow performed by the shop
information management server. When the entrance information registration unit 540 acquires
the entrance information registration request based on the coordinates and the entrance type,
the entrance information registration unit 540 determines whether the coordinates are correct. If
the entrance information is correct, the entrance information is registered in the item position
management table 515. Link the inside coordinates and the identification information (inner,
outer) of the doorway. As shown in FIG. 43, the item type of the table registers 0 meaning the
outside of the doorway or 1 meaning the inside. The meaning of the item type is shown in the
item type management table of FIG. If the coordinates are incorrect, error processing is
performed to display the result that registration can not be performed. If shelf number
information and entry / exit information are already registered at the same coordinates, the old
item type is deleted and then the new item type is registered. When the registration process is
completed, display is performed on the exit information registration result.
[0204]
FIG. 53 shows an example of a store information request processing flow performed by the store
information management server. Based on the coordinate information, the store information
management server provides the identification result of the entrance / exit, provides the product
data, and registers the position of the user based on the coordinate information.
[0205]
When acquiring the coordinates and the user information from the management server 10, the
store information request acquiring unit 500 determines whether the coordinates are correct,
and extracts the item type associated with the coordinates from the item position management
table 515 if the coordinates are correct. Do. If the coordinates are incorrect, an error process is
03-05-2019
56
performed to display a result indicating that the answer can not be made.
[0206]
When the item type is 1, the user position management unit 590 records that the user position
information management table 555 has passed the outside of the entrance (FIG. 48), and
requests the store information response notification unit 580 for notification. . When the item
type is 2, the user position management unit 590 records the fact that it has passed the inside of
the entrance in the user position information management table 555 (FIG. 48), and requests the
store information response notification unit 580 for notification. .
[0207]
When the item type is 3 or 4, the shelf position information extraction unit 550 extracts the shelf
number from the item position management table 515 and transmits the shelf number to the
item information extraction unit 520. However, when the item type is 4 (event, campaign), the
shelf number may not be specified. The item information extraction unit 520 extracts an item
code from the item management table 525 based on the shelf number, and extracts item
information from the item information management table 535. Subsequently, the user position
management unit 590 is requested to register the user position. The user position management
unit 590 records, on the user position information management table 555, the fact that the place
such as the shelf has been passed (FIG. 48), and requests the store information response
notification unit 580 for notification.
[0208]
The store information response notification unit 580 notifies the management server 10 of the
requested content.
[0209]
FIG. 54 shows an example of the entrance status acquisition processing flow performed by the
store information management server.
03-05-2019
57
The store information management server manages entry status of each user.
[0210]
When the user position management unit 590 acquires the entry status request of the user from
the management server 10, it determines whether the user information is managed, and the user
is correctly managed in the user position information management table 555 Extracts the entry
status at the time of request, and requests the store information response notification unit 580
for notification. However, the entry status indicates that the last entry recorded for each user
information has passed the outside of the entry / exit, indicating that the store has exited, and the
entry situation has been recorded when passing the inside of the entry / exit. Judge as entering
the store. If the user information is invalid, error processing is performed to display the result
that the reply can not be made. The store information response notification unit 580 notifies the
management server 10 of the requested content.
[0211]
FIG. 55 shows an example of an item information acquisition processing flow performed by the
store information management server. The store management server manages an item code
(such as a product code) and item information (such as product information).
[0212]
When the item information extraction unit 520 acquires an item code from the management
server 10 and acquires an item information request, it determines whether the item code is
correct or not and extracts item information from the item information management table 535 if
it is correct. At the same time, the rack number is extracted from the item management table 525
based on the item code, and the store information response notification unit 580 is requested to
notify. If the item code is invalid, error processing is performed to display the result indicating
that the answer can not be made. The store information response notification unit 580 notifies
the management server 10 of the requested content.
[0213]
In the above, the pedestrian navigation service has been described by taking the store as an
03-05-2019
58
example, but in addition, for example, in the home of the subway, the user is notified which
direction it is closest to the destination to move to. It is possible to use such as guidance and
guidance to the car parked in the underground parking lot.
[0214]
Further, the position information acquisition technology using the above-described acoustic
marker system can be applied to an application that uses augmented reality technology to
provide supplementary information on exhibits such as museums, art museums, and aquariums.
It is possible to achieve systematization in an indoor environment that has been difficult to
realize in the prior art.
[0215]
As in the store information management server described above, when information on pedestrian
navigation and flow lines of each user of augmented reality is collected, this information can be
used by a business operator as information for improving service. In addition, with regard to the
security of the facility and the arrangement of the clerk of the railway company, it is possible to
use the application in such a way that the manager grasps the current position.
[0216]
As in the store information management server described above, if entry management is
performed, whether or not the entry is surely entered as a condition for requesting a store visit
as a condition of point program for retail store or coupon issuance is based on position
information It can be grasped. In the prior art, it is possible for the user to check in without
actually entering the store because position estimation is often performed by GPS or WiFi, but in
the present technology, an audio signal in a high range is used. Because it is easy to limit the
area, it is possible to be limited so that you can not check in without entering the store. In
addition, since the position can be acquired in real time, entry can be confirmed at the moment of
passing through the entrance.
03-05-2019
59
[0217]
Providing information on posters and other postings according to this technology, there is no
restriction that only one person can acquire one two-dimensional code simultaneously as in
conventional two-dimensional code scanning, and a large number of people can simultaneously
obtain information at one time. You can get it.
[0218]
Since a pedestrian holding a device using the present technology can acquire an acoustic signal
while walking, for example, it is possible to specify a booth that has passed at an exhibition, etc.,
and obtain materials automatically. it can.
In addition, information such as an advertisement or a discount ticket distributed on the street or
the like can be similarly acquired.
[0219]
In television broadcasting and radio broadcasting, it is also possible to perform product
introduction and purchase support linked to an application distributed in advance by
transmitting an acoustic signal using the present technology. The sound signal can be changed
from moment to moment, so that it is possible to provide information such as costumes and
music of the performer.
[0220]
Although the embodiments of the present invention have been described above, it goes without
saying that those skilled in the art can variously modify and apply the above-described
embodiments within the scope of the present invention.
03-05-2019
60
Документ
Категория
Без категории
Просмотров
0
Размер файла
86 Кб
Теги
jp2013106278
1/--страниц
Пожаловаться на содержимое документа