scispace - formally typeset
Search or ask a question
Author

Shi Yuanchun

Bio: Shi Yuanchun is an academic researcher. The author has contributed to research in topics: Direct voice input & Intelligent electronic device. The author has an hindex of 2, co-authored 6 publications receiving 7 citations.

Papers
More filters
Patent
25 Jul 2017
TL;DR: In this article, a hand shape tracking method comprises the steps of fixing depth sensors on two or more positions of an arm or a wrist, and the depth sensors are used for obtaining depth map information of the corresponding position.
Abstract: The invention provides a hand shape tracking method and device and a computer readable medium. The hand shape tracking method comprises the steps of fixing depth sensors on two or more positions of an arm or a wrist, and the depth sensors are used for obtaining depth map information of the corresponding position; according to the obtained depth map information, achieving the purpose of rebuilding three-dimensional space information of the hand in real time. Through the arrangement of the depth sensors on the arm or the wrist, the depth map information of the corresponding position is obtained, and portable, cheap and precise hand shape track can be achieved.

3 citations

Patent
08 Nov 2019
TL;DR: In this paper, an interaction method is used for performing voice input when the user carries intelligent electronic equipment. But the interaction burden and difficulty are reduced, and thus, interaction is relatively natural.
Abstract: The invention provides electronic equipment configured with multiple microphones. The electronic equipment is provided with a storage and a central processing unit; a computer executable instruction is stored in the storage; when the computer executable instruction is executed by the central processing unit, the following operations can be executed: sound signals acquired by the multiple microphones are analyzed; whether a user is speaking to the electronic equipment closely or not is judged; and, by responding to the fact that the user is speaking to the electronic equipment closely is determined, the sound signals acquired by the microphones are used as the voice input processing of the user. An interaction method is suitable for performing voice input when the user carries intelligent electronic equipment; operation is natural and simple; the voice input step is simplified; the interaction burden and difficulty are reduced; and thus, interaction is relatively natural.

2 citations

Patent
15 Nov 2019
TL;DR: In this article, a sliding-touch input of a user on the input plane can be adapted to display the sliding track and the candidate words on the display plane, thereby improving the input efficiency of the user and having a high error tolerance rate.
Abstract: The invention provides an input method, an input device, an input system and electronic equipment. The input method is applied to first equipment with a display unit and comprises: receiving a first sliding track input by a user from second equipment, wherein the first sliding track is generated by conducting first sliding touch operation on an input unit of the second equipment by the user; displaying the first sliding track and a soft keyboard for text input on a display unit while receiving the first sliding track; matching the first sliding track with at least one candidate word in a wordbank according to a matching algorithm; and displaying at least one candidate word on a display unit, wherein the first sliding track is displayed as the fixed position, such as the center, of the starting point of the first sliding track on the soft keyboard. In this way, the sliding touch input of the user on the input plane can be adapted to display the sliding track and the candidate words onthe display plane, thereby improving the input efficiency of the user and having a high error-tolerant rate.

1 citations

Patent
20 Sep 2019
TL;DR: In this paper, the authors proposed a voice input triggering method and an intelligent electronic device with a sensor system. And when the intelligent electronic devices is located beside the mouth of the user, voice input is automatically activated.
Abstract: The invention provides a voice input triggering method and an intelligent electronic device. The triggering method is applied to the intelligent electronic device with a sensor system. And when the intelligent electronic device is located beside the mouth of the user, voice input is automatically activated. The mobile device captures signals through the sensor system and judges whether the intelligent electronic device is close to the mouth of the user or not. And in response to determining that the terminal is located beside the mouth of the user, voice input is activated. And under the condition that the user performs voice input, the sensor system detects a signal that the mouth of the user leaves the intelligent electronic device so as to end the voice input application. Therefore, the device is suitable for the user to perform voice input on the intelligent electronic device, improves the reception quality, efficiency and privacy of voice input, and enables interaction to be more natural.

1 citations

Patent
10 Dec 2020
TL;DR: In this paper, a voice input wake-up method based on detection of approaching mouth, and a medium is proposed, which is applied to an intelligent electronic device with a sensor system, and when the user performs voice input, the sensor system detecting a signal which indicates that the mouth of the user moves away from the intelligent electronic devices to end a VOI application.
Abstract: A voice input wake-up apparatus and method based on detection of approaching mouth, and a medium. The method is applied to an intelligent electronic device with a sensor system. The method involves: when an intelligent electronic device is located in close proximity to the mouth of a user, automatically activating voice input. A mobile device capturing a signal by means of a sensor system, and determining whether the intelligent electronic device is close to the mouth of the user; in response to determining that the intelligent electronic device is located in close proximity to the mouth of the user, activating voice input; and when the user performs voice input, the sensor system detecting a signal which indicates that the mouth of the user moves away from the intelligent electronic device to end a voice input application. The invention is suitable for a user to perform voice input on an intelligent electronic device, improves the sound collection quality, efficiency and privacy of the voice input and makes the interaction more natural.

Cited by
More filters
Patent
09 Feb 2018
TL;DR: Wang et al. as mentioned in this paper proposed a 3D convolutional neural network sign language identification method integrated with multi-modal data, which can accurately extract the limb movement track information in two different data formats, can effectively reduce the computing complexity of a model, and effectively solves the problem that single classifier encounters error classification because of data loss.
Abstract: The invention discloses a 3D convolutional neural network sign language identification method integrated with multi-modal data. The 3D convolutional neural network sign language identification methodintegrated with multi-modal data includes the steps: constructing a deep neural network, respectively performing characteristic extraction on an infrared image and a contour image of a gesture from the spatial dimension and the time dimension of a video, and integrating two network output based on different data formats to perform final classification of sign language. The 3D convolutional neuralnetwork sign language identification method integrated with multi-modal data can accurately extract the limb movement track information in two different data formats, can effectively reduce the computing complexity of a model, uses a deep learning strategy to integrate the classification results of two networks, and effectively solves the problem that single classifier encounters error classification because of data loss, so as to enable the model to have relatively higher robustness for illumination and background noise of different scenes.

18 citations

Patent
10 Dec 2020
TL;DR: In this paper, an electronic device configured with a microphone, a voice interactive wake-up method executed by a computer-readable medium, and a central processor, is presented for performing voice input when the user carries a smart electronic device, and is natural and simple in operation.
Abstract: An electronic device configured with a microphone, a voice interactive wakeup method executed by an electronic device configured with a microphone, and a computer-readable medium. The electronic device comprises a memory and a central processor; the memory stores a computer-executable instruction. When the computer-executable instruction is executed by the central processor, the following operations are performed: analyzing a sound signal that is acquired by the microphone, and identifying whether the sound signal comprises the speaking voice of a person and comprises wind noise sound generated because an airflow generated by the speaking of the person hits the microphone (S101); and in response to determining that the sound signal comprises the speaking sound of the person and comprises the wind noise sound generated because the airflow generated by the speaking of the person hits the microphone, using the sound signal as the voice input of a user and performing processing (S102). The method is suitable for performing voice input when the user carries a smart electronic device, and is natural and simple in operation, and the steps of the voice input are simplified, thereby reducing the load and difficulty of interaction, and making interaction more natural.

3 citations

Patent
12 Jul 2019
TL;DR: In this article, a real-time reconstruction method and device for a hand and object interaction process is presented, and the method comprises the following steps: carrying out the data segmentation of to-be-processed depth image data, obtaining a hand-object segmentation result, and obtaining gesture posture prediction data, and dividing the prediction data and the hand and objects into constraint terms to optimize the unified energy function.
Abstract: The invention discloses a real-time reconstruction method and device for a hand and object interaction process, and the method comprises the following steps: carrying out the data segmentation of to-be-processed depth image data, obtaining a hand and object segmentation result, and obtaining gesture posture prediction data, and the hand and object segmentation result comprising object data and hand data; dividing the prediction data and the hand and object into constraint terms to optimize the unified energy function, so as to obtain a hand motion sequence and an object non-rigid motion sequence; and fusing the object data into the object model to obtain an object static model, and obtaining a real-time reconstruction result of the hand and object interaction process according to the handmotion sequence, the object non-rigid motion sequence and the object static model. The method can effectively solve the real-time reconstruction problem of hand and object interactive motion, and canobtain hand motion, object motion and object geometric models in real time.

1 citations

Patent
10 Dec 2020
TL;DR: In this paper, a smart electronic device having a built-in microphone performs voice input-based interaction with a user by means of the following operations: processing a sound signal captured by a microphone to determine whether a voice signal is present in the sound signal; in response to confirming that a voice signals are present in sound signal, further determining on the basis of the sound signals collected by the microphone whether the distance between the smart electronic devices and the mouth of the user is less than a predetermined threshold.
Abstract: A smart electronic device having a built-in microphone; the smart electronic portable device performs voice input-based interaction with a user by means of the following operations: processing a sound signal captured by a microphone to determine whether a voice signal is present in the sound signal; in response to confirming that a voice signal is present in the sound signal, further determining on the basis of the sound signal collected by the microphone whether the distance between the smart electronic device and the mouth of the user is less than a predetermined threshold; and in response to determining that the distance between the electronic device and the mouth of the user is less than the predetermined threshold, using the sound signal collected by the microphone as a voice input and processing same. The described interaction method is suitable for a user performing voice input while carrying a smart electronic device, operation being natural and simple; in addition, the step of voice input is simplified, and the burden and difficulty of interaction are reduced so that interaction is more natural.
Patent
29 May 2020
TL;DR: In this paper, a spatial positioning method based on HoloLens glasses is proposed. But the method comprises the steps: building a tool coordinate system through employing any one marking ball as an origin of coordinates; solving a rotation matrix from the HoloLens to the NDI Spectra equipment; reading a World-to-Local rotation matrix in HoloLens by using UDP communication; and observing a rotated matrix from a Marker to HoloLenstol by utilizing an improved hand-eye calibration algorithm.
Abstract: The invention relates to a spatial positioning method based on HoloLens glasses, and the method comprises the steps: building a tool coordinate system through employing any one marking ball as an origin of coordinates; solving a rotation matrix from the HoloLenstol to the NDI Spectra equipment; reading a World to Local rotation matrix in the HoloLens by using UDP communication; solving a rotationmatrix from HoloLens to HoloLenstol by utilizing an improved hand-eye calibration algorithm; observing a rotation matrix from a Marker to the NDI Spectra equipment and a rotation matrix from a tool coordinate system to the NDI Spectra equipment, which are arranged on an object at any position in the space; and solving the spatial position relationship between the Marker-containing object in reality and the Holens. According to the method, the model is placed in the precise position of the HoloLens in the space, and the combination of the coordinate system of the HoloLens and the coordinate system of the real environment world is realized so that the HoloLens obtains the spatial position relationship of the Marker at the spatial specified position in the HoloLens coordinate system.