The first experience of the Fingero module released by uSens: a new choice for VR gesture interaction

The lack of interactive solutions for mobile VR is a well-known situation. Gear VR, the best product currently available, can only be controlled by turning heads and touchpads. It is learned that Oculus's Carmac is working hard to develop an inside out (inside and out) tracking system for Gear VR, while many other companies also occupy this area.

On August 24th, Silicon Valley startup company uSens Lingyin Technology held the first press conference in China, officially launching its inside out optical tracking module Fingo, mainly for the ARVR field. In addition to the main gesture interaction with Leap Motion, this product also provides head position tracking.

Three versions of the Fingo module and one all-in-one reference design

There are three versions of the Fingo module released this time: Fingo, Color Fingo, and Power Fingo.

Fingo has two infrared cameras with a resolution of 640×480, a working distance of 5-70 cm, frames of 60 FPS, and a field of view of 140 degrees horizontally and 122 degrees vertically. The official said that it allows the device to have 26 degrees of freedom gesture tracking (referring to a total of 26 degrees of freedom for all fingers combined) and marker-based position tracking, and to minimize battery and running costs.

Color Fingo has two RGB cameras with a resolution of 1280×720, a working distance of 1-3 m, an angle of field of view of 115 degrees, a vertical of 90 degrees, and a frame rate of 60 FPS. It adds inside-out 6-DOF position tracking and ARVR scene switching based on Fingo .

Power Fingo has four cameras, two infrared and two RGB. Based on the first two functions, it also integrates a battery and Qualcomm Snapdragon processor.

Official display design of one machine

In addition to the above three products, the company also introduced a reference design for a mobile VR-based all-in-one, featuring the Qualcomm Snapdragon 820 processor, the 14401440 dual-screen, and the integration of the Fingo module with a gesture of 26 degrees of freedom, 6 Freedom head position tracking and AR overlay functionality.

Experience and Demo

Live gesture interaction Demo

At the conference, uSens demonstrated its three main functions: gesture interaction, head position tracking, and AR overlay. The demo of the scene looks fluent.

Xiao Bian also experienced two functions of gesture interaction and head position tracking at the scene, and found that the Demo did not show so well. First of all, gesture tracking is often lost, and the delay is obvious, that is, when the hand in the virtual world is manually followed by a delay.

Xiaobian Experience VR Helmet with Fingo

The reason why the experience is not as good as demo, the explanation of the on-site staff is: First, the environment in the experience area is relatively noisy, so the situation of tracking loss is caused; the delay is caused by overheating and frequency reduction of the mobile phone. After the meeting, Xiao Bian interviewed uSens co-founder and COO Shi Chi on these issues. He said that ambient light noise in the experience area is indeed the cause of the problem, and the company has developed noise filtering technology that can filter 90% of the Ambient light noise to ensure a good experience in a variety of environments. However, because the refresh rate of this technology is not good enough, it is not released for the time being.

Shi Chi also said that the tracking accuracy of the Fingo module is 0.1 millimeters and the power consumption is 1.1 W, which is only half that of Leap Motion and will be further reduced in the future.

It should be pointed out that the products that are experienced in the field are all mobile phone boxes and the mobile phones use Samsung s6 or s7. The all-in-one machine is only displayed. The helmet of the PC platform only appears in the Demo.

Shi Chi expressed his apology for the inadequacy of equipment preparation at the conference venue. He said that the number of experiences exceeded the original expectation. If more mobile phones are prepared and the continuous experience of fever reduction is reduced, the on-site experience will be better. In addition, he also expressed that the problem of environmental noise and fever is currently a common phenomenon in similar products.

Time to market and developer plan

The products introduced by uSens this time are all B2B2C. The company itself will not launch products for consumers, but will cooperate with manufacturers to apply their own technologies to helmets. Chi Chi said that the price of modules provided to customers can be as low as 30 US dollars, the future will be further reduced, the module has opened booking.

With regard to the cooperation of helmet manufacturers, the more important content manufacturers and the licensees of all-in-one machines, uSens has not announced them, but Shichi said that the relevant products can be seen in about October.

On the developer side , uSens officially announced the opening of the beta version of the SDK and the launch of the uDev developer program to provide a full suite of developer tools. At present, the software system supports Unity 3D, Java, and C++ development based on mobile and PC, and will support more development platforms in the future.

In addition to VR, the company is also involved in the field of AR, Shi Chi revealed that there are currently some domestic AR hardware manufacturers want to seek cooperation, but there is no specific news to be announced. He also stated that his home in the field of SLAM algorithm can be ranked in the top five in the world.

postscript

Founded in 2013, uSens develops Inside out tracking technology solutions for use in ARVR. In June this year, the company announced that it had received a $20 million Series A round of financing led by Fosun Kunzhong .

In the field of mobile VR interaction technology, uSens provides a relatively complete solution, but current mainstream mobile VR vendors, including Gear VR and Google Daydream, are developing their own interactive methods. The extent to which uSens's solution can be applied remains to be seen.

Gas Generator

Gas Generator,4 Cycle 16 Cylinders,4 Cycle 16 Cylinders Cummins Generators,4 Cycle 16 Cylinders Generators

XCMG E-Commerce Inc. , https://www.xcmg-generator.com