JOYY. has been granted a patent for a method that detects line-of-sight by analyzing face images. The process involves determining facial posture and eye pupil displacement, then back-projecting this data into three-dimensional space to identify the actual line-of-sight direction. GlobalData’s report on JOYY gives a 360-degree view of the company including its patenting strategy. Buy the report here.

According to GlobalData’s company profile on JOYY, was a key innovation area identified from patents. JOYY's grant share as of June 2024 was 48%. Grant share is based on the ratio of number of grants to total number of patents.

Method for detecting line-of-sight using eye pupil displacement

Source: United States Patent and Trademark Office (USPTO). Credit: JOYY Inc

The patent US12039752B2 outlines a method for detecting line-of-sight using facial images. The process begins by determining a face posture and eye pupil rotational displacement from a key feature point in a face image. This displacement is defined as the movement of the pupil center relative to the eyeball center. The method involves back-projecting this displacement into a three-dimensional space to ascertain the line-of-sight direction of the actual face. This back-projection is facilitated by constructing a line-of-sight optimization function that incorporates the preset projection function, face posture, and eye pupil displacement, ultimately allowing for the identification of a line-of-sight direction that meets a specified optimization target.

Additionally, the patent describes a series of steps to enhance the accuracy of the line-of-sight detection. This includes acquiring face data through scanning, reconstructing a three-dimensional face grid model, and extracting key feature points. The method also details how to determine the eye pupil rotational displacement by recognizing the eye image within the face image. Furthermore, it outlines the potential for video processing, where the line-of-sight direction can be determined for each frame, allowing for video editing operations based on line-of-sight offsets. The patent also encompasses devices and non-transitory computer-readable storage mediums that facilitate the execution of these methods, indicating a comprehensive approach to line-of-sight detection and video processing.

To know more about GlobalData’s detailed insights on JOYY, buy the report here.

Data Insights

From

The gold standard of business intelligence.

Blending expert knowledge with cutting-edge technology, GlobalData’s unrivalled proprietary data will enable you to decode what’s happening in your market. You can make better informed decisions and gain a future-proof advantage over your competitors.

GlobalData

GlobalData, the leading provider of industry intelligence, provided the underlying data, research, and analysis used to produce this article.

GlobalData Patent Analytics tracks bibliographic data, legal events data, point in time patent ownerships, and backward and forward citations from global patenting offices. Textual analysis and official patent classifications are used to group patents into key thematic areas and link them to specific companies across the world’s largest industries.