专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

31. 发明授权

US07742623B1 Method and system for estimating gaze target, gaze sequence, and gaze map from video 有权
标题翻译：用于从视频估计注视目标，注视序列和凝视图的方法和系统
公开(公告)号：US07742623B1
公开(公告)日：2010-06-22
申请号：US12221552
申请日：2008-08-04
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00
CPC分类号： G06K9/00604 , G06K9/00228
摘要： The present invention is a method and system to estimate the visual target that people are looking, based on automatic image measurements. The system utilizes image measurements from both face-view cameras and top-down view cameras. The cameras are calibrated with respect to the site and the visual target, so that the gaze target is determined from the estimated position and gaze direction of a person. Face detection and two-dimensional pose estimation locate and normalize the face of the person so that the eyes can be accurately localized and the three-dimensional facial pose can be estimated. The eye gaze is estimated based on either the positions of localized eyes and irises or on the eye image itself, depending on the quality of the image. The gaze direction is estimated from the eye gaze measurement in the context of the three-dimensional facial pose. From the top-down view the body of the person is detected and tracked, so that the position of the head is estimated using a body blob model that depends on the body position in the view. The gaze target is determined based on the estimated gaze direction, estimated head pose, and the camera calibration. The gaze target estimation can provide a gaze trajectory of the person or a collective gaze map from many instances of gaze.
摘要翻译：本发明是基于自动图像测量来估计人们正在寻找的视觉目标的方法和系统。该系统利用来自面视摄像机和自顶向下摄像机的图像测量。摄像机相对于场地和视觉目标进行校准，从而根据人的估计位置和视线方向确定目标目标。面部检测和二维姿态估计定位和归一化人脸，使眼睛能够被精确定位，并且可以估计三维面部姿势。根据图像的质量，基于局部眼睛和虹膜的位置或眼睛图像本身来估计眼睛注视。在三维面部姿势的背景下，从眼睛注视测量估计视线方向。从自上而下的视角，人体的身体被检测和跟踪，以便使用取决于视图中的身体位置的身体斑点模型来估计头部的位置。目标目标是根据估计的注视方向，估计头部姿态和相机校准来确定的。注视目标估计可以从许多注视情况提供人的凝视轨迹或集体凝视图。

32. 发明申请

US20090285456A1 Method and system for measuring human response to visual stimulus based on changes in facial expression 有权
标题翻译：基于面部表情变化测量人类视觉刺激反应的方法和系统
公开(公告)号：US20090285456A1
公开(公告)日：2009-11-19
申请号：US12154002
申请日：2008-05-19
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00
CPC分类号： G06K9/00335 , G06K9/00315
摘要： The present invention is a method and system for measuring human emotional response to visual stimulus, based on the person's facial expressions. Given a detected and tracked human face, it is accurately localized so that the facial features are correctly identified and localized. Face and facial features are localized using the geometrically specialized learning machines. Then the emotion-sensitive features, such as the shapes of the facial features or facial wrinkles, are extracted. The facial muscle actions are estimated using a learning machine trained on the emotion-sensitive features. The instantaneous facial muscle actions are projected to a point in affect space, using the relation between the facial muscle actions and the affective state (arousal, valence, and stance). The series of estimated emotional changes renders a trajectory in affect space, which is further analyzed in relation to the temporal changes in visual stimulus, to determine the response.
摘要翻译：本发明是一种用于根据人的面部表情测量人类对视觉刺激的情感反应的方法和系统。给人一个被检测和跟踪的人脸，它被精确定位，使得脸部特征被正确识别和定位。脸部和面部特征使用几何专业的学习机器进行本地化。然后提取情感敏感的特征，如面部特征或面部皱纹的形状。使用受情绪敏感特征训练的学习机来估计面部肌肉动作。使用面部肌肉动作和情感状态（觉醒，价态和姿态）之间的关系将即时面部肌肉动作投射到影响空间的一个点。估计情绪变化的一系列呈现出影响空间的轨迹，进一步根据视觉刺激的时间变化进行分析，以确定反应。

33. 发明授权

US07590261B1 Method and system for event detection by analysis of linear feature occlusion 有权
标题翻译：通过分析线性特征遮挡事件检测的方法和系统
公开(公告)号：US07590261B1
公开(公告)日：2009-09-15
申请号：US10912450
申请日：2004-07-30
申请人： Vladimir Y. Mariano , Rajeev Sharma
发明人： Vladimir Y. Mariano , Rajeev Sharma
IPC分类号： G06K9/00
CPC分类号： G06K9/00785 , G06K9/6878
摘要： The invention is a method for detecting events in an imaged scene by analyzing the occlusion of linear features in the background image. Linear features, curved or straight, in specific scene locations are either manually specified or automatically learned from an image or image sequence of the background scene. For each linear feature, an occlusion model determines whether the line or part of it is occluded. The locations of the lines of interest in the scene, together with their occlusion characterizations, collectively form a description of the scene for a particular image. An event, defined as a series of descriptions of the scene over an image sequence, can then be initially defined and subsequently detected automatically by the system. An example application of this is counting cars or people passing in front of a video camera.
摘要翻译：本发明是通过分析背景图像中的线性特征的遮挡来检测成像场景中的事件的方法。在特定场景位置的线性特征，弯曲或直线，可以从背景场景的图像或图像序列手动指定或自动学习。对于每个线性特征，遮挡模型确定线或其一部分是否被遮挡。感兴趣的场景的位置以及它们的遮挡特性一起形成特定图像的场景的描述。然后可以首先定义事件，定义为一系列对图像序列的场景的描述，然后由系统自动检测。这方面的一个例子是计算在摄像机前面通过的汽车或人。

34. 发明授权

US07274803B1 Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction 有权
标题翻译：用于检测有意识的手运动模式的方法和系统以及用于促进人机交互的计算机生成的视觉反馈
公开(公告)号：US07274803B1
公开(公告)日：2007-09-25
申请号：US10403234
申请日：2003-03-31
申请人： Rajeev Sharma , Nils Krahnstoever , Emilio Schapira
发明人： Rajeev Sharma , Nils Krahnstoever , Emilio Schapira
IPC分类号： G06K9/00 , G06K9/34 , H04N7/14 , H04N7/18 , H04N9/47
CPC分类号： G06K9/00375
摘要： The present invention is a system and method for detecting and analyzing motion patterns of individuals present at a multimedia computer terminal from a stream of video frames generated by a video camera and the method of providing visual feedback of the extracted information to aid the interaction process between a user and the system. The method allows multiple people to be present in front of the computer terminal and yet allow one active user to make selections on the computer display. Thus the invention can be used as method for contact-free human-computer interaction in a public place, where the computer terminal can be positioned in a variety of configurations including behind a transparent glass window or at a height or location where the user cannot touch the terminal physically.
摘要翻译：本发明是一种用于从由摄像机产生的视频帧流中检测和分析存在于多媒体计算机终端的个人的运动模式的系统和方法，以及提供所提取的信息的视觉反馈以帮助在用户和系统。该方法允许多个人存在于计算机终端之前，并且允许一个主动用户在计算机显示器上进行选择。因此，本发明可以用作公共场合中的无接触人机交互的方法，其中计算机终端可以以包括透明玻璃窗后面或用户不能接触的高度或位置处的各种配置来定位物理终端。

35. 发明授权

US07225414B1 Method and system for virtual touch entertainment 有权
标题翻译：虚拟触摸娱乐的方法和系统
公开(公告)号：US07225414B1
公开(公告)日：2007-05-29
申请号：US10634962
申请日：2003-08-05
申请人： Rajeev Sharma , Emilio Schapira , Namsoon Jung
发明人： Rajeev Sharma , Emilio Schapira , Namsoon Jung
IPC分类号： G06F3/00 , G06F9/00
CPC分类号： G06F3/017 , G06F3/012
摘要： The present invention is a method and apparatus for attracting the attention of people in public places and engaging them in a touch-free interaction with a multimedia display using an image-capturing system and a set of Computer Vision algorithms as a means of informing the public as well as collecting data about/from the users. The invention is named, Virtual Touch Entertainment (VTE) Platform. The VTE Platform comprises of a series of interaction states, such as the Wait State, the Attraction State, the User Engagement State, the User Interaction State, and the Interaction Termination State. The modules in these interaction states handle complicated tasks assigned to them, such as attracting the users, training the users, providing the multimedia digital content to the users, and collecting the user data and statistics, in an efficient and intelligent manner. The user is able to experience a whole new way of interaction paradigm while getting information and entertainment through the rich digital multimedia. The system operates automatically and dynamically in real-time throughout the whole interaction process.
摘要翻译：本发明是一种用于吸引公共场所的人的注意力的方法和装置，并且使用图像捕获系统和一组计算机视觉算法作为通知公众的手段使其与多媒体显示器的无触摸的交互以及从用户那里收集数据。该发明被命名为虚拟触摸娱乐（VTE）平台。 VTE平台包括一系列交互状态，例如等待状态，吸引状态，用户参与状态，用户交互状态和交互终止状态。这些交互状态中的模块处理分配给他们的复杂任务，例如吸引用户，训练用户，向用户提供多媒体数字内容，并以高效智能的方式收集用户数据和统计信息。用户能够通过丰富的数字多媒体获得信息和娱乐，体验全新的互动模式。系统在整个交互过程中实时自动动态地运行。

36. 发明授权

US10963893B1 Personalized decision tree based on in-store behavior analysis 有权
公开(公告)号：US10963893B1
公开(公告)日：2021-03-30
申请号：US15051629
申请日：2016-02-23
申请人： Rajeev Sharma
发明人： Rajeev Sharma
IPC分类号： G06Q30/00 , G06Q30/02 , G06K9/00
摘要： A method and system for determining the hierarchical purchase decision process of a shopper in front of a product category in a retail store. Shopping consideration and the decision path the shopper can be obtained by combining behavior data with the category layout and transaction data. The hierarchical decision process can be determined based on observed actual in-store purchase behavior using a set of video cameras and processor implemented instructions for extracting the sequence and timing of the shopper's decision process. The hierarchical decision process, obtained by the clustering of shopper behavior data over multiple shopping trips, can not only identify the sequence of the decision, but can also quantify the volume of shopping trips at each level in the decision process and the amount of time spent by the shopper for making each decision. The decisions of the shopper for each product group can be captured down to the product attribute level. Such in-depth understanding can provide a picture of the relative importance of each product attribute in the purchase decision process, and can help retailers personalize targeted messaging to the shopper.

37. 发明授权

US10614436B1 Association of mobile device to retail transaction 有权
公开(公告)号：US10614436B1
公开(公告)日：2020-04-07
申请号：US15247324
申请日：2016-08-25
申请人： Rajeev Sharma , Joonhwa Shin , Youngrock Yoon , Donghun Kim
发明人： Rajeev Sharma , Joonhwa Shin , Youngrock Yoon , Donghun Kim
IPC分类号： G06Q20/20 , G06Q10/10 , G06Q20/12 , G06K9/00 , G06F16/51 , G06F16/583 , G06F16/58
CPC分类号： G06Q20/202 , G06F16/51 , G06F16/5854 , G06F16/5866 , G06K9/00288 , G06Q10/10 , G06Q20/12
摘要： A method and system for associating a mobile device carried by a shopper with Point-of-Sale (PoS) data from that shopper's transaction at a retail location. Specifically, the association can utilize face data that was associated with the mobile device to match face data that was generated by association with PoS data. The association with a mobile device can also include the calculation of a mobile trajectory to enable the generation of a shopper profile including shopper behavior. The mobile to PoS association can include tracking of the mobile device throughout a retail location to form a trajectory. The association of a face to a mobile device can utilize the device's MAC address and repeat visit analysis to determine a match. The association of a face to PoS data can utilize the aligning of event time series based on a dynamic time disparity to match checkout events with PoS events.

38. 发明授权

US09747497B1 Method and system for rating in-store media elements 有权
公开(公告)号：US09747497B1
公开(公告)日：2017-08-29
申请号：US12386655
申请日：2009-04-21
申请人： Rajeev Sharma , Varij Saurabh , Namsoon Jung
发明人： Rajeev Sharma , Varij Saurabh , Namsoon Jung
IPC分类号： G06K9/00
CPC分类号： G06K9/00369 , G06K9/00771 , G06Q30/00
摘要： The present invention is a method and system for rating in-store media elements based on the measurement for behavior patterns and demographics of the audience in the vicinity of the media element, where a plurality of input images of the audience are captured by at least a means for capturing images in the vicinity of the media element. The input images are processed by automated video analytic algorithms in order to measure the behavior patterns and demographics of each person in the audience tied to the media element. The measurements for the behavior patterns and demographics of the audience from the target media elements are aggregated. A set of ratings for the media element is calculated based on the measurements. The measured media elements are sampled, and the audience measurement for the sample is extrapolated to other media elements for in-store locations or for a group of stores. The ratings are converted into a standardized output. The standardized output facilitates comparisons among a plurality of media elements. The rating can be used to plan media types in the media element for reaching targeted demographics.

39. 发明授权

US09740977B1 Method and system for recognizing the intentions of shoppers in retail aisles based on their trajectories 有权
公开(公告)号：US09740977B1
公开(公告)日：2017-08-22
申请号：US12455295
申请日：2009-05-29
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06N5/00 , G06N7/00 , G06T7/00
CPC分类号： G06N5/00 , G06K9/00771 , G06N7/005 , G06Q30/02 , G06T7/00
摘要： The present invention is a method and system for automatically recognizing which products a shopper intends to find or purchase based on the shopper's trajectory in a retail aisle. First, the system detects and tracks the person to generate the trajectory of the shopper. Then some of the dynamic features are extracted from the shopper trajectory. The shopper trajectory features of a given trajectory are typically the positions, the motion orientations, and speeds at each point of the trajectory. A shopper behavior model is designed based on some of the primitive actions of shoppers. The last step of the method is to analyze a given shopper trajectory to estimate the shopper's intention. The step either utilizes decision rules based on the extracted shopper trajectory features, or utilizes a trained Hidden Markov Model, to estimate the progression of the primitive actions from the trajectory. The decoded progression of the shopper behavior states is then interpreted to finally determine the shopper's intention.

40. 发明授权

US08570376B1 Method and system for efficient sampling of videos using spatiotemporal constraints for statistical behavior analysis 有权
标题翻译：使用时空约束对视频进行有效采样的方法和系统进行统计行为分析
公开(公告)号：US08570376B1
公开(公告)日：2013-10-29
申请号：US12313359
申请日：2008-11-19
申请人： Rajeev Sharma , Namsoon Jung
发明人： Rajeev Sharma , Namsoon Jung
IPC分类号： H04N7/18 , G06K9/00
CPC分类号： H04N7/18 , G06K9/00751 , G06K9/00771 , G06Q30/02
摘要： The present invention is a method and system for selecting and storing videos by applying semantically-meaningful selection criteria to the track sequences of the trips made by people in an area covered by overlapping multiple cameras. The present invention captures video streams of the people in the area by multiple cameras and tracks the people in each of the video streams, producing track sequences in each video stream. The present invention determines a first set of video segments that contains the trip information of the people, and compacts each of the video streams by removing a second set of video segments that do not contain the trip information of the people from each of the video streams. The present invention selects video segments from the first set of video segments based on predefined selection criteria for the statistical behavior analysis. The stored video data is an efficient compact format of video segments that contain the track sequences of the people and selected according to semantically-meaningful and domain-specific selection criteria. The final storage format of the videos is a trip-centered format, which sequences videos from across multiple cameras, and it can be used to facilitate multiple applications dealing with behavior analysis in a specific domain.
摘要翻译：本发明是一种通过将语义上有意义的选择标准应用于由重叠的多个照相机覆盖的区域中的人们进行的旅行的轨道序列来选择和存储视频的方法和系统。本发明通过多个摄像机捕获该区域中的人的视频流，并且跟踪每个视频流中的人，并产生每个视频流中的轨道序列。本发明确定包含人员的行程信息的第一组视频段，并通过从每个视频流中移除不包含人员的行程信息的第二组视频段来压缩每个视频流。本发明基于用于统计行为分析的预定义的选择标准从第一组视频片段中选择视频段。存储的视频数据是包含人的轨道序列并根据语义有意义的和特定于领域的选择标准来选择的视频片段的有效的紧凑格式。视频的最终存储格式是一种以行程为中心的格式，可以对来自多个摄像机的视频进行排序，并可用于促进处理特定域中行为分析的多个应用程序。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式