专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

11. 发明申请

US20170053663A1 LIP SYNCHRONIZATION BETWEEN RIGS 审中-公开
标题翻译： RIGS之间的LIP同步
公开(公告)号：US20170053663A1
公开(公告)日：2017-02-23
申请号：US14831021
申请日：2015-08-20
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Ji Hun Yu , Michael Koperwas , Jeffrey Bruce Yost , Sheila Santos , Kiran S. Bhat
IPC分类号： G10L21/10 , G06T13/40 , G06T13/20
CPC分类号： G06T13/40 , G06K9/00302 , G06K9/4604 , G06T7/246 , G06T2207/30201 , G06T2207/30204
摘要： In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models. The method further includes determining a solution, including values for at least some of the plurality of controls, that matches the first animation model to the positional information to reproduce the facial expressions from the performance to the first animation model, retargeting the facial expressions from the performance to the second animation model using the solution; and thereafter, synchronizing lip movement of the second animation model with lip movement from the first animation model.
摘要翻译：在一些实施例中，提供了将面部表情从受试者转移到计算机生成的角色的方法，其中所述方法包括从表示具有要传送到计算机生成的角色的表情的表现的对象的运动捕捉会话中接收位置信息，接收表示所述对象的第一动画模型，以及接收表示所述计算机生成的角色的第二动画模型。第一和第二动画模型中的每一个可以包括多个可调整的控件，其限定模型的几何形状，并且可以被调整以在模型上呈现不同的面部表情，并且其中第一和第二动画模型被设计成使得设置相同每个模型中同一组可调节控件的值在模型上产生类似的面部姿势。该方法还包括确定包括与第一动画模型匹配的多个控件中的至少一些的值的解决方案与位置信息，以从表演到第一动画模型再现面部表情，将面部表情从使用该解决方案对第二动画模型的性能; 之后，使第二动画模型的唇部移动与来自第一动画模型的唇部移动同步。

12. 发明授权

US12022357B1 Content presentation and layering across multiple devices 有权
公开(公告)号：US12022357B1
公开(公告)日：2024-06-25
申请号：US17472579
申请日：2021-09-10
申请人： Lucasfilm Entertainment Company Ltd.
发明人： John Gaeta , Michael Koperwas , Nicholas Rasmussen
IPC分类号： G06T19/00 , H04B1/3827 , H04M1/72409 , H04W4/02
CPC分类号： H04W4/026 , G06T19/006 , H04B1/385 , H04M1/72409
摘要： A method includes causing background content to be displayed on a display device with a first virtual object and a second virtual object; causing augmented reality (AR) content to be rendered based on a location of an AR device relative to the display device; determining that the AR content is in front of the first virtual object in the scene when viewed through the AR device and rendering the background content with a cutout in the first virtual object when the first virtual object overlaps with the AR content; and determining that the AR content is behind the second virtual object in the scene when viewed through the AR device and rendering the AR content with a cutout in the AR content when the AR content overlaps with the second virtual object.

13. 发明授权

US11128984B1 Content presentation and layering across multiple devices 有权
公开(公告)号：US11128984B1
公开(公告)日：2021-09-21
申请号：US16664778
申请日：2019-10-25
申请人： Lucasfilm Entertainment Company Ltd.
发明人： John Gaeta , Michael Koperwas , Nicholas Rasmussen
IPC分类号： G06T19/00 , H04W4/02 , H04B1/3827 , H04M1/72409
摘要： A method may include causing first content to be displayed on a display device; causing second content to be rendered irrespective of a location of a mobile device relative to the display device; and causing the second content to be displayed on the mobile device such that the second content is layered over the first content. When the second content has moved a predetermined distance from the screen, The method may also include causing the second content to be rendered based on the location of the mobile device relative to the display device; and causing the second content to be displayed on the mobile device such that the second content is layered over the first content.

14. 发明申请

US20200265638A1 CREATING SHADOWS IN MIXED REALITY 审中-公开
公开(公告)号：US20200265638A1
公开(公告)日：2020-08-20
申请号：US16281003
申请日：2019-02-20
申请人： Lucasfilm Entertainment Company Ltd. LLC
发明人： Michael Koperwas , Lutz Latta
IPC分类号： G06T15/60 , G06T19/00 , G06T7/11 , G06T17/00
摘要： Implementations of the disclosure are directed to generating shadows in the physical world that correspond to virtual objects displayed on MR displays. In some implementations, a method includes: synchronously presenting a version of a scene on each of a MR display system and a projector display system, where during presentation: the MR display system displays a virtual object overlaid over a view of a physical environment; and a projector of the projector display system creates a shadow on a surface in the physical environment, the created shadow corresponding to the virtual object displayed by the MR display. In some implementations, the method includes: loading in a memory of the MR display system, a first version of the scene including the virtual object; and loading in a memory of the projector display system a second version of the scene including a virtual surface onto which the virtual object casts a shadow.

15. 发明授权

US10489958B1 Facial animation models 有权
公开(公告)号：US10489958B1
公开(公告)日：2019-11-26
申请号：US15666286
申请日：2017-08-01
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Ronald Mallet , Yuting Ye , Michael Koperwas , Adrian R. Goldenthal , Kiran S. Bhat
IPC分类号： G06T13/40
CPC分类号： G06T13/40
摘要： A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.

16. 发明授权

US10147219B2 Determining control values of an animation model using performance capture 有权
公开(公告)号：US10147219B2
公开(公告)日：2018-12-04
申请号：US15424727
申请日：2017-02-03
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06T13/40 , G06K9/00 , G06T7/73 , G06K9/62 , G06T13/80 , G06T7/60
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

17. 发明授权

US10078917B1 Augmented reality simulation 有权
公开(公告)号：US10078917B1
公开(公告)日：2018-09-18
申请号：US15289858
申请日：2016-10-10
申请人： Lucasfilm Entertainment Company Ltd.
发明人： John Gaeta , Michael Koperwas , Nicholas Rasmussen
IPC分类号： G06T15/00 , G06T19/00 , G06F3/01 , G02B27/01
CPC分类号： G06F3/012 , G02B27/017 , G02B2027/0134 , G02B2027/014 , G06F3/011 , G06F3/04815 , G06T15/503
摘要： A method may include rendering a first view of a three-dimensional (3-D) virtual scene comprising a view of first content being displayed on a virtual display device from a location in the 3-D virtual scene. The method may also include rendering a second view comprising one or more content objects. The second view may be rendered from the location in the 3-D virtual scene, and the second scene may include a view of the display device as would be seen through a pair of augmented-reality glasses that display the one or more content objects. The method may additionally include generating a composite view by combing the first view and the second view. The method may further include causing the composite view to be displayed on a virtual-reality headset.

18. 发明授权

US10055874B2 Lip synchronization between rigs 有权
公开(公告)号：US10055874B2
公开(公告)日：2018-08-21
申请号：US14831021
申请日：2015-08-20
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Ji Hun Yu , Michael Koperwas , Jeffrey Bruce Yost , Sheila Santos , Kiran S. Bhat
IPC分类号： G10L21/10 , G06T13/40 , G06T13/20
CPC分类号： G06T13/40 , G06K9/00302 , G06K9/4604 , G06T7/246 , G06T2207/30201 , G06T2207/30204
摘要： In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models. The method further includes determining a solution, including values for at least some of the plurality of controls, that matches the first animation model to the positional information to reproduce the facial expressions from the performance to the first animation model, retargeting the facial expressions from the performance to the second animation model using the solution; and thereafter, synchronizing lip movement of the second animation model with lip movement from the first animation model.

19. 发明授权

US09600742B2 Determining control values of an animation model using performance capture 有权
公开(公告)号：US09600742B2
公开(公告)日：2017-03-21
申请号：US14704796
申请日：2015-05-05
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06T13/00 , G06K9/62 , G06T13/80 , G06K9/00 , G06T7/00 , G06K9/46 , G06T7/60 , G06K9/52
CPC分类号： G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

20. 发明申请

US20160328628A1 DETERMINING CONTROL VALUES OF AN ANIMATION MODEL USING PERFORMANCE CAPTURE 有权
标题翻译：使用性能捕获确定动画模型的控制值
公开(公告)号：US20160328628A1
公开(公告)日：2016-11-10
申请号：US14704796
申请日：2015-05-05
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06K9/62 , G06K9/00 , G06K9/52 , G06K9/46 , G06T7/60 , G06T13/80 , G06T7/00
CPC分类号： G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.
摘要翻译：性能捕获系统和技术被提供用于捕捉主体的表现并再现跟踪对象的表现的动画演奏。例如，提供系统和技术用于确定用于控制动画模型的控制值，以基于性能来定义对象的计算机生成的表示的特征。方法可以包括获得与被摄体执行的姿势对应的输入数据，所述输入数据包括定义被摄体的脸部上的位置的位置信息。该方法可以进一步包括获得用于对象的动画模型，该动画模型包括可调控制，其控制动画模型以定义计算机生成的脸部表示的面部特征，以及将脸部上的一个或多个位置与一个或多个动画模型上的相应位置。匹配包括使用目标函数将错误投射到动画模型的控制空间。该方法还可以包括：使用投影误差和对可调节控制器的一个或多个约束来确定一个或多个可调整控件的一个或多个值。这些值被配置为控制动画模型，以使计算机生成的表示使用一个或多个可调控件来执行姿势的表示。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式