专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明授权

US09854176B2 Dynamic lighting capture and reconstruction 有权
公开(公告)号：US09854176B2
公开(公告)日：2017-12-26
申请号：US14164006
申请日：2014-01-24
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Michael Sanders , Kiran Bhat , Curt Isamu Miyashiro , Jason Snell , Stephane Grabli
IPC分类号： G06T15/50 , H04N5/235 , G06K9/46 , H04N19/63 , H04N19/61
CPC分类号： H04N5/2351 , G06K9/4661 , G06T15/50 , H04N5/2353 , H04N19/61 , H04N19/63
摘要： Systems and techniques for dynamically capturing and reconstructing lighting are provided. The systems and techniques may be based on a stream of images capturing the lighting within an environment as a scene is shot. Reconstructed lighting data may be used to illuminate a character in a computer-generated environment as the scene is shot. For example, a method may include receiving a stream of images representing lighting of a physical environment. The method may further include compressing the stream of images to reduce an amount of data used in reconstructing the lighting of the physical environment and may further include outputting the compressed stream of images for reconstructing the lighting of the physical environment using the compressed stream, the reconstructed lighting being used to render a computer-generated environment.

2. 发明申请

US20170148201A1 DETERMINING CONTROL VALUES OF AN ANIMATION MODEL USING PERFORMANCE CAPTURE 审中-公开
公开(公告)号：US20170148201A1
公开(公告)日：2017-05-25
申请号：US15424727
申请日：2017-02-03
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06T13/40 , G06K9/00 , G06T7/73
CPC分类号： G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

3. 发明授权

US10147219B2 Determining control values of an animation model using performance capture 有权
公开(公告)号：US10147219B2
公开(公告)日：2018-12-04
申请号：US15424727
申请日：2017-02-03
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06T13/40 , G06K9/00 , G06T7/73 , G06K9/62 , G06T13/80 , G06T7/60
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

4. 发明授权

US09600742B2 Determining control values of an animation model using performance capture 有权
公开(公告)号：US09600742B2
公开(公告)日：2017-03-21
申请号：US14704796
申请日：2015-05-05
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06T13/00 , G06K9/62 , G06T13/80 , G06K9/00 , G06T7/00 , G06K9/46 , G06T7/60 , G06K9/52
CPC分类号： G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

5. 发明申请

US20160328628A1 DETERMINING CONTROL VALUES OF AN ANIMATION MODEL USING PERFORMANCE CAPTURE 有权
标题翻译：使用性能捕获确定动画模型的控制值
公开(公告)号：US20160328628A1
公开(公告)日：2016-11-10
申请号：US14704796
申请日：2015-05-05
申请人： Lucasfilm Entertainment Company Ltd.
发明人： Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
IPC分类号： G06K9/62 , G06K9/00 , G06K9/52 , G06K9/46 , G06T7/60 , G06T13/80 , G06T7/00
CPC分类号： G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要： Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.
摘要翻译：性能捕获系统和技术被提供用于捕捉主体的表现并再现跟踪对象的表现的动画演奏。例如，提供系统和技术用于确定用于控制动画模型的控制值，以基于性能来定义对象的计算机生成的表示的特征。方法可以包括获得与被摄体执行的姿势对应的输入数据，所述输入数据包括定义被摄体的脸部上的位置的位置信息。该方法可以进一步包括获得用于对象的动画模型，该动画模型包括可调控制，其控制动画模型以定义计算机生成的脸部表示的面部特征，以及将脸部上的一个或多个位置与一个或多个动画模型上的相应位置。匹配包括使用目标函数将错误投射到动画模型的控制空间。该方法还可以包括：使用投影误差和对可调节控制器的一个或多个约束来确定一个或多个可调整控件的一个或多个值。这些值被配置为控制动画模型，以使计算机生成的表示使用一个或多个可调控件来执行姿势的表示。

6. 发明授权

US11049332B2 Facial performance capture in an uncontrolled environment 有权
公开(公告)号：US11049332B2
公开(公告)日：2021-06-29
申请号：US16808110
申请日：2020-03-03
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Matthew Loper , Stéphane Grabli , Kiran Bhat
IPC分类号： G06T19/20 , G06T7/80
摘要： A method of transferring a facial expression from a subject to a computer generated character that includes: receiving a plate with an image of the subject's facial expression and an estimate of intrinsic parameters of a camera used to film the plate; generating a three-dimensional parameterized deformable model of the subject's face where different facial expressions of the subject can be obtained by varying values of the model parameters; solving for the facial expression in the plate by executing a deformation solver to solve for at least some parameters of the deformable model with a differentiable renderer and shape-from-shading techniques, using as inputs, the three-dimensional parameterized deformable model, estimated intrinsic camera parameters, estimated lighting conditions and albedo estimates over a series of iterations to infer geometry of the facial expression and generate an intermediate facial; generating, from the intermediate facial mesh, refined albedo estimates for the deformable model; and solving for the facial expression in the plate by executing the deformation solver using the intermediate facial mesh, the estimated intrinsic camera parameters, the estimated lighting conditions and the refined albedo estimates as inputs over a series of iterations to infer geometry of the facial expression and generate a final facial mesh using the set of parameter values of the deformable model which result in a facial expression that more closely matches the expression of the subject in the plate than does the intermediate facial mesh.

7. 发明申请

US20200286301A1 FACIAL PERFORMANCE CAPTURE IN AN UNCONTROLLED ENVIRONMENT 审中-公开
公开(公告)号：US20200286301A1
公开(公告)日：2020-09-10
申请号：US16808110
申请日：2020-03-03
申请人： LUCASFILM ENTERTAINMENT COMPANY LTD.
发明人： Matthew Loper , Stéphane Grabli , Kiran Bhat
IPC分类号： G06T19/20 , G06T7/80
摘要： A method of transferring a facial expression from a subject to a computer generated character that includes: receiving a plate with an image of the subject's facial expression and an estimate of intrinsic parameters of a camera used to film the plate; generating a three-dimensional parameterized deformable model of the subject's face where different facial expressions of the subject can be obtained by varying values of the model parameters; solving for the facial expression in the plate by executing a deformation solver to solve for at least some parameters of the deformable model with a differentiable renderer and shape-from-shading techniques, using as inputs, the three-dimensional parameterized deformable model, estimated intrinsic camera parameters, estimated lighting conditions and albedo estimates over a series of iterations to infer geometry of the facial expression and generate an intermediate facial; generating, from the intermediate facial mesh, refined albedo estimates for the deformable model; and solving for the facial expression in the plate by executing the deformation solver using the intermediate facial mesh, the estimated intrinsic camera parameters, the estimated lighting conditions and the refined albedo estimates as inputs over a series of iterations to infer geometry of the facial expression and generate a final facial mesh using the set of parameter values of the deformable model which result in a facial expression that more closely matches the expression of the subject in the plate than does the intermediate facial mesh.

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式