专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明申请

US20130095920A1 GENERATING FREE VIEWPOINT VIDEO USING STEREO IMAGING 审中-公开
标题翻译：使用立体成像生成免费观看视频
公开(公告)号：US20130095920A1
公开(公告)日：2013-04-18
申请号：US13273213
申请日：2011-10-13
申请人： Kestutis Patiejunas , Kanchan Mitra , Patrick Sweeney , Yaron Eshet , Adam G. Kirk , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , David Harnett , Amit Mital , Simon Winder
发明人： Kestutis Patiejunas , Kanchan Mitra , Patrick Sweeney , Yaron Eshet , Adam G. Kirk , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , David Harnett , Amit Mital , Simon Winder
IPC分类号： A63F13/00 , H04N13/02
CPC分类号： G06T15/00 , G06T7/521 , G06T7/593 , G06T15/04 , G06T17/20 , G06T2207/10021 , G06T2207/10024 , G06T2207/10048 , G06T2207/20228 , H04N13/111 , H04N13/271 , H04N2013/0081
摘要： Methods and systems for generating free viewpoint video using an active infrared (IR) stereo module are provided. The method includes computing a depth map for a scene using an active IR stereo module. The depth map may be computed by projecting an IR dot pattern onto the scene, capturing stereo images from each of two or more synchronized IR cameras, detecting dots within the stereo images, computing feature descriptors corresponding to the dots in the stereo images, computing a disparity map between the stereo images, and generating the depth map using the disparity map. The method also includes generating a point cloud for the scene using the depth map, generating a mesh of the point cloud, and generating a projective texture map for the scene from the mesh of the point cloud. The method further includes generating the video for the scene using the projective texture map.
摘要翻译：提供了使用主动红外（IR）立体声模块产生免费视点视频的方法和系统。该方法包括使用主动IR立体声模块来计算场景的深度图。可以通过将IR点图案投影到场景上来计算深度图，从两个或更多个同步红外相机中的每一个拍摄立体图像，检测立体图像内的点，计算与立体图像中的点相对应的特征描述符，立体图像之间的视差图，并使用视差图生成深度图。该方法还包括使用深度图生成场景的点云，生成点云的网格，并从点云的网格生成场景的投影纹理贴图。该方法还包括使用投影纹理图生成场景的视频。

2. 发明授权

US08126275B2 Interest point detection 有权
标题翻译：兴趣点检测
公开(公告)号：US08126275B2
公开(公告)日：2012-02-28
申请号：US11739672
申请日：2007-04-24
申请人： Simon Winder
发明人： Simon Winder
IPC分类号： G06K9/46
CPC分类号： G06K9/4671
摘要： An interest point detection technique is presented. More particularly, for each of possibly multiple image pyramid resolutions, a cornerness image is generated. One or more potential interest point locations are identified in the cornerness image. This involves finding locations associated with a pixel that exhibits a higher corner strength value than pixels in a prescribed-sized surrounding pixel neighborhood. The potential interest point locations are then clustered to identify groups that likely derive from a same 2D structure. Potential interest point locations in one or more of the identified groups are respectively combined to produce a single location that represents the combined group. The representative location of each group having one is then designated as an interest point. An optional location refinement can also be implemented.
摘要翻译：提出了一种兴趣点检测技术。更具体地，对于可能的多个图像金字塔分辨率中的每一个，生成角部图像。在角度图像中识别一个或多个潜在的兴趣点位置。这涉及找到与规定大小的周围像素邻域中的像素相比具有更高角强度值的像素的位置。然后将潜在的兴趣点位置聚类以识别可能来自相同2D结构的组。分别组合一个或多个识别组中的潜在兴趣点位置以产生表示组合组的单个位置。然后，将具有一个的每个组的代表性位置指定为兴趣点。还可以实现可选的位置细化。

3. 发明授权

US07561620B2 System and process for compressing and decompressing multiple, layered, video streams employing spatial and temporal encoding 有权
标题翻译：用于使用空间和时间编码来压缩和解压缩多个分层的视频流的系统和过程
公开(公告)号：US07561620B2
公开(公告)日：2009-07-14
申请号：US10910077
申请日：2004-08-03
申请人： Simon Winder , Matthew Uyttendaele , Charles Zitnick, III , Richard Szeliski , Sing Bing Kang
发明人： Simon Winder , Matthew Uyttendaele , Charles Zitnick, III , Richard Szeliski , Sing Bing Kang
IPC分类号： H04B1/66 , H04N7/12 , H04N11/02 , H04N11/04 , H04N5/14 , H04N9/64
CPC分类号： H04N21/4347 , H04N13/111 , H04N19/109 , H04N19/39 , H04N19/593 , H04N19/597 , H04N19/61 , H04N19/70 , H04N19/96 , H04N21/2365
摘要： A system and process for compressing and decompressing multiple video streams depicting substantially the same dynamic scene from different viewpoints. Each frame in each contemporaneous set of video frames of the multiple streams is represented by at least a two layers—a main layer and a boundary layer. Compression of the main layers involves first designating one or more of these layers in each set of contemporaneous frames as keyframes. For each set of contemporaneous frames in time sequence order, the main layer of each keyframe is compressed using an inter-frame compression technique. In addition, the main layer of each non-keyframe within the frame set under consideration is compressed using a spatial prediction compression technique. Finally, the boundary layers of each frame in the current frame set are each compressed using an intra-frame compression technique. Decompression is generally the reverse of the compression process.
摘要翻译：一种用于压缩和解压缩从不同观点描绘基本相同的动态场景的多个视频流的系统和过程。多个流的每个同期视频帧集合中的每个帧由至少两层（主层和边界层）表示。主要层的压缩包括首先将每组同期帧中的这些层中的一个或多个指定为关键帧。对于按时间顺序排列的每组同期帧，使用帧间压缩技术对每个关键帧的主层进行压缩。另外，使用空间预测压缩技术对所考虑的帧集合内的每个非关键帧的主层进行压缩。最后，使用帧内压缩技术对当前帧集合中每帧的边界层进行压缩。压缩通常与压缩过程相反。

4. 发明授权

US07010174B2 System and process for generating high dynamic range video 失效
标题翻译：用于生成高动态范围视频的系统和过程
公开(公告)号：US07010174B2
公开(公告)日：2006-03-07
申请号：US10965935
申请日：2004-10-15
申请人： Sing Bing Kang , Matthew T. Uyttendaele , Simon Winder , Richard Szeliski
发明人： Sing Bing Kang , Matthew T. Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06K9/40
CPC分类号： H04N5/2355 , G06T5/50 , H04N5/235 , H04N5/2352 , H04N5/77 , H04N5/781 , H04N5/85
摘要： A system and process for generating High Dynamic Range (HDR) video is presented which involves first capturing a video image sequence while varying the exposure so as to alternate between frames having a shorter and longer exposure. The exposure for each frame is set prior to it being captured as a function of the pixel brightness distribution in preceding frames. Next, for each frame of the video, the corresponding pixels between the frame under consideration and both preceding and subsequent frames are identified. For each corresponding pixel set, at least one pixel is identified as representing a trustworthy pixel. The pixel color information associated with the trustworthy pixels is then employed to compute a radiance value for each pixel set to form a radiance map. A tone mapping procedure can then be performed to convert the radiance map into an 8-bit representation of the HDR frame.
摘要翻译：提出了用于产生高动态范围（HDR）视频的系统和过程，其涉及首先在改变曝光的同时捕获视频图像序列，以便在具有较短和较长曝光的帧之间交替。每个帧的曝光在其被捕获之前被设置为在先前帧中的像素亮度分布的函数。接下来，对于视频的每个帧，识别所考虑的帧与前后帧之间的对应像素。对于每个对应的像素集合，至少一个像素被识别为表示可靠的像素。然后使用与可信赖像素相关联的像素颜色信息来计算每个像素组的辐射值以形成辐射图。然后可以执行色调映射过程以将辐射图转换成HDR帧的8位表示。

5. 发明申请

US20050286759A1 Interactive viewpoint video system and process employing overlapping images of a scene captured from viewpoints forming a grid 有权
标题翻译：交互视点视频系统和使用从形成网格的视点捕获的场景的重叠图像的处理
公开(公告)号：US20050286759A1
公开(公告)日：2005-12-29
申请号：US11097542
申请日：2005-03-31
申请人： Charles Zitnick , Matthew Uyttendaele , Richard Szeliski , Simon Winder , Sing Kang
发明人： Charles Zitnick , Matthew Uyttendaele , Richard Szeliski , Simon Winder , Sing Kang
IPC分类号： G06T15/20 , G06T19/00 , G06K9/00
CPC分类号： H04N5/2627 , G06T7/557 , G06T7/596 , G06T15/205 , G06T2207/10021
摘要： A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
摘要翻译：一种用于生成并再现和显示交互视点视频的系统和过程，其中用户可以在操纵（冻结，减慢或反转）时间并随意改变视点的同时观看动态场景。通常，使用少量摄像机生成交互视点视频以捕获多个视频流。采用多视图3D重建和消隐技术来创建视频帧的分层表示，使得能够实现捕获的动态场景的高效压缩和交互式回放，同时允许实时渲染。

6. 发明申请

US20050285875A1 Interactive viewpoint video system and process 有权
标题翻译：互动观点视频系统和过程
公开(公告)号：US20050285875A1
公开(公告)日：2005-12-29
申请号：US10880774
申请日：2004-06-28
申请人： Sing Kang , Charles Zitnick , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Sing Kang , Charles Zitnick , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06T15/20 , G06T19/00 , G09G5/00
CPC分类号： H04N5/2627 , G06T7/557 , G06T7/596 , G06T15/205 , G06T2207/10021
摘要： A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
摘要翻译：一种用于生成并再现和显示交互视点视频的系统和过程，其中用户可以在操纵（冻结，减慢或反转）时间并随意改变视点的同时观看动态场景。通常，使用少量摄像机生成交互视点视频以捕获多个视频流。采用多视图3D重建和消隐技术来创建视频帧的分层表示，使得能够实现捕获的动态场景的高效压缩和交互式回放，同时允许实时渲染。

7. 发明申请

US20050013501A1 System and process for generating high dynamic range images from multiple exposures of a moving scene 有权
标题翻译：用于从移动场景的多次曝光中产生高动态范围图像的系统和过程
公开(公告)号：US20050013501A1
公开(公告)日：2005-01-20
申请号：US10623033
申请日：2003-07-18
申请人： Sing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Sing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06T1/00 , G06F20060101 , G06K9/40 , G06T20060101 , G06T3/00 , G06T5/00 , G06T5/50 , G06T7/20 , H04N1/407 , H04N1/46 , H04N1/60 , H04N5/235 , H04N5/262
CPC分类号： G06T5/50 , G06T7/269
摘要： A system and process for generating a high dynamic range (HDR) image from a bracketed image sequence, even in the presence of scene or camera motion, is presented. This is accomplished by first selecting one of the images as a reference image. Then, each non-reference image is registered with another one of the images, including the reference image, which exhibits an exposure that is both closer to that of the reference image than the image under consideration and closest among the other images to the exposure of the image under consideration, to generate a flow field. The flow fields generated for the non-reference images not already registered with the reference image are concatenated to register each of them with the reference image. Each non-reference image is then warped using its associated flow field. The reference image and the warped images are combined to create a radiance map representing the HDR image.
摘要翻译：提出了即使在存在场景或相机运动的情况下也可以从包围的图像序列生成高动态范围（HDR）图像的系统和过程。这是通过首先选择一个图像作为参考图像来实现的。然后，将每个非参考图像与包括参考图像的另一个图像一起登记，该参考图像表现出比正在考虑的图像更接近参考图像的曝光，并且在其他图像中最接近曝光考虑的图像，产生一个流场。为未参考图像注册的非参考图像生成的流场被连接以将它们注册到参考图像。然后使用其相关联的流场对每个非参考图像进行翘曲。参考图像和翘曲图像被组合以产生表示HDR图像的辐射图。

8. 发明授权

US08774274B2 Compressing and decompressing multiple, layered, video streams employing multi-directional spatial encoding 有权
标题翻译：使用多向空间编码压缩和解压缩多个分层的视频流
公开(公告)号：US08774274B2
公开(公告)日：2014-07-08
申请号：US13348262
申请日：2012-01-11
申请人： Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
发明人： Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
IPC分类号： H04N7/12
CPC分类号： H04N21/4347 , H04N13/111 , H04N19/109 , H04N19/39 , H04N19/593 , H04N19/597 , H04N19/61 , H04N19/70 , H04N19/96 , H04N21/2365
摘要： A process for compressing and decompressing non-keyframes in sequential sets of contemporaneous video frames making up multiple video streams where the video frames in a set depict substantially the same scene from different viewpoints. Each set of contemporaneous video frames has a plurality frames designated as keyframes with the remaining being non-keyframes. In one embodiment, the non-keyframes are compressed using a multi-directional spatial prediction technique. In another embodiment, the non-keyframes of each set of contemporaneous video frames are compressed using a combined chaining and spatial prediction compression technique. The spatial prediction compression technique employed can be a single direction technique where just one reference frame, and so one chain, is used to predict each non-keyframe, or it can be a multi-directional technique where two or more reference frames, and so chains, are used to predict each non-keyframe.
摘要翻译：一种用于在构成多个视频流的同步视频帧的顺序集合中压缩和解压缩非关键帧的过程，其中集合中的视频帧从不同视点描绘基本相同的场景。每组同时期的视频帧具有指定为关键帧的多个帧，其余的是非关键帧。在一个实施例中，使用多方向空间预测技术来压缩非关键帧。在另一个实施例中，使用组合链接和空间预测压缩技术来压缩每组同时期视频帧的非关键帧。所使用的空间预测压缩技术可以是单向技术，其中仅使用一个参考帧，因此使用一条链来预测每个非关键帧，或者它可以是多方向技术，其中两个或更多个参考帧等链，用于预测每个非关键帧。

9. 发明申请

US20130321586A1 CLOUD BASED FREE VIEWPOINT VIDEO STREAMING 审中-公开
标题翻译：基于云的免费观看视频流
公开(公告)号：US20130321586A1
公开(公告)日：2013-12-05
申请号：US13588917
申请日：2012-08-17
申请人： Adam Kirk , Patrick Sweeney , Don Gillett , Neil Fishman , Kanchan Mitra , Amit Mital , David Harnett , Yaron Eshet , Simon Winder , David Eraker
发明人： Adam Kirk , Patrick Sweeney , Don Gillett , Neil Fishman , Kanchan Mitra , Amit Mital , David Harnett , Yaron Eshet , Simon Winder , David Eraker
IPC分类号： H04N13/02
CPC分类号： G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要： Cloud based FVV streaming technique embodiments presented herein generally employ a cloud based FVV pipeline to create, render and transmit FVV frames depicting a captured scene as would be viewed from a current synthetic viewpoint selected by an end user and received from a client computing device. The FVV frames use a similar level of bandwidth as a conventional streaming movie would consume. To change viewpoints, a new viewpoint is sent from the client to the cloud, and a new streaming movie is initiated from the new viewpoint. Frames associated with that viewpoint are created, rendered and transmitted to the client until a new viewpoint request is received.
摘要翻译：本文呈现的基于云的FVV流技术实施例通常使用基于云的FVV流水线来创建，呈现和发送描绘所捕获场景的FVV帧，如将从最终用户选择并从客户端计算设备接收的当前合成视点所观察到的。 FVV帧使用与传统流式电影将消耗的类似的带宽水平。为了改变观点，从客户端向云端发送一个新的观点，从新的角度出发新的流媒体电影。与该视点相关联的帧被创建，呈现并发送到客户端，直到接收到新的视点请求为止。

10. 发明授权

US07324687B2 Color segmentation-based stereo 3D reconstruction system and process 有权
标题翻译：基于颜色分割的立体3D重建系统和过程
公开(公告)号：US07324687B2
公开(公告)日：2008-01-29
申请号：US10879327
申请日：2004-06-28
申请人： Charles Zitnick, III , Sing Bing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Charles Zitnick, III , Sing Bing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06K9/00
CPC分类号： G06K9/20 , G06K2209/40 , G06T7/55
摘要： A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.
摘要翻译：提出了一种用于基于基于颜色分割的方法从其多个图像计算场景的3D重建的系统和过程。首先，每个图像被独立地分割。第二，使用假设一个段内的所有像素具有相同的视差来为每个段计算初始视差空间分布（DSD）。接下来，每个段的DSD使用相邻段进行细化，并将其投影到其他图像中。然后在视差平滑阶段放宽每个段具有单个视差的假设。结果是每个图像的视差图，如果重建应用程序需要它，它又可以用于计算每像素深度图。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式