专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明公开

US20230385157A1 SNAPSHOT COMPARISON WITH METADATA COMPACTION 审中-公开
公开(公告)号：US20230385157A1
公开(公告)日：2023-11-30
申请号：US18325853
申请日：2023-05-30
申请人： Cloudera, Inc.
发明人： Prashant Pogde , Siddharth Wagle , Siyao Meng , Nandakumar Vadivelu , Sadanand Shenoy
IPC分类号： G06F11/14 , G06F16/11 , G06F16/13 , G06F16/182 , G06F16/178
CPC分类号： G06F11/1458 , G06F16/122 , G06F16/134 , G06F16/1844 , G06F16/178 , G06F2201/84
摘要： Snapshot or point-in-time image functionality improves the use of object-based datastores. An example system includes an object-based datastore and a metadata datastore associated with the object-based datastore. Instances of the metadata datastore are created as snapshot images of the object-based datastore. Comparison of snapshot images is important for database analytics, disaster recovery, data protection, and more. Example techniques provide comparison of snapshot images (as metadata datastore instances) and remain robust and accurate in view of compactions performed by the metadata datastore. An example technique includes generating and updating a graph-based data structure that captures relationships between metadata files in the metadata datastore, particularly between pre-compaction files and post-compaction files. The example technique further includes referencing the graph-based data structure to accelerate snapshot image comparison based on determining whether files of a source snapshot image were compacted into files of a destination snapshot image, and/or vice versa.

2. 发明授权

US11768739B2 Manifest-based snapshots in distributed computing environments 有权
公开(公告)号：US11768739B2
公开(公告)日：2023-09-26
申请号：US16943674
申请日：2020-07-30
申请人： Cloudera, Inc.
发明人： Jonathan Ming-Cyn Hsieh , Matteo Bertozzi
IPC分类号： G06F16/27 , G06F11/14
CPC分类号： G06F11/1464 , G06F16/27 , G06F11/1456 , G06F2201/84
摘要： Scalable architectures, systems, and services are provided herein for creating manifest-based snapshots in distributed computing environments. In some embodiments, responsive to receiving a request to create a snapshot of a data object, a master node identifies multiple slave nodes on which a data object is stored in the cloud-computing platform and creates a snapshot manifest representing the snapshot of the data object. The snapshot manifest comprises a file including a listing of multiple file names in the snapshot manifest and reference information for locating the multiple files in the distributed database system. The snapshot can be created without disrupting I/O operations, e.g., in an online mode by various region servers as directed by the master node. Additionally, a log roll approach to creating the snapshot is also disclosed in which log files are marked. The replaying of log entries can reduce the probability of causal consistency in the snapshot.

3. 发明授权

US11630830B2 Background format optimization for enhanced queries in a distributed computing cluster 有权
公开(公告)号：US11630830B2
公开(公告)日：2023-04-18
申请号：US16921558
申请日：2020-07-06
申请人： Cloudera, Inc.
发明人： Marcel Kornacker , Justin Erickson , Nong Li , Lenni Kuff , Henry Noel Robinson , Alan Choi , Alex Behm
IPC分类号： G06F16/2458 , G06F16/25 , G06F16/27 , G06F16/2453
摘要： A format conversion engine for Apache Hadoop that converts data from its original format to a database-like format at certain time points for use by a low latency (LL) query engine. The format conversion engine comprises a daemon that is installed on each data node in a Hadoop cluster. The daemon comprises a scheduler and a converter. The scheduler determines when to perform the format conversion and notifies the converter when the time comes. The converter converts data on the data node from its original format to a database-like format for use by the low latency (LL) query engine.

4. 发明申请

US20220382323A1 ENSURING PROPERLY ORDERED EVENTS IN A DISTRIBUTED COMPUTING ENVIRONMENT 有权
公开(公告)号：US20220382323A1
公开(公告)日：2022-12-01
申请号：US17836909
申请日：2022-06-09
申请人： Cloudera, Inc.
发明人： David Alves , Todd Lipcon
IPC分类号： G06F1/14 , G06F11/07
摘要： A first event occurs at a first computer at a first time, as measured by a local clock. A second event is initiated at a second computer by sending a message that includes the first time. The second event occurs at a second time, as measured by a local clock. Because of clock error, the first time is later than the second time. Based on the first time being later than the second time, an alternate second time, that is based on the first time, is used as the time of the second event. When a third system determines the order of the two events, the first time is obtained from the first computer, and the alternate second time is obtained from the second computer, and the order of the events is determined based on a comparison of the two times.

5. 发明申请

US20210271653A1 MUTATIONS IN A COLUMN STORE 有权
公开(公告)号：US20210271653A1
公开(公告)日：2021-09-02
申请号：US17314813
申请日：2021-05-07
申请人： Cloudera, Inc.
发明人： Todd Lipcon
IPC分类号： G06F16/22 , G06F16/23
摘要： Columnar storage provides many performance and space saving benefits for analytic workloads, but previous mechanisms for handling single row update transactions in column stores suffer from poor performance. A columnar data layout facilitates both low-latency random access capabilities together with high-throughput analytical access capabilities, simplifying Hadoop architectures for use cases involving real-time data. In disclosed embodiments, mutations within a single row are executed atomically across columns and do not necessarily include the entirety of a row. This allows for faster updates without the overhead of reading or rewriting larger columns.

6. 发明授权

US11099892B2 Utilization-aware resource scheduling in a distributed computing cluster 有权
公开(公告)号：US11099892B2
公开(公告)日：2021-08-24
申请号：US16797996
申请日：2020-02-21
申请人： Cloudera, Inc.
发明人： Karthik Kambatla
IPC分类号： G06F9/44 , G06F9/48 , G06F9/50
摘要： Embodiments are disclosed for a utilization-aware approach to cluster scheduling, to address this resource fragmentation and to improve cluster utilization and job throughput. In some embodiments a resource manager at a master node considers actual usage of running tasks and schedules opportunistic work on underutilized worker nodes. The resource manager monitors resource usage on these nodes and preempts opportunistic containers in the event this over-subscription becomes untenable. In doing so, the resource manager effectively utilizes wasted resources, while minimizing adverse effects on regularly scheduled tasks.

7. 发明授权

US10853368B2 Distinct value estimation for query planning 有权
公开(公告)号：US10853368B2
公开(公告)日：2020-12-01
申请号：US15943496
申请日：2018-04-02
申请人： Cloudera, Inc.
发明人： Alexander Behm , Mostafa Mokhtar
IPC分类号： G06F16/00 , G06F16/2453 , G06F16/2458 , G06F16/835
摘要： The problem of distinct value estimation has many applications, but is particularly important in the field of database technology where such information is utilized by query planners to generate and optimize query plans. Introduced is a novel technique for estimating the number of distinct values in a given dataset without scanning all of the values in the dataset. In an example embodiment, the introduced technique includes gathering multiple intermediate probabilistic estimates based on varying samples of the dataset, 2) plotting the multiple intermediate probabilistic estimates against indications of sample size, 3) fitting a function to the plotted data points, and 4) determining an overall distinct value estimate by extrapolating the objective function to an estimated or known total number of values in the dataset.

8. 发明授权

US10681190B2 Ensuring properly ordered events in a distributed computing environment 有权
公开(公告)号：US10681190B2
公开(公告)日：2020-06-09
申请号：US16198677
申请日：2018-11-21
申请人： Cloudera, Inc.
发明人： David Alves , Todd Lipcon
IPC分类号： H04L29/06 , G06F1/14 , G06Q50/26 , H04L29/08 , G06Q10/00
摘要： A first event occurs at a first computer at a first time, as measured by a local clock. A second event is initiated at a second computer by sending a message that includes the first time. The second event occurs at a second time, as measured by a local clock. Because of clock error, the first time is later than the second time. Based on the first time being later than the second time, an alternate second time, that is based on the first time, is used as the time of the second event. When a third system determines the order of the two events, the first time is obtained from the first computer, and the alternate second time is obtained from the second computer, and the order of the events is determined based on a comparison of the two times.

9. 发明授权

US10599664B2 Interactive identification of similar SQL queries 有权
公开(公告)号：US10599664B2
公开(公告)日：2020-03-24
申请号：US15495397
申请日：2017-04-24
申请人： Cloudera, Inc.
发明人： Rituparna Agrawal , Anupam Singh , Prithviraj Pandian
IPC分类号： G06F16/248 , G06F16/84 , G06F16/21 , G06F16/28 , G06F16/2455
摘要： Systems and methods for very fast grouping of “similar” SQL queries according to user-supplied similarity criteria. The user-supplied similarity criteria include a threshold quantifying the degree of similarity between SQL queries and common artifacts included in the queries. A similarity-characterizing data structure allows for the very fast grouping of “similar” SQL queries. Because the computation is distributed among multiple compute nodes, a small cluster of compute nodes takes a short time to compute the similarity-characterizing data on a workload of tens of millions of queries. The user can supply the similarity criteria through a UI or a command line tool. Furthermore, the user can adjust the degree of similarity by supplying new similarity criteria. Accordingly, the system can display in real time or near real time, updated SQL groupings corresponding to the newly supplied similarity criteria using the originally computed similarity-characterizing data structure.

10. 发明授权

US10255335B2 Database workload analysis and optimization visualizations 有权
公开(公告)号：US10255335B2
公开(公告)日：2019-04-09
申请号：US15345375
申请日：2016-11-07
申请人： Cloudera, Inc.
发明人： Yihua Ding
IPC分类号： G06F17/30
摘要： Techniques are described for analyzing usage of data stored in a data storage system without accessing the stored data. In some embodiments, workload data indicative of queries executed at the data storage system on stored data is received. This workload data can include query logs generated during execution of the queries. The workload data is processed to identify data elements such as tables, columns, and views associated with the stored data as well as information regarding usage of the identified data elements. Usage can include operations performed on the data elements during execution of the queries. Based on this processing relationships between the identified data elements can be inferred and visualizations generated that convey information regarding usage of the data stored at the data storage system. Visualizations can include, among others, usage heatmap diagrams, join diagrams, column family diagrams, filter diagrams, view lineage diagrams, data flow diagrams, denormalization diagrams, and workload distribution diagrams.

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式