专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明授权

US09213584B2 Varying a characteristic of a job profile relating to map and reduce tasks according to a data size 有权
标题翻译：根据数据大小改变与地图和减少任务相关的作业简档的特征
公开(公告)号：US09213584B2
公开(公告)日：2015-12-15
申请号：US14110398
申请日：2011-05-11
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F9/46 , G06F9/50 , G06Q10/06 , G06Q10/10
CPC分类号： G06F9/5083 , G06F9/505 , G06F9/5066 , G06F2209/5017 , G06Q10/06315 , G06Q10/10
摘要： A job profile is received that includes characteristics of a job to be executed, where the characteristics of the job profile relate to map tasks and reduce tasks of the job. The map tasks produce intermediate results based on input data, and the reduce tasks produce an output based on the intermediate results. The characteristics of the job profile include at least one particular characteristic that varies according to a size of data to be processed. The at least one particular characteristic of the job profile is set based on the size of the data to be processed.
摘要翻译：接收到包括要执行的作业的特征的作业简档，其中作业简档的特征与映射任务相关并且减少作业的任务。地图任务基于输入数据产生中间结果，而减少任务根据中间结果产生输出。作业简档的特征包括根据要处理的数据的大小而变化的至少一个特定特征。基于要处理的数据的大小来设置作业简档的至少一个特定特征。

2. 发明申请

US20130339972A1 DETERMINING AN ALLOCATION OF RESOURCES TO A PROGRAM HAVING CONCURRENT JOBS 审中-公开
标题翻译：确定资源分配给具有相关职位的计划
公开(公告)号：US20130339972A1
公开(公告)日：2013-12-19
申请号：US13525820
申请日：2012-06-18
申请人： Zhuoyao Zhang , Abhishek Verma , Ludmila Cherkasova
发明人： Zhuoyao Zhang , Abhishek Verma , Ludmila Cherkasova
IPC分类号： G06F9/50
CPC分类号： G06F9/5066 , G06F9/50 , G06F11/3404 , G06F11/3447 , G06F2201/88 , G06F2209/501 , G06Q10/0639
摘要： A performance model for a collection of jobs that make up a program is used to calculate a performance parameter based on a number of map tasks in the jobs, a number of reduce tasks in the jobs, and an allocation of resources, where the jobs include the map tasks and the reduce tasks, the map tasks producing intermediate results based on segments of input data, and the reduce tasks producing an output based on the intermediate results. The performance model considers overlap of concurrent jobs. Using a value of the performance parameter calculated by the performance model, a particular allocation of resources is determined to assign to the jobs of the program to meet a performance goal of the program.
摘要翻译：用于构成程序的作业集合的性能模型用于根据作业中的多个地图任务，作业中的多个减少任务以及作业所在的资源分配来计算性能参数地图任务和减少任务，基于输入数据段生成中间结果的地图任务，以及基于中间结果生成输出的减少任务。性能模型考虑并发作业的重叠。使用由性能模型计算的性能参数的值，确定资源的特定分配以分配给程序的作业以满足程序的性能目标。

3. 发明申请

US20130318538A1 ESTIMATING A PERFORMANCE CHARACTERISTIC OF A JOB USING A PERFORMANCE MODEL 审中-公开
标题翻译：使用性能模型估计作业的性能特征
公开(公告)号：US20130318538A1
公开(公告)日：2013-11-28
申请号：US13982732
申请日：2011-02-02
申请人： Abhishek Verma , Ludmila Cherkasova
发明人： Abhishek Verma , Ludmila Cherkasova
IPC分类号： G06F9/50
CPC分类号： G06F9/50 , G06F11/3419 , G06F11/3442 , G06F11/3447 , G06F2201/865
摘要： A job profile is received (302) that describes a job to be executed. A performance model is produced (304) based on the job profile and allocated amount of resources for the job, and a performance characteristic of the job is estimated (306) using the performance model.
摘要翻译：接收作业简档（302），描述要执行的作业。基于作业简档和作业的分配资源量生成（304）性能模型，并且使用性能模型来估计作业的性能特征（306）。

4. 发明申请

US20130290972A1 WORKLOAD MANAGER FOR MAPREDUCE ENVIRONMENTS 审中-公开
标题翻译： MAPREDUCE环境工作负责经理
公开(公告)号：US20130290972A1
公开(公告)日：2013-10-31
申请号：US13458069
申请日：2012-04-27
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F9/50
CPC分类号： G06F9/5066 , G06F9/5083
摘要： A method of managing workloads in MapReduce environments with a system. The system receives job profiles of respective jobs, wherein each job profile describes characteristics of map and reduce tasks. The map tasks produce intermediate results based on the input data, and the reduce tasks produce an output based on the intermediate results. The jobs are ordered according to performance goals into a hierarchy. A minimum quantity of resources is allocated to each job to achieve its performance goal. A plurality of spare resources are allocated to at least one of the jobs. A new job profile having a new performance goal is then received. Next, it is determined whether the new performance goal can be met without deallocating spare resources. Spare resources are re-allocated form the other jobs to the new job to achieve its performance goal without compromising the performance goals of the other jobs.
摘要翻译：使用系统管理MapReduce环境中的工作负载的方法。系统接收各个作业的作业简档，其中每个作业简档描述地图的特征并减少任务。地图任务基于输入数据产生中间结果，并且减少任务基于中间结果产生输出。根据绩效目标将作业排序到层次结构中。为每个工作分配最少的资源以实现其绩效目标。多个备用资源被分配给至少一个作业。然后接收到具有新性能目标的新工作简档。接下来，确定在不重新分配备用资源的情况下是否可以满足新的性能目标。将其他工作的备用资源重新分配给新工作，以达到其绩效目标，而不会影响其他工作的绩效目标。

5. 发明申请

US20130167151A1 JOB SCHEDULING BASED ON MAP STAGE AND REDUCE STAGE DURATION 有权
标题翻译：基于地图阶段和减少阶段工作的工作时间表
公开(公告)号：US20130167151A1
公开(公告)日：2013-06-27
申请号：US13335847
申请日：2011-12-22
申请人： Abhishek VERMA , Ludmila Cherkasova , Vijay S. Kumar
发明人： Abhishek VERMA , Ludmila Cherkasova , Vijay S. Kumar
IPC分类号： G06F9/46
CPC分类号： G06F9/5066
摘要： A plurality of job profiles is received. Each job profile describes a job to be executed, and each job includes map tasks and reduce tasks. An execution duration for a map stage including the map tasks and an execution duration for a reduce stage including the reduce tasks of each job is estimated. The jobs are scheduled for execution based on the estimated execution duration of the map stage and the estimated execution duration of the reduce stage of each job.
摘要翻译：接收多个作业简档。每个作业配置文件描述要执行的作业，并且每个作业都包括映射任务并减少任务。估计包括地图任务的地图阶段的执行持续时间和包括每个作业的减少任务的减少阶段的执行持续时间。基于地图阶段的估计执行持续时间和每个作业的减少阶段的估计执行持续时间，这些作业被安排执行。

6. 发明授权

US08799916B2 Determining an allocation of resources for a job 有权
标题翻译：确定作业的资源分配
公开(公告)号：US08799916B2
公开(公告)日：2014-08-05
申请号：US13019529
申请日：2011-02-02
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F9/46
CPC分类号： G06F9/5066
摘要： A job profile describes characteristics of a job. A performance parameter is calculated based on the job profile, and using a value of the performance parameter, an allocation of resources is determined to assign to the job to meet a performance goal associated with a job.
摘要翻译：作业简介描述了作业的特征。基于作业简档计算性能参数，并且使用性能参数的值，确定资源分配以分配给作业以满足与作业相关联的性能目标。

7. 发明申请

US20130290976A1 SCHEDULING MAPREDUCE JOB SETS 有权
标题翻译：调度映射作业集
公开(公告)号：US20130290976A1
公开(公告)日：2013-10-31
申请号：US13460687
申请日：2012-04-30
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F9/50 , G06F9/46
CPC分类号： G06F9/5038 , G06F2209/5017
摘要： Determining a schedule of a batch workload of MapReduce jobs is disclosed. A set of multi-stage jobs for processing in a MapReduce framework is received, for example, in a master node. Each multi-stage job includes a duration attribute, and each duration attribute includes a stage duration and a stage type. The MapReduce framework is separated into a plurality of resource pools. The multi-stage jobs are separated into a plurality of subgroups corresponding with the plurality of pools. Each subgroup is configured for concurrent processing in the MapReduce framework. The multi-stage jobs in each of the plurality of subgroups are placed in an order according to increasing stage duration. For each pool, the multi-stage jobs in increasing order of stage duration are sequentially assigned from either a front of the schedule or a tail of the schedule by stage type.
摘要翻译：公布了确定MapReduce作业的批处理工作量的时间表。例如，在主节点中接收一组用于在MapReduce框架中处理的多阶段作业。每个多级作业包括持续时间属性，并且每个持续时间属性包括阶段持续时间和阶段类型。 MapReduce框架分为多个资源池。多级作业被分成与多个池对应的多个子组。每个子组都配置为在MapReduce框架中进行并发处理。多个子组中的每个子组中的多阶段作业按照阶段持续时间的增加顺序放置。对于每个池，阶段持续时间的递增顺序的多阶段作业从时间表的前面或按阶段类型的时间表的尾部顺序分配。

8. 发明授权

US09141430B2 Scheduling mapreduce job sets 有权
标题翻译：计划mapreduce工作集
公开(公告)号：US09141430B2
公开(公告)日：2015-09-22
申请号：US13460687
申请日：2012-04-30
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F9/46 , G06F9/50
CPC分类号： G06F9/5038 , G06F2209/5017
摘要： Determining a schedule of a batch workload of MapReduce jobs is disclosed. A set of multi-stage jobs for processing in a MapReduce framework is received, for example, in a master node. Each multi-stage job includes a duration attribute, and each duration attribute includes a stage duration and a stage type. The MapReduce framework is separated into a plurality of resource pools. The multi-stage jobs are separated into a plurality of subgroups corresponding with the plurality of pools. Each subgroup is configured for concurrent processing in the MapReduce framework. The multi-stage jobs in each of the plurality of subgroups are placed in an order according to increasing stage duration. For each pool, the multi-stage jobs in increasing order of stage duration are sequentially assigned from either a front of the schedule or a tail of the schedule by stage type.
摘要翻译：公布了确定MapReduce作业的批处理工作量的时间表。例如，在主节点中接收一组用于在MapReduce框架中处理的多阶段作业。每个多级作业包括持续时间属性，并且每个持续时间属性包括阶段持续时间和阶段类型。 MapReduce框架分为多个资源池。多级作业被分成与多个池对应的多个子组。每个子组都配置为在MapReduce框架中进行并发处理。多个子组中的每个子组中的多阶段作业按照阶段持续时间的增加顺序放置。对于每个池，阶段持续时间的递增顺序的多阶段作业从时间表的前面或按阶段类型的时间表的尾部顺序分配。

9. 发明授权

US08732720B2 Job scheduling based on map stage and reduce stage duration 有权
标题翻译：基于地图阶段的作业调度和减少阶段持续时间
公开(公告)号：US08732720B2
公开(公告)日：2014-05-20
申请号：US13335847
申请日：2011-12-22
申请人： Abhishek Verma , Ludmila Cherkasova , Vijay S. Kumar
发明人： Abhishek Verma , Ludmila Cherkasova , Vijay S. Kumar
IPC分类号： G06F9/46 , G06F7/00
CPC分类号： G06F9/5066
摘要： A plurality of job profiles is received. Each job profile describes a job to be executed, and each job includes map tasks and reduce tasks. An execution duration for a map stage including the map tasks and an execution duration for a reduce stage including the reduce tasks of each job is estimated. The jobs are scheduled for execution based on the estimated execution duration of the map stage and the estimated execution duration of the reduce stage of each job.
摘要翻译：接收多个作业简档。每个作业配置文件描述要执行的作业，并且每个作业都包括映射任务并减少任务。估计包括地图任务的地图阶段的执行持续时间和包括每个作业的减少任务的减少阶段的执行持续时间。基于地图阶段的估计执行持续时间和每个作业的减少阶段的估计执行持续时间，这些作业被安排执行。

10. 发明申请

US20140089727A1 ESTIMATING A PERFORMANCE PARAMETER OF A JOB HAVING MAP AND REDUCE TASKS AFTER A FAILURE 有权
标题翻译：评估失败后的地图和减少任务的工作性能参数
公开(公告)号：US20140089727A1
公开(公告)日：2014-03-27
申请号：US14118520
申请日：2011-05-31
申请人： Ludmila Cherkasova , Abhishek Verma
发明人： Ludmila Cherkasova , Abhishek Verma
IPC分类号： G06F11/07
CPC分类号： G06F11/0715 , G06F11/2041 , G06F11/3404 , G06F11/3419 , G06F11/3433 , G06F11/3447 , G06F2201/865
摘要： A job profile includes characteristics of a job to be executed, where the characteristics of the job profile relate to map tasks and reduce tasks of the job, and where the map tasks produce intermediate results based on input data, and the reduce tasks produce an output based on the intermediate results. In response to a failure in a system, numbers of failed map tasks and reduce tasks of the job based on a time of the failure are computed, and numbers of remaining map tasks and reduce tasks are computed. A performance model is provided, and a performance parameter of the job is estimated using the performance model.
摘要翻译：作业简档包括要执行的作业的特征，其中作业简档的特征与映射任务相关，并减少作业的任务，以及映射任务基于输入数据产生中间结果的位置，并且减少任务产生输出基于中间结果。为了响应系统故障，计算失败地图任务的数量并基于故障时间减少作业的任务，并计算剩余的地图任务和减少任务的数量。提供性能模型，并使用性能模型估计作业的性能参数。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式