专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明授权

US08335758B2 Data ETL method applied to real-time data ETL system 有权
标题翻译：数据ETL方法应用于实时数据ETL系统
公开(公告)号：US08335758B2
公开(公告)日：2012-12-18
申请号：US12644871
申请日：2009-12-22
申请人： Wei Chang , Zhigang Yu , Shuquan Liu , Guoxiang Liu , Pengcheng Shen , Qing Lan , Guozhen Bian , Feng Zhang
发明人： Wei Chang , Zhigang Yu , Shuquan Liu , Guoxiang Liu , Pengcheng Shen , Qing Lan , Guozhen Bian , Feng Zhang
IPC分类号： G06F9/46 , G06F7/00
CPC分类号： G06F17/30563
摘要： The data ETL (Extraction-Transformation-Loading) dispatching method of the present invention is applied to a real-time data ETL system, wherein a main ETL dispatching engine executes tasks according to preset sequence. In the execution, some key information are memorized by the main ETL dispatching engine, such as lscycle (latest successful data cycle), curcycle (current processing data cycle), and endcycle (processing end data cycle), etc., and are transferred to called programs. After the execution of the called programs, the main ETL dispatching engine records and keeps the updated dispatching information. In the data re-extraction, the data ETL dispatching method is adopted for the automatic re-extraction of some tasks and some cycles therein. The data ETL dispatching method, solves the problem caused by cyclic closed-loop extraction in traditional ETL dispatching programs according to timestamps in the real-time data ETL system, simplifies the tasks of the called program by allowing the called programs to focus on its own business logic, thereby giving sufficient development time for the real-time data ETL field, resulting in greatly enhancing the efficiency of project implementation.
摘要翻译：本发明的数据ETL（提取 - 转换 - 加载）调度方法应用于实时数据ETL系统，其中主ETL调度引擎根据预设顺序执行任务。在执行中，主要的ETL调度引擎记录了一些关键信息，如lscycle（最新成功数据周期），curcycle（当前处理数据周期）和endcycle（处理结束数据周期）等，并转移到称为程序。执行被调用程序后，主ETL调度引擎记录并保存更新的调度信息。在数据重新提取中，采用数据ETL调度方式自动重新提取一些任务及其中的一些周期。数据ETL调度方法根据实时数据ETL系统中的时间戳解决了传统ETL调度程序中循环闭环提取引起的问题，简化了被调用程序的任务，允许被调用的程序集中在自己的业务逻辑，从而为实时数据ETL领域提供充足的开发时间，大大提高了项目实施的效率。

IPRDB

热门服务

关于我们

友情链接

联系方式