会员体验
专利管家(专利管理)
工作空间(专利管理)
风险监控(情报监控)
数据分析(专利分析)
侵权分析(诉讼无效)
联系我们
交流群
官方交流:
QQ群: 891211   
微信请扫码    >>>
现在联系顾问~
热词
    • 1. 发明授权
    • Data ETL method applied to real-time data ETL system
    • 数据ETL方法应用于实时数据ETL系统
    • US08335758B2
    • 2012-12-18
    • US12644871
    • 2009-12-22
    • Wei ChangZhigang YuShuquan LiuGuoxiang LiuPengcheng ShenQing LanGuozhen BianFeng Zhang
    • Wei ChangZhigang YuShuquan LiuGuoxiang LiuPengcheng ShenQing LanGuozhen BianFeng Zhang
    • G06F9/46G06F7/00
    • G06F17/30563
    • The data ETL (Extraction-Transformation-Loading) dispatching method of the present invention is applied to a real-time data ETL system, wherein a main ETL dispatching engine executes tasks according to preset sequence. In the execution, some key information are memorized by the main ETL dispatching engine, such as lscycle (latest successful data cycle), curcycle (current processing data cycle), and endcycle (processing end data cycle), etc., and are transferred to called programs. After the execution of the called programs, the main ETL dispatching engine records and keeps the updated dispatching information. In the data re-extraction, the data ETL dispatching method is adopted for the automatic re-extraction of some tasks and some cycles therein. The data ETL dispatching method, solves the problem caused by cyclic closed-loop extraction in traditional ETL dispatching programs according to timestamps in the real-time data ETL system, simplifies the tasks of the called program by allowing the called programs to focus on its own business logic, thereby giving sufficient development time for the real-time data ETL field, resulting in greatly enhancing the efficiency of project implementation.
    • 本发明的数据ETL(提取 - 转换 - 加载)调度方法应用于实时数据ETL系统,其中主ETL调度引擎根据预设顺序执行任务。 在执行中,主要的ETL调度引擎记录了一些关键信息,如lscycle(最新成功数据周期),curcycle(当前处理数据周期)和endcycle(处理结束数据周期)等,并转移到 称为程序。 执行被调用程序后,主ETL调度引擎记录并保存更新的调度信息。 在数据重新提取中,采用数据ETL调度方式自动重新提取一些任务及其中的一些周期。 数据ETL调度方法根据实时数据ETL系统中的时间戳解决了传统ETL调度程序中循环闭环提取引起的问题,简化了被调用程序的任务,允许被调用的程序集中在自己的 业务逻辑,从而为实时数据ETL领域提供充足的开发时间,大大提高了项目实施的效率。