会员体验
专利管家(专利管理)
工作空间(专利管理)
风险监控(情报监控)
数据分析(专利分析)
侵权分析(诉讼无效)
联系我们
交流群
官方交流:
QQ群: 891211   
微信请扫码    >>>
现在联系顾问~
热词
    • 9. 发明专利
    • REAL-TIME DATA DEDUPLICATION COUNTING METHOD AND DEVICE
    • CA3152844A1
    • 2021-03-04
    • CA3152844
    • 2020-06-24
    • CANADA LTD 10353744
    • WANG KAIZHANG PANPANHAN ZHENXULI CHENGSUN QIAN
    • G06F16/2455
    • A real-time data deduplication counting method and device. The accurate calculation of a measure deduplication counting value of real-time data can be realized, and a small memory space is occupied in a deduplication process. The method comprises: acquiring real-time data and counting information, wherein the counting information comprises dimension information, dimension combination information and measure information (S10); obtaining a one-dimensional dimension combination of the real-time data according to the dimension information, the dimension combination information and the measure information, and generating a duplication determination key (S20); performing Redis batch duplication determination on the duplication determination key by means of a distributed lock mechanism to obtain a deduplication counting result of the real-time data (S30); and storing the deduplication counting result in a database (S40). According to the method, the uniqueness of a measure field of real-time data under each dimension combination can be guaranteed, and an accurate deduplication counting value of the real-time data can be obtained through duplication determination. Only the duplication determination key of a one-dimensional dimension combination needs to be stored for duplication determination, a large number of memory resources are released, the length of the duplication determination key is fixed, and the Redis memory usage amount can be estimated.