In data integration, entity resolution is an important technique to improve data quality. Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric. For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques. In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics. In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood. We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project. We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision. Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets.
from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/2Gq3pCS
via IFTTT
Εγγραφή σε:
Σχόλια ανάρτησης (Atom)
Δημοφιλείς αναρτήσεις
-
Publication date: Available online 4 January 2018 Source: European Journal of Radiology Author(s): Peiyao Zhang, Jing Wang, Qin Xu, Zhen...
-
Medicine by Alexandros G. Sfakianakis,Anapafseos 5 Agios Nikolaos 72100 Crete Greece,00302841026182, Butyric Acid from Probiotic Staphyloco...
-
Does CBD Oil Lower Blood Pressure? This article was originally published at SundayScaries." Madeline Taylor POSTED ON January 13, 20...
-
Medicine by Alexandros G. Sfakianakis,Αλέξανδρος Γ. Σφακιανάκης A Novel Technique for Endoscopic Repair of Large Anterior Skull Base Defect...
-
2016-11-22T07-55-59Z Source: International Journal of Medical Science and Public Health Banothu Srinivas, Madhu Mohan Reddy B. Backgrou...
-
2016-10-15T06-30-01Z Source: The Southeast Asian Journal of Case Report and Review Sangita Deepak Kamath, Neeraj Jain, Saurabh Pathak, Ba...
-
BACKGROUND AND PURPOSE: Lesion load is a common biomarker in multiple sclerosis, yet it has historically shown modest association with cl...
-
Abstract The development of focused ion beam-scanning electron microscopy (FIB-SEM) techniques has allowed high-resolution 3D imaging of n...
-
Vol.48 No.2 from #AlexandrosSfakianakis via Alexandros G.Sfakianakis on Inoreader http://ift.tt/1S2Z7n2 via IFTTT
Δεν υπάρχουν σχόλια:
Δημοσίευση σχολίου