Mining Imperfect Data
This book thoroughly discusses the varying problems that occur in data mining, including their sources, consequences, detection, and treatment. Specific strategies for data pretreatment and analytical validation that are broadly applicable are described, making them useful in conjunction with most data mining analysis methods. Examples illustrate the performance of the pretreatment and validation methods in a variety of situations. The book, which deals with a wider range of data anomalies than are usually treated, includes a discussion of detecting anomalies through generalized sensitivity analysis (GSA), a process of identifying inconsistencies using systematic and extensive comparisons of results obtained by analysis of exchangeable datasets or subsets. Real data is made extensive use of, both in the form of a detailed analysis of a few real datasets and various published examples. A succinct introduction to functional equations illustrates their utility in describing various forms of qualitative behavior for useful data characterizations.
- Suitable for industrial and academic researchers
- Enables readers to develop strategies and tactics for dealing with a number of critically important data imperfections that must be addressed before obtaining useful analysis results from large databases
- Examples are presented to illustrate the performance of the pretreatment and validation methods in a variety of situations
Reviews & endorsements
'An accessible presentation of statistical methods and analysis to deal with imperfect data in real data mining applications.' Joydeep Ghosh, University of Texas at Austin
'An appealing feature of this book is the use of fresh datasets that are much larger than those currently found in standard books on outliers and statistical diagnostics.' Anthony Atkinson, London School of Economics
'The book provides the reader with clear descriptions and accessible discussions of problems, motivations, methods and interpretations. The author excels when describing the importance of tools and their applications. The first chapter is a prime example of how to introduce important concepts and methods to a wide readership that may be composed of students, researchers and non-specialists.' Francisco J. Azuaje, BioMedical Engineering OnLine
Product details
April 2005Paperback
9780898715828
184 pages
255 × 178 × 16 mm
0.554kg
This item is not supplied by Cambridge University Press in your region. Please contact Soc for Industrial & Applied Mathematics for availability.
Table of Contents
- Preface
- 1. Introduction
- 2. Imperfect datasets
- 3. Univariate outlier detection
- 4. Data pretreatment
- 5. What is a 'good' data characterization?
- 6. Generalized sensitivity analysis
- 7. Sampling schemes for a fixed dataset
- 8. Concluding remarks and open questions
- Bibliography
- Index.