A Novel Discriminative Naive Bayesian Network for Classification

A Novel Discriminative Naive Bayesian Network for Classification

Kaizhu Huang (Fujitsu Research and Development Centre Co. Ltd., China), Zenglin Xu (Chinese University of Hong Kong Shatin, Hong Kong), Irwin King (Chinese University of Hong Kong Shatin, Hong Kong), Michael R. Lyu (Chinese University of Hong Kong Shatin, Hong Kong) and Zhangbing Zhou (Zhou, Bell-Labs, Lucent Technologies, China)
Copyright: © 2007 |Pages: 12
DOI: 10.4018/978-1-59904-141-4.ch001
OnDemand PDF Download:


Naive Bayesian network (NB) is a simple yet powerful Bayesian network. Even with a strong independency assumption among the features, it demonstrates competitive performance against other state-of-the-art classifiers, such as support vector machines (SVM). In this chapter, we propose a novel discriminative training approach originated from SVM for deriving the parameters of NB. This new model, called discriminative naive Bayesian network (DNB), combines both merits of discriminative methods (e.g., SVM) and Bayesian networks. We provide theoretic justifications, outline the algorithm, and perform a series of experiments on benchmark real-world datasets to demonstrate our model’s advantages. Its performance outperforms NB in classification tasks and outperforms SVM in handling missing information tasks.

Complete Chapter List

Search this Book:
Table of Contents
K. R. Rao
Chapter 1
Kaizhu Huang, Zenglin Xu, Irwin King, Michael R. Lyu, Zhangbing Zhou
Naive Bayesian network (NB) is a simple yet powerful Bayesian network. Even with a strong independency assumption among the features, it... Sample PDF
A Novel Discriminative Naive Bayesian Network for Classification
Chapter 2
Ben K. Daniel, Juan-Diego Zapata-Rivera, Gordon I. McCalla
Bayesian belief networks (BBNs) are increasingly used for understanding and simulating computational models in many domains. Though BBN techniques... Sample PDF
A Bayesian Belief Network Approach for Modeling Complex Domains
Chapter 3
Sachin Shetty, Min Song, Mansoor Alam
A Bayesian network model is a popular formalism for data mining due to its intuitive interpretation. This chapter presents a semantic genetic... Sample PDF
Data Mining of Bayesian Network Structure Using a Semantic Genetic Algorithm-Based Approach
Chapter 4
Dimitris Margaritis, Christos Faloutsos, Sebastian Thrun
We present a novel method for answering count queries from a large database approximately and quickly. Our method implements an approximate DataCube... Sample PDF
NetCube: Fast, Approximate Database Queries Using Bayesian Networks
Chapter 5
Helge Langseth, Luigi Portinale
Over the last decade, Bayesian networks (BNs) have become a popular tool for modeling many kinds of statistical problems. In this chapter we will... Sample PDF
Applications of Bayesian Networks in Reliability Analysis
Chapter 6
Sumeet Gupta, Hee-Wong Kim
This chapter deals with the application of Bayesian modeling as a management decision support tool for management information systems (MIS)... Sample PDF
Application of Bayesian Modeling to Management Information Systems: A Latent Scores Approach
Chapter 7
Andreas Savaki, Jiebo Luo, Michael Kane
Image understanding deals with extracting and interpreting scene content for use in various applications. In this chapter, we illustrate that... Sample PDF
Bayesian Networks for Image Understanding
Chapter 8
Pedro M. Jorge, Arnaldo J. Abrantes, João M. Lemos, Jorge S. Marques
This chapter describes an algorithm for tracking groups of pedestrians in video sequences. The main difficulties addressed in this work concern... Sample PDF
Long Term Tracking of Pedestrians with Groups and Occlusions
Chapter 9
Qian Diao, Jianye Lu, Wei Hu, Yimin Zhang, Gary Bradski
In a visual tracking task, the object may exhibit rich dynamic behavior in complex environments that can corrupt target observations via background... Sample PDF
DBN Models for Visual Tracking and Prediction
Chapter 10
David Lo
In applications where the locations of human subjects are needed, for example, human-computer interface, video conferencing, and security... Sample PDF
Multimodal Human Localization Using Bayesian Network Sensor Fusion
Chapter 11
C. Notarnicola
This chapter introduces the use of Bayesian methodology for inversion purposes: the extraction of bio-geophysical parameters from remotely sensed... Sample PDF
Retrieval of Bio-Geophysical Parameters from Remotely Sensing Data by Using Bayesian Methodology
Chapter 12
Arunkumar Chinnasamy, Sudhanshu Patwardhan, Wing-Kin Sung
The end of the 20th century and the advent of the new millennium have brought in a true merger of sciences for the benefit of mankind. The biggest... Sample PDF
Application of Bayesian Network in Drug Discovery and Development Process
Chapter 13
Seiya Imoto, Satoru Miyano
In cells, genes interact with each other and this system can be viewed as directed graphs. A gene network is a graphical representation of... Sample PDF
Bayesian Network Approach to Estimate Gene Networks
Chapter 14
Vipin Narang, Rajesh Chowdhary, Ankush Mittal, Wing-Kin Sung
A predicament that engineers who wish to employ Bayesian networks to solve practical problems often face is the depth of study required in order to... Sample PDF
Bayesian Network Modeling of Transcription Factor Binding Sites: A Tutorial
Chapter 15
Tie-Fei Liu, Wing-Kin Sung, Ankush Mittal
Exact determination of a gene network is required to discover the higher-order structures of an organism and to interpret its behavior. Currently... Sample PDF
Application of Bayesian Network in Learning Gene Network
About the Authors