ABSTRACT

Hybrid Models in Machine Learning

Christophe Giraud-Carrier, University of Bristol

Historically, research in machine learning has followed two separate schools of thought. On the one hand, we find those concerned with biological plausibility who have focused their efforts on the design of connectionist systems, whose underlying architecture is intended to reflect that of natural systems (e.g., the human brain). On the other hand, we find those who are interested only in psychological plausibility and thus design learning systems, symbolic for the most part, with no direct natural counterparts.

Experience has shown that both types of systems have complementary strengths and weaknesses. In particular, connectionist models (e.g., neural networks) are generally massively parallel (and thus efficient) but opaque, whilst symbolic models (e.g., decision trees) are often slower but more comprehensible. As a result of this synergy, many researchers have turned their attention to the design of hybrid connectionist-symbolic systems, as well as other forms of hybridisation (e.g., genetic algorithms and neural netowrks).

In this talk, I will review a small sample of hybrid systems we have developed in the past few years. These are chosen to show some of the benefits of hybridisation. In particular, I will present two types of connectionist/symbolic models, one motivated by efficiency and the other by anatomy. As an exemplar of the first class, I will use AA1*, a constructive, incremental learning algorithm for binary classification. As an exemplar of the second class, I will use BRAINN, a symbolic reasoning system implemented on a Hopfield network architecture based on the human cortex. In addition, I will briefly mention other forms of hybridisation, including GA-RBF, a system using a genetic algorithm to design the hidden layer of an RBF network prior to its training and FLARE, a learning algorithm that integrates lazy and eager learning.


Computer Science Home Page
Maintained by rbennett@cs.ucl.ac.uk