Research output

Article in Journal ()

Structure Discovery in Mixed Order Hyper Networks

Citation
Swingler K (2016) Structure Discovery in Mixed Order Hyper Networks, Big Data Analytics, 1 (1), Art. No.: 8.

Abstract
Background 

Mixed Order Hyper Networks (MOHNs) are a type of neural network in which the interactions between inputs are modelled explicitly by weights that can connect any number of neurons. Such networks have a human readability that networks with hidden units lack. They can be used for regression, classification or as content addressable memories and have been shown to be useful as fitness function models in constraint satisfaction tasks. They are fast to train and, when their structure is fixed, do not suffer from local minima in the cost function during training. However, their main drawback is that the correct structure (which neurons to connect with weights) must be discovered from data and an exhaustive search is not possible for networks of over around 30 inputs. 
Results 
This paper presents an algorithm designed to discover a set of weights that satisfy the joint constraints of low training error and a parsimonious model. The combined structure discovery and weight learning process was found to be faster, more accurate and have less variance than training an MLP. 
Conclusions 
There are a number of advantages to using higher order weights rather than hidden units in a neural network but discovering the correct structure for those weights can be challenging. With the method proposed in this paper, the use of high order networks becomes tractable.

Keywords
High order neural networks; Structure discovery; Linkage learning

StatusPublished
AuthorsSwingler Kevin
Publication date01/10/2016
Publication date online01/10/2016
Date accepted by journal14/09/2016
PublisherBioMed Central
ISSN 2058-6345
LanguageEnglish

Journal
big Data Analytics: Volume 1, Issue 1

© University of Stirling FK9 4LA Scotland UK • Telephone +44 1786 473171 • Scottish Charity No SC011159
My Portal