Distinguished Dissertations

Strength or Accuracy: Credit Assignment in Learning Classifier Systems

Authors: Kovacs, Tim

Buy this book

eBook $149.00
price for USA (gross)
  • ISBN 978-0-85729-416-6
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $199.00
price for USA
  • ISBN 978-1-85233-770-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $199.00
price for USA
  • ISBN 978-1-4471-1058-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
About this book

Classifier systems are an intriguing approach to a broad range of machine learning problems, based on automated generation and evaluation of condi­ tion/action rules. Inreinforcement learning tasks they simultaneously address the two major problems of learning a policy and generalising over it (and re­ lated objects, such as value functions). Despite over 20 years of research, however, classifier systems have met with mixed success, for reasons which were often unclear. Finally, in 1995 Stewart Wilson claimed a long-awaited breakthrough with his XCS system, which differs from earlier classifier sys­ tems in a number of respects, the most significant of which is the way in which it calculates the value of rules for use by the rule generation system. Specifically, XCS (like most classifiersystems) employs a genetic algorithm for rule generation, and the way in whichit calculates rule fitness differsfrom earlier systems. Wilson described XCS as an accuracy-based classifiersystem and earlier systems as strength-based. The two differin that in strength-based systems the fitness of a rule is proportional to the return (reward/payoff) it receives, whereas in XCS it is a function of the accuracy with which return is predicted. The difference is thus one of credit assignment, that is, of how a rule's contribution to the system's performance is estimated. XCS is a Q­ learning system; in fact, it is a proper generalisation of tabular Q-learning, in which rules aggregate states and actions. In XCS, as in other Q-learners, Q-valuesare used to weightaction selection.

Reviews

From the reviews:

"This book is a monograph on learning classifier systems … . The main objective of the book is to compare strength-based classifier systems with accuracy-based systems. … The book is equipped with nine appendices. … The biggest advantage of the book is its readability. The book is well written and is illustrated with many convincing examples." (Jerzy W. Grzymal-Busse, Mathematical Reviews, Issue 2005 k)


Table of contents (7 chapters)

Buy this book

eBook $149.00
price for USA (gross)
  • ISBN 978-0-85729-416-6
  • Digitally watermarked, DRM-free
  • Included format: PDF
  • ebooks can be used on all reading devices
  • Immediate eBook download after purchase
Hardcover $199.00
price for USA
  • ISBN 978-1-85233-770-4
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Softcover $199.00
price for USA
  • ISBN 978-1-4471-1058-3
  • Free shipping for individuals worldwide
  • Usually dispatched within 3 to 5 business days.
Loading...

Recommended for you

Loading...

Bibliographic Information

Bibliographic Information
Book Title
Strength or Accuracy: Credit Assignment in Learning Classifier Systems
Authors
Series Title
Distinguished Dissertations
Copyright
2004
Publisher
Springer-Verlag London
Copyright Holder
Springer-Verlag London
eBook ISBN
978-0-85729-416-6
DOI
10.1007/978-0-85729-416-6
Hardcover ISBN
978-1-85233-770-4
Softcover ISBN
978-1-4471-1058-3
Edition Number
1
Number of Pages
XVI, 307
Topics