The IMPRESS Project
The IMPRESS Project
IMProving the quality of formal
REquirementS
Specification using machine learning
techniques
`IMPRESS' was a project conducted at the
School of Computing and Mathematics at University of Huddersfield.
between 1996 and 1998, and was supported by the EPSRC, the MoD, and
the National Air Traffic Services.
It was aimed at developing and evaluating
the application
of machine learning techniques to the validation of requirements
specifications written in customised,
many-sorted first order logic.
A precise requirements model
can be viewed as an imperfect theory of the requirements domain
that needs to undergo refinement to remove bugs or to
reflect changes in the domain, and
the problem can be formulated as one
of theory revision.
To drive the research we used an
air traffic control requirements model (the `CPS') developed in a
previous project called FAROAS. The model
represents aircraft separation criteria and conflict
prediction procedures relating to airspace over the North East Atlantic,
and, inclusive of flight information, amounts to several thousand axioms.
The main results were as follows:
- the project succeeded in applying learning techniques
to the validation of the CPS requirements model.
This was accomplished using classified tests of the
major function of the CPS (i.e. conflict prediction) as
training examples. The CPS can be animated by a tool that
translates it into a clausal form, and
executes it using a Prolog interpreter.
Training examples which are mis-classified by the CPS's
animated form
were investigated with the help of
meta-interpreter technology. `Blame assignment' techniques were
used to pin-point suspect clauses, and theory revision algorithms
implemented to find revisions of the clauses.
Two major obstacles during the research were (1)
standard meta-interpreters could not cope with
general clause form theories, in particular negation in clause bodies.
We overcame this problem by designing a meta-interpreter to
expand out negative literals. This could then build
up proof trees from calls to negative as well as positive literals,
and hence produce more accurate proof trees for
analysis by the blame assignment phase.
(2) efficiency of theory revision: we overcame the combinatorial
problems inherent in theory revision using a bias that
restricts revisions to `ordinal' literals and operators.
In technical specifications such as the CPS,
axioms involving comparisons and limits often make up the
most complex conditions
and hence are most prone to error.
- the design, implementation, and testing
of integrated tools making up
an automated validation environment for a large requirements
model written in customised many-sorted logic
has been accomplished. The environment incorporates
two theory revision algorithms aimed at ordinal revision.
One is based on hill climbing and implemented using simple
ordinal revision operators.
The second implements composite, focussed operators for
inducing complex requirements. While the first
algorithm has been used successfully
to find and remove bugs in the CPS, the second has been used to
update the CPS by inducing the formalisation of new
requirements.
Personnel involved with the project included:
For further details on IMPRESS email: impress@hud.ac.uk
IMPRESS and related FAROAS Publications
M. M.West and T. L. McCluskey (2001)
The Application of Machine Learning Tools
to the Validation of An Air Traffic Control
Domain Theory
International Journal on Artificial Intelligence Tools,
Volume 10, Number 4, December 2001,
pages 613 -- 637.
See
Journal Contents Page
McCluskey, T. L.; West, M.M. (2001)
The Automated Refinement of a Requirements Domain Theory
Journal of Automated Software Enginnering, vol 8, pp 195-218,
(Special Issue on Inductive Programming), Kluwer Academic
Publishers, April 2001.
West, M.M.; McCluskey, T.L.(2000)
The Application of a Machine Learning Tool to the Validation
of an Air Traffic Control Domain Theory.
ICTAI 2000:
Proceedings of the 12th IEEE International Conference on
Tools with Artificial Intelligence, Vancouver, November 2000,
(pages 414 - 421).
McCluskey, T.L.; West, M.M. (1999)
The Automated Refinement of a Requirements Domain Theory
Final Technical Report
McCluskey, T.L.; West, M.M. (1998)
Towards the Automated Debugging and Maintenance of Logic-based
Requirements Models.
ASE '98:
Proceedings of the 13th IEEE International Conference on
Automated Software Engineering, Hawaii. IEEE Press, (pages 105-114).
McCluskey, T.L.; West, M.M. (1998)
A Case Study
in the Use of Theory Revision in Requirements Validation.
Machine Learning: Proceedings of the 15th International Conference,
Shavlik, J (Ed.) Morgan Kaufmann Publishers, (pages 368-376).
McCluskey, T.L.; West, M.M. (1998)
Ordinal Operators in Focused Theory Revision.
Proceedings: JICSLP'98 Post Conference Workshop on Computational
Logic and Machine Learning.
West, M.M.; Bryant, C.H.; T.L. McCluskey (1997)
Transforming
General Program Proofs: A Meta Interpreter which Expands Negative
Literals.
Proceedings of The
Seventh International Workshop on Logic Program Synthesis and
Transformation, Leuven, Belgium, 10-12 July 1997.
McCluskey, T.L.; Porteous, J.M.; West, M.M.; Bryant, C.H. (1996)
The Validation of Formal Specifications of Requirements.
Proceedings of the BCS-FACS
Northern Formal Methods Workshop, Ilkley, UK, September 1996, Electronic Workshops in Computing Series, Springer.
McCluskey, T.L.; Porteous, J.M.; Naik,Y.;Taylor, C. T.; Jones, S.V
A Requirements Capture Method and its use in an Air Traffic Control
Application ,
In:
The Journal of Software Practice and Experience, 25(1), January 1995
IMPRESS Technical Reports
McCluskey, T.L. (1997)
An Integrated Validation Environment for the Conflict Prediction Specification.
Technical Report impress/2/03/1,
School of Computing and Mathematics, University of Huddersfield,
UK.
West, M.M.; Bryant, C.H. (1997)
Assigning Blame to General Clausal Form Theories.
Technical Report impress/2/01/1,
School of Computing and Mathematics, University of Huddersfield,
UK.
Bryant, C.H.; West, M.M. (1996)
Deliverable 1.1: Machine Learning for IMPRESS.
Technical Report impress/1/02/1,
School of Computing and Mathematics, University of Huddersfield,
UK.
West, M.M.; Bryant, C.H. (1996)
Deliverable 2.1: Customisation of the Formal Requirements Engineering
Environment for the IMPRESS Project.
Technical Report impress/1/03/1,
School of Computing and Mathematics, University of Huddersfield,
UK.
West, M.M.; Bryant, C.H.; T.L. McCluskey; J.M. Porteous (1996)
The Use of Machine Learning in the Validation of a Formal Requirements
Specification: the Work of IMPRESS.
Technical Report impress/1/01/1,
School of Computing and Mathematics, University of Huddersfield,
UK.
Related research on AI
Planning is also being conducted in the school.
This page is maintained by
Margaret West
(Email: m.m.west@hud.ac.uk).
Last updated on September 6th 2000.