The IMPRESS Project

The IMPRESS Project

IMProving the quality of formal REquirementS Specification using machine learning techniques

`IMPRESS' was a project conducted at the School of Computing and Mathematics at University of Huddersfield. between 1996 and 1998, and was supported by the EPSRC, the MoD, and the National Air Traffic Services. It was aimed at developing and evaluating the application of machine learning techniques to the validation of requirements specifications written in customised, many-sorted first order logic. A precise requirements model can be viewed as an imperfect theory of the requirements domain that needs to undergo refinement to remove bugs or to reflect changes in the domain, and the problem can be formulated as one of theory revision. To drive the research we used an air traffic control requirements model (the `CPS') developed in a previous project called FAROAS. The model represents aircraft separation criteria and conflict prediction procedures relating to airspace over the North East Atlantic, and, inclusive of flight information, amounts to several thousand axioms.

The main results were as follows:

- the project succeeded in applying learning techniques to the validation of the CPS requirements model. This was accomplished using classified tests of the major function of the CPS (i.e. conflict prediction) as training examples. The CPS can be animated by a tool that translates it into a clausal form, and executes it using a Prolog interpreter. Training examples which are mis-classified by the CPS's animated form were investigated with the help of meta-interpreter technology. `Blame assignment' techniques were used to pin-point suspect clauses, and theory revision algorithms implemented to find revisions of the clauses. Two major obstacles during the research were (1) standard meta-interpreters could not cope with general clause form theories, in particular negation in clause bodies. We overcame this problem by designing a meta-interpreter to expand out negative literals. This could then build up proof trees from calls to negative as well as positive literals, and hence produce more accurate proof trees for analysis by the blame assignment phase. (2) efficiency of theory revision: we overcame the combinatorial problems inherent in theory revision using a bias that restricts revisions to `ordinal' literals and operators. In technical specifications such as the CPS, axioms involving comparisons and limits often make up the most complex conditions and hence are most prone to error.

- the design, implementation, and testing of integrated tools making up an automated validation environment for a large requirements model written in customised many-sorted logic has been accomplished. The environment incorporates two theory revision algorithms aimed at ordinal revision. One is based on hill climbing and implemented using simple ordinal revision operators. The second implements composite, focussed operators for inducing complex requirements. While the first algorithm has been used successfully to find and remove bugs in the CPS, the second has been used to update the CPS by inducing the formalisation of new requirements.

Personnel involved with the project included:

For further details on IMPRESS email: impress@hud.ac.uk

IMPRESS and related FAROAS Publications

  • M. M.West and T. L. McCluskey (2001)
    The Application of Machine Learning Tools to the Validation of An Air Traffic Control Domain Theory
    International Journal on Artificial Intelligence Tools, Volume 10, Number 4, December 2001, pages 613 -- 637.
    See Journal Contents Page
  • McCluskey, T. L.; West, M.M. (2001)
    The Automated Refinement of a Requirements Domain Theory
    Journal of Automated Software Enginnering, vol 8, pp 195-218, (Special Issue on Inductive Programming), Kluwer Academic Publishers, April 2001.
  • West, M.M.; McCluskey, T.L.(2000)
    The Application of a Machine Learning Tool to the Validation of an Air Traffic Control Domain Theory.
    ICTAI 2000: Proceedings of the 12th IEEE International Conference on Tools with Artificial Intelligence, Vancouver, November 2000, (pages 414 - 421).
  • McCluskey, T.L.; West, M.M. (1999)
    The Automated Refinement of a Requirements Domain Theory
    Final Technical Report
  • McCluskey, T.L.; West, M.M. (1998)
    Towards the Automated Debugging and Maintenance of Logic-based Requirements Models.
    ASE '98: Proceedings of the 13th IEEE International Conference on Automated Software Engineering, Hawaii. IEEE Press, (pages 105-114).
  • McCluskey, T.L.; West, M.M. (1998)
    A Case Study in the Use of Theory Revision in Requirements Validation.
    Machine Learning: Proceedings of the 15th International Conference, Shavlik, J (Ed.) Morgan Kaufmann Publishers, (pages 368-376).
  • McCluskey, T.L.; West, M.M. (1998)
    Ordinal Operators in Focused Theory Revision. Proceedings: JICSLP'98 Post Conference Workshop on Computational Logic and Machine Learning.
  • West, M.M.; Bryant, C.H.; T.L. McCluskey (1997)
    Transforming General Program Proofs: A Meta Interpreter which Expands Negative Literals. Proceedings of The Seventh International Workshop on Logic Program Synthesis and Transformation, Leuven, Belgium, 10-12 July 1997.
  • McCluskey, T.L.; Porteous, J.M.; West, M.M.; Bryant, C.H. (1996)
    The Validation of Formal Specifications of Requirements. Proceedings of the BCS-FACS Northern Formal Methods Workshop, Ilkley, UK, September 1996, Electronic Workshops in Computing Series, Springer.
  • McCluskey, T.L.; Porteous, J.M.; Naik,Y.;Taylor, C. T.; Jones, S.V
    A Requirements Capture Method and its use in an Air Traffic Control Application
    , In: The Journal of Software Practice and Experience, 25(1), January 1995

    IMPRESS Technical Reports

  • McCluskey, T.L. (1997) An Integrated Validation Environment for the Conflict Prediction Specification. Technical Report impress/2/03/1, School of Computing and Mathematics, University of Huddersfield, UK.
  • West, M.M.; Bryant, C.H. (1997) Assigning Blame to General Clausal Form Theories. Technical Report impress/2/01/1, School of Computing and Mathematics, University of Huddersfield, UK.
  • Bryant, C.H.; West, M.M. (1996) Deliverable 1.1: Machine Learning for IMPRESS. Technical Report impress/1/02/1, School of Computing and Mathematics, University of Huddersfield, UK.
  • West, M.M.; Bryant, C.H. (1996) Deliverable 2.1: Customisation of the Formal Requirements Engineering Environment for the IMPRESS Project. Technical Report impress/1/03/1, School of Computing and Mathematics, University of Huddersfield, UK.
  • West, M.M.; Bryant, C.H.; T.L. McCluskey; J.M. Porteous (1996) The Use of Machine Learning in the Validation of a Formal Requirements Specification: the Work of IMPRESS. Technical Report impress/1/01/1, School of Computing and Mathematics, University of Huddersfield, UK.


    Related research on AI Planning is also being conducted in the school.

    This page is maintained by Margaret West (Email: m.m.west@hud.ac.uk).
    Last updated on September 6th 2000.