STRL STRL

Defence Technology Centre in
Data and Information Fusion (DIF-DTC)

The centre is funded by the MoD (Ministry of Defence). The DTC is the first MoD Defence Technology Centre and is a consortium led by General Dynamics UK. Members of the consortium are BT, QinetiQ, Imperial College and the Universities of Bristol, Cardiff, Cambridge, Southampton, De Montfort, Surrey and Cranfield. The STRL has two projects within the DIF-DTC.

Trust Management in Collaborative Systems.
    
DIF-DTC
 
Secure and Trusted Agents for
    Data and Information Fusion.
DIF-DTC
 


Trust Management in Collaborative Systems (aToMICS)

The project is aimed to provide a formal policy-based approach to the management of trust, uncertainty and risks. aToMICS will be integrated into components of a collaborative system, for example a Multi-Agent System developed using the JADE framework, or provided as a trusted service that is provided by a concrete middle-ware. The central benefit is that policies capture the dynamics of trust. Policies can change with observations and over time, therefore accounting for the intuitive subjectivity of the concept as individuals in the collaboration can define their own policies. The formal, mathematical underpinning provided for policies and their interaction with system's security mechanisms provide the necessary assurance that is needed for a successful military exploitation.

Outline

The project aims to develop a sound and implementable Trust Management System in which the evaluation and propagation of trust are governed by trust policies. Our notion of trust integrates trust-levels, uncertainty and risk in a uniform framework. Fundamental to our approach is the ability to capture the dynamic nature of trust.

Motivation

It is widely accepted that:

``The ability to form multi-organizational networks rapidly is crucial to humanitarian aid, disaster relief, and large urgent projects. Designing and implementing the network's conversation space is the central challenge.''

We have seen a move from traditionally isolated and closed environments towards more networked applications where organisations increasingly share and exchange information. Organisations nowadays cooperate with a very limited number of carefully selected and trusted partners which has huge security implications on these networked environments. It is anticipated that this trend will continue, leading to open environments where organisations form ad-hoc collaborations with partners whose long-term intentions are unknown and difficult to predict.

The dynamics of these ad-hoc collaborations and the increased number of partners and information poses two fundamental problems:

  1. agility and speed of the formation of these collaborations and
  2. the assessment of the trustworthiness of the involved partners.
These are major concerns for applications in the military domain where it is desirable to increase situational awareness through collaboration and to decrease the length of the decision making cycle.

The move towards autonomous systems, that can to some degree participate in collaborations at their own discretion provides a solution, as their agility to adapt and reconfigure to new, unforeseen conditions overcomes beforementioned problems. This autonomy, however, leads to entirely new challenges for the security of these systems which are best addressed by introducing the notion of a trust management system that intertwines with the system's security mechanisms.

Trust and Security are not orthogonal concepts. Some aspects of trust rely heavily on the existence of sound security mechanisms. One example is the adequate protection and handling of meta-information, e.g. log-files, that are associated with trust. Equally security decisions can be also influenced by trust as an access control policy may depend on the trust-level that the system has in the entities that are requesting access to secured data. As a result existing security mechanisms must be able to cope with the dynamics of trust. Policies, that govern the access to resources will change as a result of trust-evaluations.

Trust is typically not enough to model the complexity of our decision making within collaborations. We therefore associate trust with a degree of uncertainty, reflecting for example the entity's confidence in the trust evaluation. Trust therefore is denoted by a tuple: trust-level/uncertainty. We also introduce risk as an equally weighted component of the proposed trust management framework. Risk assessment is essential to the decision making, especially when the confidence in the trust assessment is low. Risk assessments allow the trust-model to evolve using experience gained from low risk interactions to build up trust and confidence for future interactions.

TRUST OUTLINE

Trust Management Framework

Trust is a fundamental concept in human behaviour, and has governed collaboration between humans and organisations for millennia. The ultimate aim of our research on trust-based systems is to transfer such forms of collaboration to future autonomous systems scenarios. Trust in computing is the attempt to formalise, implement and utilise trust models borrowed from social sciences to govern and control the interactions between a set of autonomous entities in an open environment.

In such environment entities are owned by different providers, some of which are benevolent and others that have different interests in the overall objective of the system. The interactions between the entities are based on the trust that these entities have in each other, the uncertainty of the assessment and the risk that is involved.

We view the system as a collection of autonomous entities. The trust management system itself is encapsulated within each entity.

The trust management system consists of a trust- and a risk engine that are controlled by policies.

  • The trust engine assesses the trust and uncertainty of information and behaviours. It represents a subjective trust/uncertainty view of the environment. The main tasks are to update of trust and uncertainty values as well as maintaining trust relevant meta-information over time, based on observations of its environment.
  • The risk engine does evaluate the risk that is associated with a trust decision and thus provides an independent measure for the decision making.
Trust can also propagate between entities. This form of propagation is mostly associated with the notion of reputation. In addition, trust policies control how trust information is communicated and what meta-information may be transmitted and provide the link to existing security mechanisms. The interaction between Bob and Alice would succeed, whilst the interaction between Eve (an untrusted entity for that interaction) and Alice is denied.
Trust Categories

We divide trust into three categories:

  1. Information Trust
  2. Behavioural Trust
  3. Identity Trust
These categories are highly dependent on each other. One of the key questions is to explore the nature of their relationships. For example how can we assess the trust-level of a given information that was processed from trusted information by an untrusted entity?
TRUST RELATIONS
It is anticipated that our model will address these categories in a uniform and integrated fashion.
Information Trust

Information trust is especially relevant to all command and control (C2) applications and every system that processes intelligence information. A model of trust must be able to provide meta-information that is required to calculate trust-levels. Meta-information could for example be the original source, the access log, versions or the way the information has been communicated.

When exchanging information it is important to clearly define which meta-information can be communicated and which meta-information must be kept secret from other entities. This establishes the link to more traditional mechanisms such as access control and information flow that are dependent on trust evaluations.

Behavioural Trust

Behavioural trust requires a model of the entities' expected behaviours. Trust in an entity is established if its observable behaviours match the expected ones.

To be able to build such a model it is necessary to have prior knowledge of the entity's specification (expected behaviour). A source of this are informal interface descriptions or more formal representations such as semantically marked up service descriptions that are employed in service-based computing. One of the key problems, which we will explore, is the incompleteness of these descriptions.

The trust in derived information is not only dependent on the raw information sources, but also on the trust we have in its processing. It is important to define the effect that behavioural trust has on the produced information.

Identity Trust

Identity trust deals with the trust that one has in the authenticity of an entity's identity. It can actually be seen as a combination of behavioural trust and information trust, as the credentials the entity presents are information and the mechanism that is used to establish their authenticity is a behaviour.

Uncertainty

Uncertainty is a major aspect of our trust model. Trust is constantly re-evaluated based on freshly obtained information and communication of trust information with other entities. Ideally trust converges to give an accurate picture of the trustworthiness of information and other entities' behaviours. However, in any real world application this is unlikely to happen, as trusted entities that were once benevolent may engage in perceptively malicious activities or new trustworthy information is contradicting another trusted information.

The concept of uncertainty complements the notion of trust as it does define a secondary measure that can be used in trust-based decision making. Every trust evaluation is accompanied by an uncertainty assessment reflecting that, for example a specific information is principally trusted (the trust assessment) but there is not enough evidence that can support this trust evaluation (the uncertainty assessment). In this case the information would be trusted, but our confidence in the assessment remains low. The level of uncertainty will change over time and reflects the increase/decrease, in the confidence of the trust evaluation.

Similar to trust, uncertainty measures of trust evaluations do change over time and on events. For example the event of obtaining the contradictory information will force a re-evaluation of the uncertainty assessment of the associated trust levels.

Risk

Before engaging in an interaction with an unknown entity a decision must be made whether to trust its behaviour and the received information. This decision will take into account the trust-level in the entity's behaviour and the uncertainty of this trust evaluation. An important aspect is the risk assessment of this decision. By risk assessment we mean an assessment of the severity of the decision's consequences.

The importance of including risks in the decision making is that the Trust Management System has the ability to engage in an interaction that is deemed to be untrusted or that has a very low confidence rating. Based on the policies it may choose to do so if the risk involved is very low. The experience gained from that interaction can then be used to update the trust/uncertainty values to either promote this form of interaction in the future or to prevent it.

Publications

2007-6
Deriving Enforcement Mechanisms from Policies.
H. Janicke, A. Cau, F. Siewe and H. Zedan.
In proceedings of Policy2007, Bologna, Italy, IEEE, 2007.
[ pdf file ]

2007-7
A Note on the Formalisation of UCON.
H. Janicke, A. Cau, and H. Zedan.
In proceedings of SACMAT'07, Sophia Antipolis, France, ACM, 2007.
[ pdf file ]

2007-9
The Role of Dynamic Security Policy in Military Scenarios.
H. Janicke and L. Finch.
In proceedings of the 6th European Conference on Information Warfare and Security, 2007.
[ pdf file ]

2007-10
Policy-Driven Service Discovery.
H. Janicke and M. Solanki.
In proceedings of YRSOC 2007, 2007.
[ pdf file ]

2007-22
The Role of Dynamic Security Policies in Military Scenarios.
H. Janicke and L. Finch.
In Proc. Digital In Journal of Information Warfare, William Hutchinson (Edt.), Volume 6, Issue 3, pages 1-14, Dec 2007.
[ pdf file ]

2008-4
Concurrent Enforcement of Usage Control Policies.
H. Janicke, A. Cau, F. Siewe and H. Zedan.
In the proceedings of the 9th IEEE Workshop on Policies for Distributed Systems and Networks (POLICY2008) Palisades, NY, US, June 4-6th, 2008.
[ pdf file ]

Back

Secure and Trusted Agents for Data and Information Fusion.

Aim

Provide a sound, unifying and compositional framework for the development of secure and trusted MAS in which security, functionality and temporal aspects are integrated.

  • Security cannot be bolt on.
  • Security has a temporal dimension.
  • Security must be expressed as policies which can change dynamically.

Framework Overview

SANTA workbench

The work is organised along the theoretical to applied axis. The foundation is an abstract computational and security model that has a specification oriented semantics in Interval Temporal Logic. The development starts with a high-level specification of a Multi-Agent System and its protection requirements, which is refined step by step into an implementable program. All refinements are provably correct.

Computational Model

Computational Model Overview

The computational model describes the functioning of the Multi-Agent System. The entities that are defined in the computational model are agents, objects and enforcement mechanisms.

Agents are active entities in the MAS that can perform actions to perceive or act upon their environment. They are autonomous, viz. in control of the actions they execute.

Execution Cycle

Objects are passive entities in the MAS that can be accessed by agents. They represent the shared environment of the agents in the MAS. Objects provide interfaces that define the operations that can be performed on them.

Enforcement Mechanisms link the security model with the computational model. They define what the enforcement of a policy means and how it is implemented. We distinguish between Vigilant Mechanisms where the enforcement is implemented as part of the agent or object and Security Enforcer where the enforcement is implemented in a central entity that protects the interfaces of a collection of objects.

Security Model

The focus of the framework is the expression of complex, history-dependent protection requirements such as authorisation, delegation, obligation and integrity in form of policies. Policies are dynamic, viz. they can change over time and on the occurrence of events.

History Dependent Rules capture protection requirements that are dependent on the past execution of the MAS. An example is the Chinese Wall Policy.

Once a subject has accessed an object, the only other objects accessible by that subject are within the same company data-set or within a different conflict of interest class.
allow (S,O,A) when T: exists x in objects : {
      (sometime done(S,x,access)) and dataset(O) = dataset(x) },
allow (S,O,A) when T: exists x in objects : {
      (sometime done(S,x,access)) and (always not(ciclass(O)=ciclass(x))) }

Policy Composition is used to express security requirements that apply only to a certain situation. For example the policy that is enforced at airports depends on the national terrorist threat-level.

policy low-threat : /* ... */ end
policy high-threat : /* ... */ end
policy composition :
   repeat ( (unless done(S,system,alert): low-threat) ;
      (unless done(S,system,resetalert): high-threat) )
end

Linguistic Support and Development

To ease the writing of the specification, linguistic support for the expression of the systems functional and security requirements is provided in form of the SANTA language. SANTA has a specification oriented semantics in Interval Temporal Logic that allows to reason about properties of the MAS.

SANTA is a wide-spectrum language, viz. the MAS is expressed at different levels of abstraction. During the development, design-decisions are made that move from the abstract specification towards a concrete implementation. The refinement rules that are used to make design-decisions are provably correct, ensuring that the implementation does not violate its original specification.

Tools

Tool support for the analysis of the program at specification and implementation level is provided. The tools use a logic-based approach for the validation of the systems functional, security and temporal requirements. SPAT (Security Policy Analysis Tool) allows for the animation of policies to validate the initial protection requirements. SPAT is part of the SANTA workbench.

SPAT

Publications

2003-16
A Compositional Framework for Access Control Policies Enforcement.
Francois Siewe, Antonio Cau and Hussein Zedan.
In the proceedings of the ACM workshop on Formal Methods in Security Engineering: From Specifications to Code, Washington, DC, USA, October 2003.
[ pdf file ]

2005-3
Analysis and Run-time Verification of Dynamic Security Policies.
H. Janicke, F. Siewe, K. Jones, A. Cau and H. Zedan.
Proceedings of the Workshop on Defence Applications & Multi-Agent Systems (DAMAS05), at 4th international joint conference on Autonomous Agents & Multi Agent Systems (AAMAS05), July 25, 2005.
[ postscript file ]

2005-4
Dynamic Access Control Policies and Web-Service Composition.
F.Siewe, H.Janicke and K. Jones.
Proceedings of the 1st Young Researchers Workshop on Service Oriented Computing (YR-SOC 05), Leicester, April, 2005.
[ postscript file ]

2005-31
Autonomous Agents and Multi-Agent Systems for the Military -- Issues and Challenges.
P. Beaumont, D. Allsopp, M. Greaves, S. Goldsmith, S. Spires, S. Thompson and H. Janicke.
In Proceedings of the Workshop on Defence Applications & Multi-Agent Systems (DAMAS05), at 4th international joint conference on Autonomous Agents & Multi Agent Systems (AAMAS05), July 25, 2005.

2006-3
A Compositional Event & Time-based Policy Model.
H. Janicke, A. Cau, F. Siewe, H.Zedan and K. Jones.
In proceedings of Policy2006, London, Ontario, Canada, IEEE, 2006.
[ pdf file ]

Back






Jul 16 2012
Home | Training | Research | Members | About | News