Controllability and observability in distributed testing

TLDR: Conformance testing approaches are required for gaining confidence in final products and guaranteeing their integration and interoperability within open distributed environment, and ideas gained from the experience with protocol testing are examined.

Abstract: In developing distributed systems, current trends are towards creating open distributed environments supporting interworking, interoperability, and portability, in spite of heterogeneity and autonomy of related systems. Several reference models, architectures and frameworks such as ODP, CORBA, and TINA, have already been designed and proposed. However, even though models, architectures, and frameworks, provide a good basis for developing working open distributed applications, conformance testing approaches are required for gaining confidence in final products and guaranteeing their integration and interoperability within open distributed environment. ODP provides some preliminary statements on conformance assessment in open distributed systems, but considerable work needs to be done before reaching a workable and accepted conformance testing methodology for open distributed processing. Further, ISO, ITU, OMG, and TINA-C, have recently recognized the urgent need for conformance testing. In this paper, we examine ideas gained from our experience with protocol testing, which may contribute to the design of such a framework. Our methodology is essentially guided by two features that have a great influence on all aspects of the testing process: controllability and observability.