NSF Workshop on Modeling and Simulation for Design of Large Software-Intensive Systems:
Challenges and New Research Directions (DLS03) [Dec 3-4, 2003]

Final Report

Attendance
Objectives
Activities
Sponsorship
Organization
Outcome
Concept
Bibliography


Hotel Information   Schedule   ACIMS/M&SNet Meeting   Critical Infrastructure Protection

Attendance:

By invitation only.

Participants:

           Name             Affiliation              Email
Adelinde Uhrmacher Rostock University, Germany lin@informatik.unirostock.de
Bernard Zeigler University of Arizona zeigler@ece.arizona.edu
Dan Craigen ORA Canada dan@ora.on.ca
Drew Hamilton Auburn  University hamilton@eng.auburn.edu
Fabrice Bernardi University Corse, France bernardi@univ-corse.fr
Gabriel Wainer Carleton University gwainer@sce.carleton.ca
George Riley Georgia Tech riley@ece.gatech.edu
Gerry Gannod Arizona State gannod@asu.edu
Glenn Ropella Tempus Dictum gepr@tempusdictum.com
Hessam Sarjoughian Arizona State Hessam.Sarjoughian@asu.edu
Jaideep Ray Sandia Labs jaray@ca.sandia.gov
Jim Nutaro University of Arizona nutaro@ece.arizona.edu
Kevin McNeil University of Arizona mcneil@ece.arizona.edu
Lee Shyr Sandia Labs lshyr@sandia.gov
Levent Yilmaz Trident Systems levent@tridsys.com
Mamadou Kaba Traore ISIMA, France traore@isima.fr
Manish  Parashar Rutgers parashar@caip.rutgers.edu
Marc LeGoc Tixis Systems marc.legoc@tixis.arcelor.com
Marshall Potter FAA marshall.potter@faa.gov
Mitchell Anderson University of Hawaii mitch@hawaii.edu
Neelan Gupta University of Arizona ngupta@cs.arizona.edu
Paul Davis RAND Corporation pdavis@rand.org
Perry Alexander University of Kansas alex@ittc.ku.edu
Phillip Hammonds JITC hammonp@fhu.disa.mil
Prasanna Sridhar University New Mexico prasanna@cs.unm.edu
Ralph Martinez University of Arizona martinez@ece.arizona.edu
Ram Chillarege Chillarege Inc. ram@chillarege.com
Ray Vaughn Mississippi State University vaughn@cs.msstate.edu
Renato Figueiredo University of Florida renato@ece.ufl.edu
Rob Armstrong Sandia Labs rob@z.ca.sandia.gov
Rob Pooley University of Edinburgh rjp@macs.hw.ac.uk
Robert Mathew University of Hawaii mathews@uhunix2.hawaii.edu
Salim Hariri University of Arizona hariri@ece.arizona.edu
Saurabh Mittal University of Arizona saurabh@ece.arizona.edu
Sheik Shahab University New Mexico shahab@unm.edu
Steve Stevenson Clemson University steve@cs.clemson.edu
Sumit Ghosh Stevens Tech. Institute sghosh2@stevens-tech.edu
Susan Gerhart Emery Riddle U. gerharts@erau.edu
Xiaolin Hu Georgia State University xhu@cs.gsu.edu
Zhenyu Wang Laurel Networks zwang@laurelnetworks.com

Objectives

The purpose of the workshop is to explore new directions for a science of design for large software-intensive systems facilitated by modeling and simulation (M&S). To do this, researchers in the theory, concepts and methodologies of M&S will meet with counterparts in software development to consider how the disparate elements that exist today can be integrated and further developed into a robust of science of large systems design.

Activities

A two-day workshop, by invitation only, will be held in Tucson, Arizona on Dec 3-4 in the neighborhood of the University of Arizona. The workshop format, with approximately 30 participants, will provide a cordial environment that is conducive to free and open exchange of software and system design approaches and examples of large software-intensive design issues to challenge these approaches. The workshop will be centered on three, inter-related, themes:

  • Specific design issues characteristic of large software-intensive systems
  • Current approaches to design of such systems
  • Emerging approaches: toward a science of software-intensive system design
Sponsorship

The National Science Foundation Advanced Networking Infrastructure Research Program (NSF/ANIR)

Organization:

The workshop is organized by:

Bernard Zeigler : Professor, Electrical & Computer Engineering, University of Arizona, co-Director of ACIMS .

Salim Hariri : Associate Professor, Electrical & Computer Engineering, University of Arizona, Director of HPDC Lab .

Hessam Sarjoughian : Assistant Professor, Computer Science and Engineering, Arizona State University. co-Director of ACIMS .

Sumit Ghosh , Hatrick Professor , Stevens Institute, Director of SENDLAB

Kevin McNeill, Research Associate Professor, Electrical & Computer Engineering, University of Arizona. Co-director of CERL

Gabriel Wainer , Assistant Professor, Systems and Computer Engineering, Carlton University

Phillip Hammonds, NGIT  Team Technical Lead, JITC

Outcome:

The results of the workshop will be compiled into a report that will help determine NSF's funding initiatives in software development and modeling and simulation (see for example, a report from prior workshops on Ultra-large Networks.)

Concept:

Moore's law of exponentially expanding computational and networking infrastructure is fueling a trend toward ever-larger software structures to drive business, science, and military systems Software-intensive systems such as future military systems-of-systems seek to employ software to implement highly integrated and capable command, control and intelligence functionalities. Unfortunately, the science of system design has lagged behind to guide the development of such software-intensive systems. Techniques that work for small software systems fail markedly when the scale is increased by one million fold.

Symptomatic of the lack of well founded design principles is the abundance of examples of projects that cost a lot but fail to meet their objectives. Many issues arise in the design of such large, highly decentralized, collections of interacting parts. The increased connectivity and capability create new complexity that is difficult to control and dynamics that are difficult to predict. Computer-based modeling and simulation (M&S) methodology is required to address these issues since the scale is well beyond what analytical tools alone can handle and there is limited ability to do controlled experiments. Large software-intensive systems demand new M&S approaches for understanding the dynamic behaviors of very large inter-connected networks with very few loci of control and many interacting components.

As detailed in recent DOD-sponsored reports, M&S, when properly performed through various stages of the software-intensive system design lifecycle, can provide effective assistance in formulating the system's capabilities, predicting and comparing the cost/benefit ratios of its various alternative architectures, and evaluating its achieved functional effectiveness. However, to date, the development of simulation systems has become highly costly, yielding unwieldy, unreliable, and non-reusable artifacts. Reuse of off-the-shelf packages is extremely limited, in part, because their experimentation specifications, models and simulations, and are too tightly coupled.. This lack of transparency and modularity makes it extremely unlikely that one will be able to match one's currently needed functionality with that of the off-the-shelf package in each of the three dimensions.


The underlying cause that impedes the development of reusable software is the absence from widespread use of a theory and formalism for modeling and simulation that among other things, supports separation of experimentation, models, and simulators. Such a theory would suggest the directions of a science of design in which M&S plays the indispensable supporting role that is required for large software-intensive systems.



The goal of the proposed workshop is to explore directions for a science of M&S-based design for large software-intensive systems. To do this researchers in the theory and formalisms of M&S will be brought together with researchers in software development concepts and methodologies. The discussion will center on integrating technical, infrastructure, and pragmatic elements into coherent basis for a science of large software-intensive systems.

Among the technical elements to be considered for their contribution to a science of design are:
  • Spiral development , a normative, flexible, risk-driven process model that is used to guide multiple stakeholders through concurrent engineering of software-intensive systems. Model-Based (system) Architecting and Software Engineering (MBASE) is a recent extension of the spiral model with the goals of tailoring a project's balance of discipline and flexibility via risk considerations.

  • Formal methods including the possibilities of "lightweight" variants that allow for inclusion of informal elements trading rigor for expressibility. Also, for large systems, a single, complete specification may not be possible and it may be more productive to compose many partial but appropriately abstracted specifications to allow some analysis of properties.

  • Architectural principles that provide uniform structures with known properties to organize the complexity of large systems. Architectural styles, design patterns and Unified Modeling Language constructs provide instances of such principles
Among the infrastructure elements are
  • Simulation and Execution Infrastructure provide the means by which software-intensive systems are designed and executed. Executable specifications and model continuity concepts are allowing greater linkage between phases of development with great potential reduced cycle time and increased quality.

  • Modeling of Dynamic Systems - large software-intensive systems multiply the dynamic system complexities encountered by today's real-time control and embedded systems. Dynamic systems modeling formalisms enable specifying both system structure and the environments in which can be tested.

  • Knowledge, Intelligence and Logic are the essential ingredients of emerging large software-intensive systems. Future system developments such as reliable and trusted Cyberinfratructure, critical infrastructure protection, global financial processing and military systems-of-systems all will intrinsically incorporate artificial intelligence, knowledge based approaches and classical and model logic-based data manipulation schemes.
Among the pragmatic elements are
  • Education is the basis by which any theory of design that emerges will be promulgated to form the greatly-improved software practice of the future.

  • Research is needed to foster examination of basic software practices and principles, to create new integration frameworks, and to test these out in scientific ways.

  • Practice is the source of issues to be considered in theory development and the ultimate test of success for new theoretical frameworks.
Invited participants with expertise in these elements will share their knowledge and insights with the group. The discussion will then center on integrating technical, infrastructure, and pragmatic elements into coherent basis for a science of design of large software-intensive systems.

Bibliography:
Barry Boehm and Wilfred J. Hansen, "The Spiral Model as a Tool for Evolutionary Acquisition," CrossTalk May 2001

Barry Boehm and Daniel Port, "Balancing Discipline and Flexibility with the Spiral Model and MBASE," CrossTalk December 2001

Barry Boehm, Dan Port, LiGuo Huang,and Winsor Brown, "Using the Spiral Model and MBASE to Generate New Acquisition Process Models: SAIV, CAIV, and SCQAIV," CrossTalk January 2002

Bass, L., Clements, P., Kazman, R. 2003. Software Architecture in Practice , (2nd edition), Addison-Wesley

Davis, P., and J. Bigelow. 2003. Motivated Metamodel. Synthesis of Cause-Effect Reasoning and Statistical Metamodeling . RAND Corporation, US.

Dagstuhl Seminar, 2002. Grand Challenges for Modeling and Simulation, Dagstuhl Report , R. M. Fujimoto, D. Lunceford, E. Page, and A. Uhrmacher (eds).

Dahmann, J.S., F. Kuhl, and R. Weatherly, Standards for Simulation: As Simple As Possible But Not Simpler The High Level Architecture For Simulation . Simulation, 1998. 71(6): p. 378-387.

Frydman C., M. Le Goc, L. Torres and N. Giambiasi, "Knowledge-Based diagnosis in Sachem using DEVS models", Special Issue of Transaction of Society for Modeling and Simulation International (SCS) on Recent Advances in DEVS Methodology, Tag Gon Kim Ed.,Vol. 18, N°3, 2001, pp147-158.

NRC Committee, "Technology for the United States Navy and Marine Corps, 2000-2035 Becoming a 21st Century Force:Volume 9: Modeling and Simulation," (1997), National Academy Press.

NRC Committee, "Modeling and Simulation in Manufacturing and Defense Acquisition: Pathways to Success" National Academy Press. (2002).

Ören, T.I. 2002. Future of Modelling and Simulation: Some Development Areas. Proceedings of the 2002 Summer Computer Simulation Conference, pp. 3-8.

Overstreet, C. M., R. E. Nance, and O. Balci. 2002. Issues in Enhancing Model Reuse. International Conference on Grand Challenges for Modeling and Simulation , Jan. 27-31, San Antonio, Texas, USA.

Page, E., and J. Opper. 1999. Observation on the Complexity of Composable Simulation. In Proceedings of the 1999 Winter Simulation Conference , 553-560.

Penix, A. M., and J. M. Alexander. 1999. Efficient Specification-Based Component Retrieval. Automated Software Engineering: An International Journal 6 (2), 139-170.

Sarjoughian, Hessam S. and Francois E. Cellier (Editors), Discrete Event Modeling and Simulation Technologies: A Tapestry of Systems and AI-Based Theories and Methodologies , Springer-Verlag, NY. 2001.

Vangheluwe, H. L., J. De Lara, and P. J. Mosterman. 2002. An Introduction to Multi-Paradigm Modelling and Simulation. In Proceedings of the 2002 AI Simulation and Planning in High Autonomy Systems . F. Barros, and N. Giambiasi (eds), 9-20. Lisbon, Portugal.

Vaughn, Rayford and George Vinu, "Application of Lightweight Formal Methods in Requirement Engineering", CrossTalk 2003

Zaremski, A. M., and J. M. Wing. 1997. Specification Matching of Software Components. ACM Transactions On Software Engineering and Methodology 6 (4), 333-369.

Zeigler, B. P. 1984. Multifacetted Modelling and Discrete Event Simulation . Academic Press Inc., London.

Zeigler, B. P., H. Praehofer, and T. G. Kim. 2000. Theory of Modeling and Simulation. Integrating Discrete Event and Continuous Complex Dynamic Systems. 2nd Ed. Academic Press. Davis.