Complex software systems<br />Multi-purpose. Organisational systems that support different functions within an organisation<br />System of systems. Usually distributed and normally constructed by integrating existing systems/components/services<br />Unlimited. Not subject to limitations derived from the laws of physics (so, no natural constraints on their size)<br />Data intensive. System data orders of magnitude larger than code; long-lifetime data<br />Dynamic. Changing quickly in response to changes in the business environment<br />
Enterprise information systems<br />Multi-purpose. Designed to cross-cut the organisation<br />System of systems. Integrate several systems, including legacy systems<br />Unlimited.Organisational code bases increasing in size<br />Data intensive. Database centric systems<br />Dynamic. Rapid business change<br />
Complex system realities<br />There is no definitive specification of what the system should ‘do’ and it is practically impossible to create such a specification<br />The complexity of the system is such that it is not ‘understandable’ as a whole<br />It is likely that, at all times, some parts of the system will not be fully operational<br />Actors responsible for different parts of the system are likely to have conflicting goals<br />
There are fundamental reasons why current approaches to software engineering cannot scale to LSCITS engineering<br />
Reductionism<br />Reductionism<br /> “an approach to understanding the nature of complex things by reducing them to the interactions of their parts, or to simpler or more fundamental things”.<br />Its focus is on the parts of a system, not the relationships between those parts<br /><ul><li>Reductionism underpins most engineering, including software engineering</li></li></ul><li>Software engineering<br />Developments in software engineering have largely adopted a reductionist perspective:<br />Design methodologies<br />Formal methods<br />Agile approaches<br />Software architecture<br />Model-driven engineering<br />Process improvement<br />Reductionist approaches to software engineering have been successful in allowing us to construct larger software systems<br />
Complex and complicated systems<br />Reductionist approaches are intended to help deal with complicated systems.<br />We are now building complex systems where is is impossible to acquire and maintain a complete understanding of the system. Elements are independently controlled and often have undocumented side-effects.<br />
Reductionist assumptions<br />Control<br />Reductionist approaches assume that we have control over the organisation of the system. It is then possible to decompose the system into parts that can themselves be engineered using reductionist approaches<br />A rational world<br />Reductionist approaches assume that rationality will be the principal influence in decision making<br />Definable problems<br />Reductionist approaches assume that the problem can be defined and the system boundaries established<br />
LSCITS reality<br />Reductionist assumptions<br />Owners of a system control its development<br />Decisions made rationally, driven by technical criteria<br />Definable problem and clear system boundaries<br />Rationality<br />Problemdefinition<br />Control<br />Wicked problem and constantly renegotiated system boundaries<br />Decisions driven by political motives<br />No single owner or controller<br />LSCITS reality<br />
Reductionism and LSCITS<br />Reductionism works (to some extent) for systems that we can control – such as software products<br />But, for LSCITS, reductionist assumptions are no longer true<br />Incremental improvements in software engineering are not enough to help us build complex systems of systems<br />
Research challenges<br />Reductionism is essentially based around the notion of a closed system<br />The focus in software engineering has been on ‘the software’<br />Models and representations<br />Verification and validation<br />Methods and techniques<br />But LSCITS engineering is an open system problem – not just the software but the environments that affect that software’s acceptability and operation<br />
Short and long-term research<br />Long-term research<br />We need new inter-disciplinary approaches to LSCITS engineering which will involve developing completely new engineering paradigms that are not based on reductionism<br />But – how do we test and validate these approaches?<br />Enlightened 20+ year funding is needed to develop these approaches<br />Shorter-term research<br />We have to address some key problems and issues that limit the development of LSCITS as, for sure, these LSCITS are being and will be constructed<br />
Systems in operation<br /><ul><li>How can we model and simulate the interactions between independent systems?
How can we monitor coalitions of systems and what are the warning signs of problems?
How can systems be designed to recover from failure?
To what extent can coalitions of systems be self-managing?
How should shared knowledge in a coalition of systems be represented?</li></li></ul><li>The socio-political environment<br />How can systems be designed to recover from failure?<br />How can we integrate socio-technical factors into systems and software engineering methods?<br />How can we manage complex, dynamically changing system configurations?<br />How can we support the agile engineering of coalitions of systems?<br />How should coalitions of systems be regulated and certified?<br />How can we do ‘probabilistic verification’ of systems?<br />
LSCITS EngD<br />Students have to work on an industrial problem and spend a significant period of time working in industry on that problem. <br />Students take a range of courses that focus on complexity and systems engineering such as systems engineering for LSCITS, socio-technical systems, high-integrity systems engineering, empirical methods and technology innovation. <br />Students don’t have to produce a conventional ‘thesis’ – a book on a single topic but can produce a portfolio of work around their selected area. <br />
Conclusion<br />Current software engineering methods and techniques are effective in building closed systems (such as software products)<br />But they cannot cope with LSCITS – where we need to consider not just the software but its development and operational environment<br />Software engineering has to change to embrace the wider reality of LSCITS engineering<br />Failure to do so will put our society at risk as complex software becomes embedded in all aspects of our lives<br />
Finding out more<br />http://arxiv.org/abs/1109.3444<br />