Validation Scenarios

As part of the overall roadmap of TeamAware, the whole set of solutions developed in the project will be tested and evaluated in dedicated demonstrations. There will be a mid-term demonstration at month 18, focused on validation of standalone systems and components, and a final demonstration and tests of version 2 TeamAware software at month 36, which will entail the global evaluation and validation of the project.

As a preliminary step for the final demonstration, one of the recent tasks performed by TeamAware’s Work Package 2 has been the elaboration of detailed demonstration scenario scripts, per-system scenario requirements, and evaluation methodologies. Two demonstration scenarios have been considered, providing a good representation of the complexities found in real life, and covering the entire set of hardware and software systems of the project.

The first scenario features a natural disaster leading to a technological disaster. There will be multiple types of incidents such as fire and smoke in a subway, victims, human screams, etc. It will involve damaged buildings, human victims, gas leakage, and fire and smoke in an underground. The scenario is planned in the BursaRay metro line, which is an important means of transport in Bursa city. The 39-km-long line is used by 250.000 passengers on a daily basis. Overall, the tunnel is 900 meters long.

An explosion takes place at the 530th meter of the tunnel's entrance, and the emergency exits are located at the 450th meter of the tunnel. The main goal of the scenario is, therefore, to rescue the citizens trapped in the tunnel.

The second scenario is planned at the city centre of Bucharest, in a crowded area with high volumes of traffic, near offices and residential areas. The great variety of buildings surrounding the venue (e.g. from older with a high degree of degradation to newer buildings, from one level houses to 20-storey apartment buildings, from local stores to factories, etc.) is also a factor to take into consideration. On the same day of an international summit, a terrorist attack with further incidents (e.g. explosions, toxic chemical attacks) will take place, some of which can only be detected once first responders have arrived at the scene.

The adopted methodology for demonstrations evaluation is based on the Trial Guidance Methodology (TGM), which has gained broad acceptance within the IT community, and which is at high scale composed by three consecutive phases: preparation, execution, and evaluation. Within the preparation phase, among others, the Gaps and Research Questions are identified with the help of the end users. Then scenarios are then formulated in detail for each TeamAware system. For the data collection phase, basic data sets per system are defined together with a set of project-wide KPIs which, in the Evaluation phase, will be calculated for each system to give an answer to the Research Questions. Finally, for each demonstration scenario, some requirements for the TeamAware systems are specified and mapped to the Gaps defined per scenario.