Main outputs:
Sound of Vision prototype, with all the aforementioned components, functionalities and characteristics, implemented, tested in simulated and real situations.
User training protocols, including the serious game (Training mode of the device), the additional real environments training protocol, as well as detailed instructions to be followed by patients and caretakers when using the system.
Additional outputs:
Reusable sonification software library: it will implement the advanced sonification methods developed by the project and offer an API (Application Programming Interface) allowing independent reuse in different researches and projects.
Reusable training serious game: the game will be implemented in a modularized and portable manner, so it can be reused in different researches and projects (for training with assistive devices or for entertainment purposes) dedicated to visually impaired people.
Database with the performed tests, BCI measurements and users feedback, including 4 important components for each performed test: visually impaired user profile (including anonymized data), user feedback pertaining to the performance and usability research, video of the performed test (either in real or virtual environments) and the associated BCI measurements of the cortical activations. A software tool will be also provided that will allow the synchronized examination of the video and the measurements. This database will be an important source of information that can lead to more findings, by other research teams, relevant in particular to sonification but, furthermore, to assistive and rehabilitation devices, and neurosciences in general.
Automatically updated database with anonymized usage data and users feedback: The automated reporting component, integrated into the devices functionality, will allow automated reporting of anonymized usage data and user’s feedback, even outside the project’s dedicated testing environments, and even after the project completion. The reporting will be optional for each user, based on personal acceptance. The automated reported data will be stored in a large and comprehensive database that can provide unique evidence about the very large social group of visually impaired people, that can translate into advanced knowledge about individual’s behaviour related to the use of Sound of Vision as assistive ICT tool, personal wellbeing and disease management and prevention and personalized behavioural health interventions. The database will be initiated before the project termination and will continue to be updated afterwards, based on system usage.