This document describes the PROSAMBA project, a partnership between Brazil and Germany applying microphone array signal processing techniques. The project focuses on fundamental research into blind source separation schemes and their application to safety, social inclusion of the hearing impaired, monitoring the Amazon forest, and developing communication devices. Key areas of research include subband adaptive filtering structures for speech separation, multi-dimensional array processing, and an ICA method called TRINICON that exploits nonwhiteness, nonstationarity, and nongaussianity of signals. Applications developed through the project include a sniper detector, intelligent hearing aids, environmental monitoring of animals and fires, and hands-free communication devices. The project is coordinated in Germany by Prof. Dr. Walter Keller

1. Microphone Array Signal Processing – A Partnership Brazil-Germany Applied to Safety, Social Inclusion of Hearing Handicapped, Monitoring of the Amazon Forest, and Development of Communication Devices PROSAMBA Homepage: http://www.internationales-buero.de/de/4210.php http://www.pgea.unb.br/~psamba/

2. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

3. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

4. Motivation Microphone array signal processing as a basis for fundamental research Blind Source Separation (BSS) schemes Signals extraction Signals classification for applied research Sniper detection Intelligent Hearing aid Environment monitoring Communication devices

5. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

7. Sound source localization;

8. Spatial filtering of the sounds;

12. Subband adaptive filtering structures

13. decorrelate the input signal;

14. reduce the computational complexity when modeling high-order FIR systems;

16. A new online subband BSS method for convolutive mixtures which employs real-coefficient uniform filter banks with critical sampling;

17. Extra filters are used to cancel aliasing between adjacent channels and improve the steady-state SIR;

18. The separation FIR filters work at smaller sampling rates that results in reduced computational complexity;

19. The coefficients of the subband separation filters are adjusted independently by a time-domain adaptation algorithm, which employs second-order statistics.[1]: P. B. Batalheiro, M. R. Petraglia, and D. B. Haddad, “Subband Blind Source Separation with Critically Sampled Filter Bank”, in Proc. 17th International Conference on Systems, Signals and Image Processing (IWSSIP), 2010, Rio de Janeiro, Brazil.

21. achieves an improved performance by taking into account the multi-dimensional structure of the data.

22. Multi-dimensional decompositions, such as Closed-Form PARAFAC (CFP) and Higher Order Singular Value Decomposition (HOSVD) are the basis for several schemes.

23. Improvement in case of colored noise via the Sequential Generalized Singular Value Decomposition (Sequential GSVD).

24. Multi-dimensional model order selection schemes have a probability of correct detection (PoD) significantly higher than matrix based schemes.

25. Application of hyper complex numbers is also foreseen.[2]: J. P. C. L. da Costa, D. Schulz, F. Roemer, M. Haardt, and J. A. Apolinario Jr., “Robust R-D Parameter Estimation via Closed-Form PARAFAC in Kronecker Colored Environments”, in Proc. 7th International Symposium on Wireless Communications Systems (ISWCS 2010), York, United Kingdom, Sept. 2010.

27. exploits simultaneously nonwhiteness, nonstationarity, and nongaussianity.

28. is restricted to the case that number of microphones M is equal or greater than the number of signals Q. By exploiting the sparseness, it is possible apply TRINICON for the underdetermined case.

29. Is it possible to integrate TRINICON with the following solutions?

30. Subband adaptive structure with critical sampling;

31. Multi-dimensional decompositions and operators to expoit also the multi-dimensional structure of the data.[3]: H. Buchner, R. Aichner, and W. Kellermann, “A generalization of blind source separation algorithms for convolutive mixtures based on second order statistics”, IEEE Trans on Speech and Audio Processing, Vol. 13, Num. 1, pp. 120-134, Jan. 2005.

32. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

34. yellow circle: phone array

35. red crossed circle: target

37. Short signal in time

38. Schockwave effectPosition (m)

39. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

41. filters spatially the desired sound source(s).

43. filters spatially the desired sound source(s).

45. Environment Monitoring (1) Environment monitoring Each sensor node with one or more microphones

47. the sensors work cooperatively as a microphone array

49. Communication devices Communication devices Hands-free communication; Conference; Laptos.

50. Outline IME Motivation Problem Fundamental research Sniper detector Intelligent hearing aid Environment monitoring Communication devices Important information TU Ilmenau

51. Importantinformation PROSAMBA stands for Processamento de Sinais em Arranjos de Microfones - uma Parceria Brasil-Alemanha Aplicada a Segurança, Inclusão Social de Portadores de Deficiência Auditiva, Monitoramento da Floresta Amazônica e Desenvolvimento de Dispositivos de Comunicação Duration of the project: 3 years Supported by IB/BMBF and CNPq Maximum period of each trip to Brazil: two months Coordinator in Germany: Prof. Dr. Walter Kellermann Coordinator in Brazil: Prof. Dr. Mariane Rembold Petraglia

52. Work Packages WP1: management of work packages 2 to 4 WP2: Specification of scenarios and requirements and metrics defintion and validation plan WP2: Proposal of BSS schemes based on filter banks with critical sampling tensor calculus hyper complex numbers WP2: Validation of the proposed BSS schemes WP3: Sniper detection WP3: Hearing aid WP3: Environment monitoring WP4: Dissemination and exploitation activities

53. Thank you for your attention! UnB UFAM UFRJ