Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. Nicolae Duta Researcher, Natural Language Understanding Nuance Communications R&D, 1 Wayside Road, Burlington, MA, 01803 Tel: (M) 781-475-9546 Email: Web page: Education Ph. D. Computer Science Michigan State E. Lansing, MI 2000 University M.S. Computer Science The University of Iowa Iowa City, IA 1996 M.S. Statistics University of Paris XI Paris, France 1992 B.S. Applied Mathematics University of Romania 1991 Bucharest Professional Positions Researcher Nuance Communications 2005 - present Scientist BBN Technologies 2000 - 2005 Research Assistant Michigan State University 1997 - 2000 Research Assistant Siemens Corporate Research 1997 - 1999 Teaching Assistant Michigan State University 1996 - 1997 Instructor The University of Iowa 1996 Teaching Assistant The University of Iowa 1994 - 1996 Research Assistant INRIA - Rocquencourt, France 1993 Research interests: pattern recognition and machine learning techniques applied to vision, speech, language, biometrics, robotics and genetics Professional Responsibilities and Projects
  2. 2. At Nuance Communications Nicolae Duta has been a member of the Natural Language Understanding R&D group. He has been responsible for the research, design and development of the language modeling and understanding modules in the Nuance Recognizer V9 and integrating the corresponding modules in the OpenSpeech® Recognizer with those in the Nuance 8.5 Voice Platform. His research of data sharing over multiple applications and domains contributed to creating best training practices for the Nuance Directory Assistance 6.0 and Nuance Call Steering products and is currently being patented [P2]. In the same time, he continued to have an active role in the computer vision and biometrics research communities by publishing technology survey papers [1], delivering invited talks [T1] and serving on technical committee boards [B]. Between 2000 and 2005 he was a scientist at BBN Technologies where he has done research and development in natural language modeling and speech recognition. He developed language models for automatic speech to text translation in both broadcast news and conversational telephony domains and three languages (English, Mandarin and Arabic)[6-7]. He designed a full language modeling package which can handle billion-words corpora [T2] which helped the BBN team win the Best Speech Recognition System award in the April 2003 DARPA evaluation. He also qualitatively analyzed the errors made by current state-of-the art large vocabulary continuous speech recognition systems as well as the errors made by the human annotator(s) who are used to establish the ground- truth against which speech recognition systems are evaluated [2]. The error analysis produced a lower bound on the word error rate that can be achieved in practice as well as suggested solutions for building an online real-time LVCSR system. Between 1997 and 2000 he was a research assistant in the department of Computer Science and Engineering at Michigan State University. He developed trainable algorithms and implemented systems for object (medical structures [3,6,7], human faces [12], human hand shapes and palm-prints [1,4], vehicles [13]) learning and retrieval in digital images. In 2000 he developed a very fast approximate string matching/aligning algorithm that can efficiently handle word mutations (different word spelling due to letter substitution, deletion or insertion). During the summer months of 1997-1999 he was a research assistant in the Imaging and Visualization Laboratory, at Siemens Corporate Research, Princeton, NJ where he worked on left ventricle detection and segmentation in MR cardiac images [4,9]. That work is patented and is part of Siemens’ commercial image analysis package called Argus.
  3. 3. Between 1994 and 1996 he conducted research on MR brain image segmentation [7,14] in the College of Engineering Imaging Group at the University of Iowa. In 1993 he was part of the research team in the Syntim Laboratory at the Institut National de Recherche en Informatique et en Automatique (INRIA), Rocquencourt, France where he worked on road detection in SPOT satellite images [6].
  4. 4. Products and systems developed (demos available on request, see my web-page for more details) 2005 - 2009 Nuance Communications: Language modeling and understanding modules in Nuance Recognizer V9 • Used in real-time commercial speech recognition and call routing. Written in C/C++. 2002 - 2004 BBN Technologies: Language modeling toolkit • Handles billion-word data, multiple discounting models, on-the-fly word compounding and computes the word transition probabilities in almost real time on a Linux PC platform. It is written in C and can be compiled on most platforms, the 64-bit Intel version is most efficient. 2000 - 2002 BBN Technologies: Rejection sub-system of the BBN automated directory assistance system • Rejects to a human operator the directory assistance calls which cannot be automatically processed. Written in C and Perl. 1998-2000 Siemens Corporate Research: Left ventricle detection in MR images (part of Simens ’ Argus) • Real time ventricle detection and display, handles multiple ventricle slices and imaging parameters. Written in C with a Matlab GUI. Commercialized as part of Siemens’ MR software. 1998 - 2000 Michigan State University: Automatic shape learning system • Clusters a set of given object shapes, discards outlier shapes and computes the average shape (model) and modes of variation for each shape cluster. Used for shape analysis and retrieval. Written in C with Matlab GUI and demo, has been used for research at several universities. 1997 - 2000 Michigan State University: Human face detection system • Face detection in black and white pictures, 85% correct detection rate, 10^(-5) false accept rate. Written in C.
  5. 5. 2000 Michigan State University: Palmprint-based ID verification system • Written in C and Matlab. 1999 Michigan State University: Hand shape-based ID verification system • Written in C and Matlab, tested on 50 subjects, 2% ID verification error. 1998 Michigan State University: Corpus Callosum segmentation system • Segments in almost real time the corpus callosum in MR images. Written in C and Matlab. 1995 - 1997 The University of Iowa: Neuro-anatomical brain structure segmentation system • Segments 10 structures (shown in the brain figure above), able to automatically detect and repair outlier boundaries. Written in C with a Motif GUI. 1993 INRIA - Rocquencourt, France: System for road detection in satellite images • Completely automatic highway detection/tracking in huge SPOT images. Written in C with a Motif GUI. Programming experience, languages and platforms Developed and implemented advanced vision, speech, language and other pattern recognition and AI algorithms since 1990. Languages: • Pascal and C since 1988, taught C programming at the University of Iowa (1996) • Prolog since 1989, used it for solving AI problems • Motif and OpenLook since 1991, used them for some system GUIs • Matlab since 1995, used it for most system GUIs and numerical analysis tasks
  6. 6. • C++ since 1996, conducted laboratory sessions at Michigan State University (1997) • C-shell since 1996, conducted laboratory sessions and automated project grading at Michigan State University (1997) • Perl since 2000, used it for almost all string processing needed in speech recognition tasks • Small programs in Java and HTML Platforms: • SunOS/Solaris since 1991 • IBM PC/Windows98,NT,2000 since 1996 • IBM PC/Linux since 1999 Professional Activities Technical Program Committee Member • International Conference on Pattern Recognition, Cambridge, UK, 2004 • International Conference on Pattern Recognition, Hong Kong, 2006 • Biometrics Symposium at The Biometric Consortium Conference (BCC) 2007 Member, IEEE and IEEE Computer Society Reviewer: IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, Pattern Recognition, Pattern Recognition Letters, Computer Vision and Image Understanding, Pattern Analysis and Applications. Patents P1. System and method for segmenting the left ventricle in a cardiac image, United States Patent 7,400,757, 2008. P2. Speech Recognition Semantic Classification Training, United States Patent Application 2639B67, 2008 P3. Method for learning-based object detection in cardiac magnetic resonance images, United States Patent Application 20030035573, 2003. P4. Deformable Matching of hand shapes for verification, United States provisional Patent, 1999.
  7. 7. Ph.D. Thesis Learning-based detection, segmentation and matching of objects PDF Copyright © 2000 by Nicolae Duta Thesis committee: Anil K. Jain (chair), Marie-Pierre Jolly (Siemens), Sridhar Mahadevan, R.V. Ramamoorthi and John Weng
  8. 8. Invited talks a. A Survey of Machine Learning Techniques Employed in Language, Speech, Vision and Biometric Applications • Department of Computer Science, University of Auckland, New Zealand, (September 2008) • First Nuance Research Conference, Naples, FL, (March 2008) b. Error analysis of the BN and CTS results, STT workshop, St. Thomas (December, 2003). PDF Copyright © 2003 by BBNT c. Using a large LM, EARS technical workshop, Martigny, Switzerland (September 2003). PDF Copyright © 2003 by BBNT d. The BBN RT03 BN English system, EARS technical workshop, Boston, MA (May 2003). PDF Copyright © 2003 by BBNT e. Language Modeling: what matters most?, EARS technical workshop, Berkeley, CA (January 2003). PDF Copyright © 2003 by BBNT f. Learning-based detection, segmentation and matching of objects: • Imaging & Visualization Laboratory, Siemens Corporate Research, Princeton, NJ, (March 2000) • Mitsubishi Electric Advanced Television Laboratory, New Providence, NJ, (March 2000) • Delphi Auto Research Labs, Warren, MI, (May 2000) • Speech & Language Processing Department, BBN Technologies, Cambridge, MA (May 2000) • Image Processing Research Department, AT&T Labs, Red Bank, NJ, (June 2000) • International Conference on Advances in Pattern Recognition (ICAPR 01) • Department of Physiology, University of Bergen, Norway (May 2002) • European Conference on Computer Vision (ECCV 2002) g. Segmentation and Interpretation of MR Brain Images: An Improved Active Shape Model
  9. 9. • Imaging & Visualization Laboratory, Siemens Corporate Research, Princeton, NJ, (June 1997)
  10. 10. Publications Book chapters [1] N. Duta, Hand Shape, in Encyclopedia of Biometrics, Li, Stan Z. (Ed.), ISBN: 978-0-387-73003-5, 2009 PDF Copyright © 2009 by Springer Verlag. Journal papers [1] N. Duta, A survey of biometric technology based on hand shape, Pattern Recognition, 2009 (article in press) PDF Copyright © 2009 by Elsevier Ltd. [2] N. Duta, R. Schwartz and J. Makhoul, Analysis of the errors produced by the 2004 BBN speech recognition system in the DARPA EARS evaluations. IEEE Transactions on Audio, Speech and Language Processing, 14(5), 2006; pp.1745-1753. PDF Copyright © 2006 by IEEE [3] K. von Plessen, A. Lundervold, N. Duta, E. Heiervang, F. Klauschen, A. Smievoll, L. Ersland and K. Hugdahl, Less developed corpus callosum in dyslexic subjects - a structural MRI study. Neuropsychologia 2002; 47(7), pp.1035-1044. PDF Copyright © 2002 by Elsevier Press [4] N. Duta, A. K. Jain, and K. V. Mardia, Matching of palmprints, Pattern Recognition Letters, No. 4, February 2002, pp. 477-485. PDF Copyright © 2002 by Elsevier Press [5] N. Duta and A. K. Jain, Invited contribution to the discussion of Glasbey and Mardia: A penalised likelihood approach to image warping. Journal of the Royal Statistical Society, Series B, 63, 502, 2001. PDF Copyright © 2001 by The Royal Statistical Society [6] N. Duta, A. K. Jain and M. P. Jolly, Learning 2D Shape Models, IEEE Transactions on PAMI (23), No. 5, May 2001, pp. 433-446. PDF Copyright © 2001 by IEEE
  11. 11. [7] N. Duta and M. Sonka, Segmentation and Interpretation of MR Brain Images: An Improved Active Shape Model, IEEE Transactions on Medical Imaging, 17(6), 1998, pp.1049-1062. PDF Copyright © 1998 by IEEE Conference papers with full review [1] N. Duta, Transcription-less Call Routing using Unsupervised Language Model Adaptation, in Proceedings of Interspeech 2008, Brisbane, Australia, 2008, pp. 1562--1565. PDF Copyright © 2008 by ISCA [2] R. Schwartz, T. Colthurst, N. Duta, H. Gish, R. Iyer, C.-L. Kai, D. Liu, O. Kimball, J. Ma, J. Makhoul, S. Matsoukas, L. Nguyen, M. Noamany, R. Prasad, B. Xiang, D-X. Xu, J.-L. Gauvain, L. Lamel, H. Schwenk, G. Adda et L. Chen, Speech Recognition in Multiple Languages and Domains: the 2003 BBN/LIMSI EARS System, Proceedings of ICASSP 2004, Montreal, pp. III:753--756. PDF Copyright © 2004 by IEEE [3] K. Kirchhoff, J. Bilmes, S. Das, N. Duta, M. Egan, G. Ji, F. He, J. Henderson, D. Liu, M. Noamany, P. Schone, R. Schwartz and D. Vergyri, "Novel Approaches to Arabic Speech Recognition: Report from the 2002 Johns-Hopkins Workshop", Proceedings of ICASSP 2003, Hong Kong. PDF Copyright © 2003 by IEEE [4] M.P. Jolly, N. Duta, G. Funka-Lea, Segmentation of the Left Ventricle in Cardiac MR Images, Proceedings of ICCV 01, Vancouver, Canada, Vol. I, pp 501-508. PDF Copyright © 2001 by IEEE [5] R. Fisker, N. Schultz, N. Duta, JM. Carstensen, A General Scheme for Training and Optimization of the Grenander Deformable Template Model, Proceedings of CVPR 00, Hilton Head, SC, Vol I, pp 698-705. PDF Copyright © 2000 by IEEE [6] N. Duta, Road Detection in Panchromatic SPOT Satellite Images, Proceedings of ICPR 00, Barcelona, Spain, Vol IV: 308-311. PDF Copyright © 2000 by IEEE [7] N. Duta, A. K. Jain and M. P. Jolly, Learning 2D Shape Models, Proceedings of CVPR 99, Fort Collins, CO, pp. 8 - 14, 1999. PDF Copyright © 1999 by IEEE
  12. 12. [8] A. Lundervold, N. Duta, T. Taxt and A. K. Jain, Model-guided Segmentation of Corpus Callosum in MR Images, Proceedings of CVPR 99, Fort Collins, CO, pp. 231 - 237, 1999. (An abridged version appeared as: Segmentation of corpus callosum using a deformable model. In Proceedings of the 7th Scientific Meeting of the International Society for Magnetic Resonance in Medicine (ISMRM'99), Philadelphia, PA, USA, 1999). PDF Copyright © 1999 by IEEE [9] N. Duta, A. K. Jain and M. P. Jolly, Learning-Based Object Detection in Cardiac MR Images, Proceedings of ICCV 99, Corfu, Greece, pp. 1210 - 1216. PDF Copyright © 1999 by IEEE [10] A. K. Jain and N. Duta, Deformable matching of hand shapes for user verification, Proceedings of ICIP 99, Kobe, Japan, pp. , 1999. PDF Copyright © 1999 by IEEE [11] N. Duta, M. Sonka and A. K. Jain, Learning Shape Models from Examples using Automatic Shape Clustering and Procrustes Analysis , Proceedings of IPMI 99, Budapest, Hungary, pp. 370-375. PDF Copyright © 1999 by Springer Verlag [12] N. Duta and A. K. Jain, Learning the human face concept from black and white pictures, Proceedings of ICPR 98, Brisbane, Australia, pp. 1365 - 1367. PDF Copyright © 1998 by IEEE [13] N. Duta and M. Sonka, An Improved Active Shape Model: Handling Occlusion and Outliers. Proceedings of ICIAP 97, Florence, Italy, pp. 398-405. PDF Copyright © 1997 by Springer Verlag [14] N. Duta and M. Sonka, Segmentation and Interpretation of MR Brain Images Using an Improved Knowledge Based Active Shape Model, Proceedings of IPMI 97, Poultney, VT, pp. 375-380. PDF Copyright © 1997 by Springer Verlag REFERENCES Dr. John Makhoul Professor Anil K. Jain Chief Scientist & Vice President Dept. of Computer Science & Speech and Language Processing, BBN Engineering Technologies Michigan State University
  13. 13. Cambridge, MA, 02138 East Lansing, MI, 48824 Phone: 617-873-3332 Phone: 517-355-9282 Fax: 617-873-2473 Fax: 517-432-1061 E-Mail: E-Mail: Professor Milan Sonka Dept. of Electrical & Computer Professor Sridhar Mahadevan Engineering Dept. of Computer Science The University of Iowa University of Massachusetts Iowa City, IA, 52242 Amherst, MA 01003 Phone: 319-335-6052 Phone: 413-545-3140 Fax: 319-335-6028 Fax: 413-545-1249 E-Mail: E-Mail: