Ronald
Allan Cole
PERSONAL
DATA
| Office
Address: |
Center
for Spoken Language Research
University
of Colorado, Boulder
Campus
Box 594 Boulder, CO. 80302-0258 |
| Telephone: |
303-735-5109 |
| Fax: |
303-735-5072 |
| Email: |
cole@cslr.colorado.edu |
ACADEMIC
TRAINING
| Institution |
Degree |
Date |
| Univ.
of Rochester |
B.A.
with distinction in Psychology |
1963-1967 |
| Univ.
of California at Riverside |
M.A.
in Psychology |
1967-1969 |
|
Univ.
of California at Riverside |
Ph.D.
in Psychology, Doctoral Dissertation: "Phoneme Independence
in short-term memory" Thesis Advisor: Dr. Terrence Kenney |
1969-1971 |
PROFESSIONAL
EXPERIENCE
| Oct.
1998 - Present |
Professor,
Dept. of Psychology, Department of Computer Science
Director,
Center for Spoken Language Understanding, University of Colorado,
Boulder. |
| Apr.
1992 - Oct. 1998 |
Professor,
Dept. of Computer Science & Engineering
Director,
Center for Spoken Language Understanding Oregon Graduate Institute. |
| Aug.
1988 - Apr. 1992 |
Associate
Professor, Dept. of Computer Science & Engineering, Oregon
Graduate Institute. |
| May
1980 - Aug. 1988 |
Senior
Project Scientist, Department of Computer Science, Carnegie Mellon
University. |
| Jan.
1975 - Apr. 1980 |
Associate
Professor, Department of Psychology, Carnegie Mellon University. |
| Jan.-
June 1974 |
Visiting
Lecturer, Department of Linguistics, Tel-Aviv University, Tel-Aviv,
Israel. |
| July
1974 - Dec. 1974 |
Associate
Professor, Department of Psychology, University of Waterloo. |
| July
1970 - June 1974 |
Assistant
Professor, Department of Psychology, University of Waterloo. |
COURSES TAUGHT
Undergraduate |
Graduate |
Short Course |
| Intro
to Psychology |
Perception |
Computer
Speech Recognition: The
State
of the Art |
| Perception
and Cognition |
Psycholinguistics |
|
| Psycholinguistics |
Time
Perception |
|
| Psychology
of Consciousness |
Speech
Perception |
|
| Research
Methods in Perception |
Acoustic
Phonetic |
|
| Biofeedback |
Spectrogram
Reading The Structure of Spoken Language |
|
MASTERS
THESES SUPERVISED
| Scott,
B.L. |
The
verbal transformation effect as a function of embedded sounds,
University of Waterloo, September, 1971. |
| Freilich,
I. |
Cognitive
rigidity and the alpha rhythm of the human electro-encephalogram;
University of Waterloo, 1972. |
| Singer,
J. |
The
effects of repetition on perception and response, University of
Waterloo, September 1974. |
| Raz,
I. |
The
extent of invariance for Hebrew consonants, Tel-Aviv University,
December 1975. |
| Gopalakrishnan,
M |
Segmenting
speech into broad phonetic categories using neural networks; Oregon
Graduate Institute, August 1990. |
| Rooker,
T. |
Formant
estimation from a spectral slice using neural networks. Oregon Graduate Institute, August 1990. |
| Zhou,
L. |
Speaker-independent
neural network pitch tracker with telephone bandwidth, speech
for computer speech recognition.
Oregon Graduate Institute, April 1991. |
| Roginski,
K. |
A
Neural Network Phonetic Classifier for Telephone Speech, Oregon
Graduate Institute, November 1991. |
|
Jain,
N. |
A
New Approach to Voice Dialing, Oregon Graduate Institute, July
1995. |
DOCTORAL
DISSERTATIONS SUPERVISED
| Scott,
B.L. |
Speech
perception: a theory and application, University of Waterloo,
August 1974. |
| Jakimik,
J. |
The
interaction of sound and knowledge during word recognition from
fluent speech, Carnegie Mellon University, June 1979. |
| Rudnicky,
A. |
The
role of language experience in language perception: An ecogical
theory. Carnegie Mellon University, June 1979. |
| Muthusamy,
Y. |
A
segmental approach to automatic language identification, Oregon
Graduate Institute, July 1993. |
RESEARCH GRANTS
| 2000
– 2005 |
Cole, R., Massaro, D., van Santen, J., Movellan,
J., “ITR: Creating the
Next Generation of Intelligent Animated Conversational Agents,”
$4,000,000, NSF. |
| 1999
- 2002 |
Cole, R., "CRCD: An Interactive Curriculum
in Human Language Technology for Undergraduate and Graduate Education
and Research," $400,000, NSF. |
| 1999
- 2001 |
Cole, R., "Advancing Human Language Technology
in Brazil and the United States Through Collaborative Research
on Portuguese Spoken Language Systems," $199,481, NSF. |
| 1998
- 2002 |
Cole, R., "CARE: Accessible Language Resources
for Research and Education," $1,200,000, NSF. |
| 1998
– 2000 |
Cole,
R., "Accelerating Research Advances in Human Language Technology
through Portable, Accessible Natural Dialogue Systems," $600,000,
ONR/DARPA. |
| 1998 |
Cole, R., “Making Spoken Language Systems Ubiquitous:
Long-Term Research Agenda,” $150,000, Intel Corporation. |
| 1997-1999 |
Cole,
R., Y. Yan, “A Phonetic Knowledge-Guided Approach to Speaker Adaption
for Large Vocabulary Continuous Speech Recognition,” $94,375,
Office of Naval Research. |
| 1997-1998 |
Cole,
R., “Large Vocabulary Continuous Speech Recognition,” $100,000,
fonix Corporation. |
| 1997-1998 |
Cole,
R., “Speech Recognition Evaluation,”$72,675, Nortel Corporation.
|
| 1997-1998 |
Fanty,
M., R. Cole, Y. Yan, “CISE Research Instrumentation: File Server
and Storage Server for Spoken Language Technologies,” $50,000,
National Science Foundation. |
| 1997-2000 |
Cole,
R., M. Macon, D. Massaro, A. Waibel, “Creating Conversational
Agents for Language Training,” $1,800,000, National Science Foundation. |
| 1997-1998 |
Cole,
R., J. de Villiers, D. Massaro, “Bringing Spoken Language Systems
to the Classroom for Learning Language Training with Hearing Impaired
People,” $50,000, National Science Foundation. |
| 1997 |
Cole
R., French, Italian, Mexican, and Caribbean Spanish Data Collection,
$199,906, AT & T. |
| 1997 |
Cole,
R., “Understanding the role of International Collaboration in
Computer Science and Engineering,” (NSF Workshop), $49,946, National
Science Foundation. |
| 1997 |
Cole,
R., Intel Equipment Grant, $200,000, (40 Pentium computers). |
| 1997 |
Cole,
R., "Proposal for the Second NSF Grantees Workshop in Interactive
Systems," $120,925, National Science Foundation. |
| 1996-1998 |
Cole,
R., G. Whitney, D. Jonassen, B. Moeller, S. Carver, "Conceptualization
of Flagship Center for Collaborative Research in Learning and
Human Language Technologies,” $50,000, National Science Foundation. |
| 1996-1997 |
Cole
R., Basic Research/Education Support, $45,913, Intel Corp. |
| 1996-1997 |
Cole,
R., S. Sutton, "Advancing Human Language Technology in Mexico
and the U.S. Through Collaborative Research on Spoken Language
Systems," $100,000, National Science Foundation. |
| 1996-1998 |
Cole,
R., D. Novick, M. Fanty, “Rapid Prototyping of Spoken Language
Systems,” $1,300,000, Office of Naval Research. |
| 1996-1998 |
Cole,
R., M. Fanty, B. Oshika, "Human Language Resources for Research
in Multilanguage Systems, Robust Recognition, and Speaker Identification,"
$746,890, National Science Foundation. |
| 1996 |
Cole,
R., "Toward Robust Speech Recognition: Improved Measures
of Confidence," $20,000, Texas Instruments. |
| 1994-1995 |
Cole,
R., "Instrumentation for Research in Spoken Language Systems,"
$40,000, National Science Foundation. |
| 1994-1996 |
Cole, R., M. Fanty, D. Novick, E. Barnard, H.
Hermansky, "Spoken Dialogue Technology for Appointment Scheduling,"
$1,400,000, U S West |
| 1994-1995 |
Cole,
R., D. Novick, M. Fanty, "Rapid Prototyping and Deployment
of Spoken Language Systems," $450,000, U.S. Office of Naval
Research/U.S. Census Bureau. |
| 1994-1995 |
Cole,
R., "Joint E.C.-U.S. Survey of the State of the Art in Human
Language Technology,” $58,000, National Science Foundation. |
| 1994-1998 |
Cole,
R., "Toward Rapid Development and Deployment of Spoken Language
Systems,” $150,646, U.S. Office of Naval Research/AASERT. |
| 1994-1995 |
Cole,
R., D. Novick, M. Fanty, E. Barnard, H. Hermansky, "Toward
Robust Spoken-Language Systems,” $829,886, NSF/ARPA. |
| 1993-1996 |
Cole,
R., B. Oshika, E. Barnard, “Linguistic Units for Language Identification,”
$697,162, Department of Defense. |
| 1993-1994 |
Cole,
R., "Digital Data Collection Platform and Software,” $41,000,
Linguistic Data Consortium. |
| 1993-1995 |
Cole, R., E. Barnard,
T. Leen, “Task-based Analysis and Stochastic Search
in Neural Networks, $325,000,
Office of Naval Research. |
| 1993-1994 |
Cole,
R., “Telephone Data Collection,” $65,325, Apple Computer Inc. |
| 1993-1996 |
Cole,
R., "Automatic Language Identification: A Distinctive Feature
Approach," $110,323, Office of Naval Research, AASERT Award. |
| 1993-1994 |
Cole,
R., D. Novick, M. Fanty, “Voice questionnaire for the Year 2000
Census,” $125,000, U.S. Bureau of the Census, (grant administered
through the U.S. Office of Naval Research). |
| 1993-1999 |
Cole,
R., D. Novick, “Graduate Traineeships for Under-Represented Minorities
for Research in Spoken-Language Interfaces,” $557,500, National
Science Foundation. |
| 1993-1994 |
Cole,
R., D. Novick, "Real Time Voice Response Questionnaire for
the Year 2000 Census,” $61,912, Digital Equipment Corporation.
|
| 1992 |
Cole,
R., S. Zahorian, L. Hirschman, “Workshop on Spoken Language Understanding,”
$35,700, National Science Foundation. |
| 1992-1995 |
Cole,
R., M. Fanty, "Spoken Letter Recognition,” $360,000/3-year,
National Science Foundation. |
| 1991-1993 |
Cole,
R., M. Fanty, T. Leen, "Neural Network Approaches to Spoken
Letter Recognition,” $230,000, Office of Naval Research. |
| 1992-1993 |
Cole,
R., M. Fanty, T. Leen, "Instrumentation for the Center for
Spoken Language Understanding,” $43,000, National Science Foundation. |
| 1991 |
Fanty,
M., R. Cole, "A Portable Interactive Environment for Computer
Speech Recognition,” $83,000, National Science Foundation. |
| 1991 |
Cole
R., Equipment donation, $108,000, Digital Equipment Corporation. |
| 1991-1992 |
Cole,
R., M. Fanty, "English Alphabet Recognition Over Telephone
Lines," $230,000, US West Advanced Technologies. |
| 1991-1992 |
Cole,
R., "Speaker-Independent Recognition of Arbitrary Sets of
Words," $100,000, US West Technologies. |
| 1990-1992 |
Cole,
R., M. Fanty, Cash donation, $40,000, and equipment donation,
$43,000, Apple Computer. |
| 1990-1992 |
Cole,
R., "Phonetic Classification of Continuous Speech,” $50,000/year,
National Science Foundation. |
| 1990 |
Cole,
R., M. Fanty, "Feasibility of Speech Recognition on a VLSI
Neurocomputer,” Matching Funds Grant, $20,000, OASIS. |
| 1985-1987 |
Cole,
R., "Phonetic Classification of Continuous Speech,"
$580,000, National Science Foundation. |
| 1982-1985 |
Cole,
R., "Knowledge Engineering and Knowledge Acquisition in Speech
Understanding Research," $480,000, National Science Foundation. |
| 1972-1975 |
Cole,
R., "What we hear during speech," $30,000, National
Research Council of Canada. |
| 1972 |
Cole,
R., "Hearing through the skin," Operating grant, $2000,
University of Waterloo Research Grant. |
| 1970-1971 |
Cole,
R., Operating grant, $4000, National Research Council of Canada. |
| 1970-1971 |
Cole,
R., Computing grant, $1300, National Research Council of Canada. |
PUBLICATIONS
|
1.
Jiyong
Ma, Jie Yan and Ron Cole, in CU Animate:Tools for Enabling Conversations
with Animated Characters, in Submitted to: ICSLP-2002, Denver,
Colorado, USA,Sept 2002., pp. 4, USA, Sep, 2002. |
|
2.
Hosom,
J.P., Cole, R.A., “Burst Detection Based on Measurements of Intensity
Discrimination.” Proceedings
of ICSLP 2000. (pp. IV-564 --
IV-567). Bejing, China
2000.
|
|
3.
Shobaki,
K., Hosom, J.P., Cole, R., “The OGI Kids’ Speech Corpus and Recognizers.”
Proceedings of ICSLP 2000. (pp.
IV-564 -- IV-567). Bejing
China 2000.
|
|
4.
Cole,
R.A., Serridge, B., Hosom, J.P., Cronk, A., and Kaiser, E., "A
Platform for Multilingual Reserach in Spoken Dialogue Systems."
Workshop on Multi-lingual Interoperability in Speech Technology
(MIST), The Netherlands, September 1999. |
|
5.
Massaro,
D. W., Cohen, M. M., Daniel, S., & Cole, R. A. (1999). Developing
and evaluating conversational agents. In P. A. Hancock (Ed.) Human
Factors and Ergonomics: Perceptual and Cognitive Principles. (Handbook
of Perception & Cognition, 2nd Edition). (pp. 173-194). San
Diego, CA: Academic Press. |
|
6.
Cole,
R. A., "Tools for research and education in speech science,"
In Proceedings of the International Conference of Phonetic Sciences,
San Francisco, CA, Aug 1999. |
|
7.
T.
Carmell, J.P. Hosom, and R. Cole. A computer-based course in spectrogram
reading. In Proceedings of ESCA/SOCRATES Workshop on Method and
Tool Innovations for Speech Science Education, London, UK, Apr
1999. |
|
8.
Ron
Cole, Dominic W. Massaro, Jacques de Villiers, Brian Rundle, Khaldoun
Shobaki, Johan Wouters, Michael Cohen, Jonas Beskow, Patrick Stone,
Pamela Connors, Alice Tarachow, and Daniel Solcher. New tools
for interactive speech and language training: Using animated conversational
agents in the classrooms of profoundly deaf children. In Proceedings
of ESCA/SOCRATES Workshop on Method and Tool Innovations for Speech
Science Education, London, UK, Apr 1999. |
|
9.
D.
Massaro, Cohen, M. M., Beskow, J., Daniel, S., Cole, R., "Developing
and Evaluating Conversational Agents," Workshop on Embodied
Conversation Characters (WECC), Lake Tohoe,
1998, http://mambo.ucsc.edu:80/psl/wecc3.rtf. |
|
10.
Cosi,
P., J.P. Hosom, J. Schalkwyk, S. Sutton, and R. A. Cole, "Connected
Digit Recognition Experiments with the OGI Toolkit's Neural Network
and HMM-Based recognizers," In Proceedings,
4th IEEE Workshop on Interactive Voice Tehcnology for
Telecommunications Applications (IVTTA-ETWR98), Turin, Italy,
(September 1998). |
|
11.
Cole,
R.A., M. Noel, and V. Noel. The CSLU Speaker Recognition Corpus.
In Proceedings of ICSLP, Sydney, Australia, 1998. |
|
12.
Hosom,
J. P., R. A. Cole, P. Cosi, "Evaluation and Integration of
Neural-Network Training Techniques for Continuous Digit Recognition,"
In Proceedings of the International
Conference on Spoken Language Processing (ICSLP), Sydney,
Australia, (November 1998). |
|
13.
Serridge,
B., R. A. Cole, A. Barbosa, N. Munive, A. Vargas, "Creating
a Mexican Spanish Version of the CSLU Toolkit," In Proceedings of the International Conference on Spoken Language Processing
(ICSLP), Sydney, Australia, (November 1998). |
|
14.
Sutton,
S., R. A. Cole, J. deVilliers, J. Schalkwyk, P. Vermeulen, M.
Macon, Y. Yan, E. Kaiser, B. Rundle, K. Shobaki, P. Hosom, A.
Kain, J. Wouters, D. Massaro, M. Cohen, "Universal Speech
Tools: The CSLU Toolkit,"
In Proceedings of the International
Conference on Spoken Language Processing (ICSLP), Sydney,
Australia, (November 1998). |
|
15.
Cole,
R., T. Carmell, P. Connors, M. Macon, J. Wouters, J. de Villiers,
A. Tarachow, D. Massaro, M.Cohen, J. Beskow, J. Yang, U. Meier,
A. Waibel, P. Stone, G. Fortier,
A. Davis, C. Soland, “Intelligent Animate Agents for Interactive
Language Training,” presented at STILL ’98, Stockholm, Sweden,
May 1998. |
|
16.
Yan,
Y., X. Wu, J. Schalkwyk, R. A. Cole, "Development of CLSU
LVCSR: The 1997 DARPA HUB4 Evaluation System," In DARPA Broadcast News Transcription and Understanding Workshop, (1998). |
|
17.
Cole,
R., S. Sutton, Y. Yan, P. Vermeulen, M. Fanty, “Accessible technology
for interactive systems: A new approach to spoken language research,”
In Proceedings of the International Conference
on Acoustics, Speech and Signal Processing, Seattle, WA.,
1998. |
|
18.
Cole,
R., D. G. Novick, M. Fanty, P. Vermeulen and S. Sutton, "Experiments
with a Spoken Dialogue System for Taking the U.S. Census,"
Special Edition: Speech Communications, (1998, in Press). |
|
19.
Cole,
R., & V. Zue, 1997. Spoken
Language Input. In Cole,
R.A., J. Mariani, H. Uszkoriet, A. Zaenen, & V. Zue (eds.),
Survey of the State of the Art in Human Language Technology, (1, pp. 1-49), Cambridge University Press. |
|
20.
Cole,
R., 1997. Spoken Output
Technologies. In Cole,
R.A., J. Mariani, H. Uszkoriet, A. Zaenen, & V. Zue (eds.),
Survey of the State of the Art in Human Language Technology, (5, pp. 165-214), Cambridge University Press. |
|
21.
Cole,
R., 1997. Mathematical
Methods. In Cole, R.A., J. Mariani, H. Uszkoriet,
A. Zaenen, & V. Zue (eds.), Survey
of the State of the Art in Human Language
Technology, (11, pp. 337-369), Cambridge University Press. |
|
22.
Cole,
R., 1997. Language Resources.
In Cole, R.A., J. Mariani, H. Uszkoriet, A. Zaenen, & V. Zue
(eds.), Survey of the State of the Art in Human
Language Technology,
(12, pp. 381-403), Cambridge University Press. |
|
23.
Computer
Science and Telecommunications Board, National Research Council,
“More Than Screen Deep: Toward
Every-Citizen Interfaces to the Nation’s Information Infrastructure,”
National Academy Press, Washington, D.C., 1997. |
|
24.
Sutton, S., E. Kaiser,
A. Cronk, and R. Cole, "Bringing spoken language systems
to the classroom", EUROSPEECH'97,
Rhodes, Greece, (1997). |
|
25.
Tu X., Y. Yan, R. Cole,
"Matching training and testing criteria in hybrid speech
recognition systems", EUROSPEECH'97,
Rhodes, Greece (1997). |
|
26.
Cole R., S. Sutton, M.
Fanty, E. Kaiser, J. Schalkwyk, J. de Villiers, A. Cronk, Colton,
"Cyberspeech: Password to Cyberspace," DAIC Workshop, Seattle, WA, (1997). |
|
27.
Yan, Y., M. Fanty, R.
Cole, “Speech recognition using neural networks with forward-backward
probability generated targets,” Proceedings
of the International Conference on Acoustics
Speech and Signal Processing, Munich, (1997). |
|
28.
Hosom, J.P., R. Cole,
“A diphone-based digit recognition system using neural networks,”
Proceedings of the International Conference
on Acoustics Speech and Signal Processing, Munich, (1997). |
|
29.
Cole, R. A., D. G. Novick,
M. Fanty, P. Vermeulen, S. Sutton, "Experiments with a spoken
dialogue system for taking the U.S. census," Free Speech Journal, (1996). |
|
30.
Yan Y., E. Barnard, R.
Cole, “Development of an approach to automatic language identification
based on phone recognition,” Computer,
Speech & Language, Vol. 10(1), pp. 37-54, January, (1996). |
|
31.
Sutton, S., D. Novick,
R. Cole, M. Fanty, “Building 10,000 spoken-dialogue systems,”
Proceedings of the International Conference
on Spoken Language Processing, Philadelphia, PA, (1996). |
|
32.
Hu, Z., J. Schalkwyk,
E. Barnard, R. Cole, “Speech recognition using syllable-like units,”
Proceedings of the International Conference
on Spoken Language Processing, Philadelphia, PA, (1996). |
|
33.
Cole, R., Y. Yan, T.
Bailey, “The influence of bigram constraints on word recognition
by humans: Implications for computer speech recognition,” Proceedings of International Conference on Spoken Language Processing, Philadelphia, PA, (1996). |
|
34.
Cole, R., Y. Yan, B.
Mak, M. Fanty, T. Bailey, “The contribution of consonants versus
vowels in word recognition of fluent speech,” Proceedings
of the International Conference on Acoustics,
Speech and Signal Processing, Atlanta, Georgia, (1996). |
|
35.
Jain, N., R. Cole, E.
Barnard, “Creating speaker-specific phonetic templates with a
speaker-independent phonetic recognizer: Implications for voice
dialing,” Proceedings of the International Conference on Acoustics, Speech
and Signal Processing, Atlanta, Georgia, (1996). |
|
36.
Colton, L. D., R. Cole,
D. G. Novick, S. Sutton, “A laboratory course for designing and
testing spoken dialogue systems,” Proceedings
of the International Conference on Acoustics, Speech and Signal Processing, Atlanta, Georgia, (1996). |
|
37.
Hu, Z., E. Barnard, R.
Cole, "Transition-based feature extraction within frame-based
recognition," Proceedings
of the Fourth European Conference on Speech Communication and
Technology, Madrid, Spain, (1995). |
|
38.
Colton, L. D., M. Fanty,
R. Cole, "Second pass verification improves N-Way forced
choice recognition and out-of-vocabulary rejection," Proceedings of the Fourth European Conference on Speech Communication
and Technology, Madrid, Spain, (1995). |
|
39.
Noel, M., R. Cole, T.
Durham, T. L. Lander, "New telephone speech corpora at CSLU,"
Proceedings of the Fourth European Conference
on Speech Communication and Technology, Madrid, Spain, (1995). |
|
40.
Lander, T., R. Cole,
B. Oshika, M. Noel, "The OGI 22 language telephone speech
corpus," Proceedings of the Fourth European Conference
on Speech | |