Erica Cooper

Profile Information

Affiliation: Digital Content and Media Sciences Research Division, National Institute of Informatics

J-GLOBAL ID: 201901012372603805
researchmap Member ID: B000350739

External link: http://www.cs.columbia.edu/~ecooper/cv.pdf

Erica Cooper completed the Ph.D. degree at Columbia University in the City of New York in 2019 with a research focus on text-to-speech synthesis for low-resource languages. She has joined the National Institute of Informatics in February 2019 to contribute to the JST-ANR CREST VoicePersonae project.

Research Interests

Research Areas

Informatics / Perceptual information processing / Speech Information Processing

Education

Sep, 2010 - Feb, 2019

Ph.D., Computer Science, Columbia University
Sep, 2009 - Jun, 2010

Master of Engineering, Electrical Engineering and Computer Science, Massachusetts Institute of Technology
Sep, 2005 - Jun, 2009

Bachelor of Science, Electrical Engineering and Computer Science, Massachusetts Institute of Technology

Committee Memberships

Dec, 2020 - Present

Speech and Language Technical Committee (Associate Member), Institute of Electrical and Electronics Engineers
Dec, 2021 - Mar, 2022

VoiceMOS Challenge 2022 Organizing Committee
Aug, 2021 - Aug, 2021

Organizing Committee, Workshop for Young Female Researchers in Speech Science & Technology (YFRSW)

Papers

Analyzing Language-Independent Speaker Anonymization Framework under Unseen Conditions

Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi, Natalia Tomashenko

Interspeech 2022, Sep, 2022 Peer-reviewed
The VoiceMOS Challenge 2022

Wen-Chin Huang, Erica Cooper, Yu Tsao, Hsin-Min Wang, Tomoki Toda, Junichi Yamagishi

Interspeech 2022, Sep, 2022 Peer-reviewedCorresponding author
Language-Independent Speaker Anonymization Approach using Self-Supervised Pre-Trained Models

Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi, Natalia Tomashenko

Odyssey 2022: The Speaker and Language Recognition Workshop, Jun, 2022 Peer-reviewed
Attention Back-End for Automatic Speaker Verification with Multiple Enrollment Utterances

Chang Zeng, Xin Wang, Erica Cooper, Xiaoxiao Miao, Junichi Yamagishi

ICASSP 2022, May, 2022 Peer-reviewed
On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis

Cheng-I Lai, Erica Cooper, Yang Zhang, Shiyu Chang, Kaizhi Qian, Yi-Lun Liao, Yung-Sung Chuang, Alexander Liu, Junichi Yamagishi, David Cox, James Glass

ICASSP 2022, May, 2022 Peer-reviewed
LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speech

Wen-Chin Huang, Erica Cooper, Junichi Yamagishi, Tomoki Toda

ICASSP 2022, May, 2022 Peer-reviewed
Generalization Ability of MOS Prediction Networks

Erica Cooper, Wen-Chin Huang, Tomoki Toda, Junichi Yamagishi

ICASSP 2022, May, 2022 Peer-reviewedLead author
Use of Speaker Recognition Approaches for Learning and Evaluating Embedding Representations of Musical Instrument Sounds

Xuan Shi, Erica Cooper, Junichi Yamagishi

IEEE/ACM Transactions on Audio, Speech, and Language Processing, 30 367-377, Jan, 2022
Multi-task learning in utterance-level and segmental-level spoof detection

Lin Zhang, Xin Wang, Erica Cooper, Junichi Yamagishi

ASVspoof 2021, Sep, 2021 Peer-reviewed
An Initial Investigation for Detecting Partially Spoofed Audio

Lin Zhang, Xin Wang, Erica Cooper, Junichi Yamagishi, Jose Patino, Nicholas Evans

Interspeech 2021, Sep, 2021 Peer-reviewed
How do Voices from Past Speech Synthesis Challenges Compare Today?

Erica Cooper, Junichi Yamagishi

11th ISCA Speech Synthesis Workshop, Aug, 2021 Peer-reviewedLead author
Text-to-Speech Synthesis Techniques for MIDI-to-Audio Synthesis

Erica Cooper, Xin Wang, Junichi Yamagishi

11th ISCA Speech Synthesis Workshop, Aug, 2021 Peer-reviewed
Exploring Disentanglement with Multilingual and Monolingual VQ-VAE

Jennifer Williams, Jason Fong, Erica Cooper, Junichi Yamagishi

11th ISCA Speech Synthesis Workshop, Aug, 2021 Peer-reviewed
Learning Disentangled Phone and Speaker Representations in a Semi-Supervised VQ-VAE Paradigm

Jennifer Williams, Yi Zhao, Erica Cooper, Junichi Yamagishi

ICASSP 2021, Jun, 2021 Peer-reviewed
How Similar or Different Is Rakugo Speech Synthesizer to Professional Performers?

Shuhei Kato, Yusuke Yasuda, Xin Wang, Erica Cooper, Junichi Yamagishi

ICASSP 2021, Jun, 2021 Peer-reviewed
Pretraining Strategies, Waveform Model Choice, and Acoustic Configurations for Multi-Speaker End-to-End Speech Synthesis

Erica Cooper, Xin Wang, Yi Zhao, Yusuke Yasuda, Junichi Yamagishi

ArXiv, Nov, 2020 Lead author
Improved Prosody from Learned F0 Codebook Representations for VQ-VAE Speech Waveform Reconstruction

Yi Zhao, Haoyu Li, Cheng-I Lai, Jennifer Williams, Erica Cooper, Junichi Yamagishi

Interspeech 2020, Oct, 2020 Peer-reviewed
Can Speaker Augmentation Improve Multi-Speaker End-to-End TTS?

Erica Cooper, Cheng-I Lai, Yusuke Yasuda, Junichi Yamagishi

Interspeech 2020, Oct, 2020 Peer-reviewed
Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddings

Erica Cooper, Cheng-I Lai, Yusuke Yasuda, Fuming Fang, Xin Wang, Nanxin Chen, Junichi Yamagishi

ICASSP 2020, May, 2020 Peer-reviewed
Modeling of Rakugo Speech and Its Limitations: Toward Speech Synthesis That Entertains Audiences

Shuhei Kato, Yusuke Yasuda, Xin Wang, Erica Cooper, Shinji Takaki, Junichi Yamagishi

IEEE Access, 8 138149-138161, 2020 Peer-reviewed

Misc.

Deepfakes: Synthetic media in the age of deep learning

Erica Cooper, Xin Wang

nextrends Asia, Oct, 2021 Invited

Presentations

Objective Evaluation in TTS

Erica Cooper

KTH Seminar on Speech Synthesis Evaluation, Jun 15, 2022, KTH Royal Institute of Technology, Department of Speech, Music, and Hearing Invited
The VoiceMOS Challenge 2022

Erica Cooper, Wen-Chin Huang

Mar 23, 2022, Special Interest Group on Spoken Language Processing, Information Processing Society of Japan Invited
Text-to-Speech Synthesis Techniques for MIDI-to-Audio Synthesis

Erica Cooper, Xin Wang

Nov 3, 2021, Division of Speech, Music and Hearing, KTH Invited
Deepfakes: High-tech Illusions to Trick the Human Brain

Sascha Frühholz, Erica Cooper, Xin Wang, Florence Steiner

Science Agora 2021, Oct 11, 2021 Invited
How do Voices from Past Speech Synthesis Challenges Compare Today?

Erica Cooper

May 31, 2021 Invited
Text-to-speech Synthesis and Beyond Speech Generation

Erica Cooper, Yi Zhao

Nov 6, 2019 Invited
Text-to-Speech Synthesis Using Found Data

Erica Cooper

Apr 26, 2018 Invited

Research Projects

Language-independent, multi-modal, and data-efficient approaches for speech synthesis and translation

Grants-in-Aid for Scientific Research Grant-in-Aid for Scientific Research (C), Japan Society for the Promotion of Science, Apr, 2021 - Mar, 2024

Erica Cooper, Yi Zhao, Canasai Kruengkrai
Can AI storytellers entertain people? - Improving the expressive power of rakugo text-to-speech and automatically generating rakugo stories

Challenging Research, Japan Society for the Promotion of Science, Jul, 2021 - Mar, 2023

Junichi Yamagishi, Erica Cooper
Optimizing a Speech Anti-spoofing Database

AI Focused Research Awards Program in Japan, Google, Oct, 2021 - Sep, 2022

Junichi Yamagishi, Xin Wang, Erica Cooper
Enhanced End-to-End Multi-Instrument MIDI/sheet-to-Music Synthesis with Timbre and Style Transfer

AIP Challenge Program, JST CREST AIP, Jun, 2021 - Mar, 2022

Xin Wang, Erica Cooper
Expressive End-to-End MIDI-to-Performance Music Synthesis

TSUBAME Encouragement Program for Young/Female Users, JHCPN, Apr, 2021 - Mar, 2022

Erica Cooper
Improved speech quality assessment models with a large-scale listening test dataset and the application to voice conversion

Colab, JST CREST, May, 2021 - Feb, 2022

Yi Zhao, Erica Cooper, WenChin Huang
Deep Generative Approach to Anti-spoofing Problems

AI Focused Research Awards Program in Japan, Google, Oct, 2020 - Sep, 2021
Transfer Learning for End-to-End Multi-Instrument MIDI-to-Music Synthesis

AIP Challenge Program, JST CREST AIP, Jun, 2020 - Mar, 2021

Erica Cooper, Xin Wang, Yi Zhao
Transfer Learning for End-to-End Multi-Instrument MIDI-to-Music Synthesis

TSUBAME Encouragement Program for Young/Female Users, Tokyo Institute of Technology, Apr, 2020 - Mar, 2021

Erica Cooper
Encoder Factorization for Capturing Dialect and Articulation Level in End-to -End Speech Synthesis

Grant-in-Aid for Research Activity Start-up, Japan Society for the Promotion of Science, Aug, 2019 - Mar, 2021

Erica Cooper
Robust and all-purpose neural source-filter models

AI Focused Research Awards Program in Japan, Google, Oct, 2019 - Sep, 2020

Junichi Yamagishi, Xin Wang, Erica Cooper

Academic Activities

DDAM Workshop 2022

Peer review

Jul 11, 2022 - Jul 25, 2022
NeurIPS 2022

Peer review

Jul 16, 2022 - Jul 22, 2022
Interspeech 2022

Peer review

Apr 10, 2022 - May 9, 2022
ICASSP 2022 (meta-reviewing)

Peer review

Nov 17, 2021 - Jan 17, 2022
Computer Speech and Language

Peer review

Oct 11, 2021 - Oct 18, 2021
ISCA Speech Synthesis Workshop 2021, keynote talk chair: Lior Wolf, "Deep Audio Conversion Technologies and Their Applications in Speech, Singing, and Music"

Panel moderator, session chair, etc.

(Budapest, Hungary (online)), Aug 26, 2021 - Aug 26, 2021
ASRU 2021

Peer review

Jul 22, 2021 - Aug 13, 2021
ASVspoof 2021

Peer review

Jul 26, 2021 - Aug 6, 2021
ICASSP 2021, poster session chair: "Speech Synthesis 7: General Topics" and "Voice Conversion & Speech Synthesis: Singing Voice & Other Topics"

Panel moderator, session chair, etc.

(Toronto, Canada (online)), Jun 11, 2021 - Jun 11, 2021
ISCA Speech Synthesis Workshop 2021

Peer review

May 6, 2021 - Jun 11, 2021
Interspeech 2021

Peer review

Apr 11, 2021 - May 1, 2021
Computer Speech and Language

Peer review

Mar 8, 2021 - Apr 3, 2021
NAACL 2021 (area chair)

Peer review

Dec 11, 2020 - Feb 8, 2021
ICASSP 2021 (meta-reviewing)

Peer review

Jan 4, 2021 - Jan 19, 2021
IEEE Transactions on Audio, Speech and Language Processing

Peer review

Oct, 2020 - Oct, 2020
Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020

Peer review

Sep, 2020 - Sep, 2020
SLT 2021

Peer review

Aug, 2020 - Aug, 2020
International Conference on Machine Learning Workshop: Self-Supervision in Audio and Speech

Peer review

Jun 15, 2020 - Jun 30, 2020
Interspeech 2020

Peer review

May 28, 2020 - Jun 18, 2020
Speech Communication

Peer review

Dec 23, 2019 - Jan 27, 2020