Ryota NISHIMURA

Profile Information

Affiliation: Associate Professor, Graduate School of Technology, Industrial and Social Science, The University of Tokushima

Degree: Ph.D. in Engineering(Toyohashi University)

Researcher number: 50635878
J-GLOBAL ID: 201101016974366738
researchmap Member ID: B000000477

External link: http://ryota.nishimura.name/

I am currently an Assistant Professor in the Graduate School of Science and Technology, Keio University, Japan. I received the B.E., M.E. and Ph.D. degrees from Toyohashi University of Technology, Japan, in 2005, 2007 and 2010, respectively. I joined the faculty of Toyohashi University, in 2011, as a Researcher. From 2011 to 2012, I joined the faculty of Nagoya University as a Technical Assistant. From 2012 to 2015, I joined the faculty of Nagoya Institute of Technology as an Assistant Professor. Since 2015 I has been an Assistant Professor in the Keio University. I was developing some Spoken Dialogue System. I have published 5 transaction papers and 16 proceeding papers.

Research Interests

Spoken Dialogue Systems

Research Areas

Education

Apr, 2007 - Dec, 2010

電子・情報工学専攻, 工学研究科, Toyohashi University of Technology
Dec, 2010

豊橋技術科学大学大学院工学研究科博士後期課程電子・情報工学専攻修了
Apr, 2005 - Mar, 2007

情報工学専攻, 工学研究科, Toyohashi University of Technology
Mar, 2007

豊橋技術科学大学大学院工学研究科情報工学専攻修士課程修了
Apr, 2003 - Mar, 2005

情報工学科, 工学部, Toyohashi University of Technology
Apr, 1998 - Mar, 2003

電子情報工学科, National Institute of Technology, Suzuka College

Research History

Oct, 2018 - Present

徳島大学大学院社会産業理工学研究部講師
Apr, 2017 - Sep, 2018

Researcher, Graduate School of Technology, Industrial and Social Science, Tokushima University
Apr, 2015 - Mar, 2017

Assistant Professor, Graduate School of Science and Technology, School of Science for OPEN and Environmental Systems, Keio University
Apr, 2012 - Mar, 2015

Assistant Professor, Nagoya Institute of Technology
Feb, 2011 - Mar, 2012

Technical Assistant, Nagoya University
Dec, 2010 - Jan, 2011

Researcher, Toyohashi University of Technology

Committee Memberships

Mar, 2020 - Dec, 2022

Technical Program Committee, International Conference on Natural Language Processing and Artificial Intelligence (NLPAI)
Jan, 2021 - Mar, 2022

Conference Chair, IEEE LifeTech (Global Conference on Life sciences and Technologies)
Apr, 2008 - Apr, 2020

会員, Institute of Electronics, Information and Communication Engineers
Apr, 2006 - Apr, 2020

会員, The Acoustical Society of Japan
Apr, 2005 - Apr, 2020

会員, The Japanese Society for Artificial Intelligence
Apr, 2005 - Apr, 2020

会員, Information Processing Society of Japan
Feb, 2020 - Mar, 2020

自動文字起こし・AI要約技術活用事業に係る企画提案評価委員会，委員, Tokushima Prefectural Government
2020 - 2020

Conference Chair, IEEE Global Conference on Consumer Electronics (GCCE)
2019 - 2020

Chair, IEEE Consumer Electronics Society West Japan Joint Chapter
2019 - 2020

Publication Chair, IEEE LifeTech (Global Conference on Life sciences and Technologies)
2018 - 2020

Technical Program Committee Chair, IEEE Global Conference on Consumer Electronics (GCCE)
2017 - 2020

Organized Session Chair (OS-SLP), IEEE Global Conference on Consumer Electronics (GCCE)
2017 - 2020

Senior Member, IEEE
2015 - 2020

Organized Session Chair (OS-AIR), IEEE Global Conference on Consumer Electronics (GCCE)
2014 - 2020

Member, IEEE
2012 - 2020

査読委員, Information Processing Society of Japan
Oct, 2018 - Oct, 2018

Treasurer, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE2018)
2018 - 2018

Reviewer, The IEEE Region 10 Symposium (IEEE TENSYMP-2018)
2018 - 2018

Treasurer, IEEE Global Conference on Consumer Electronics (GCCE)
Oct, 2017 - Oct, 2017

Conference Chair, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE2017)

Professional Memberships

Awards

Oct, 2019

Best paper award, A new corpus of elderly Japanese speech for acoustic modeling, and a preliminary investigation of dialect-dependent speech recognition, IEEE

Fukuda Meiko, Nishimura Ryota
Nov, 2013

名古屋工業大学職員褒賞優秀賞, JST CREST uDialogue Project, Nagoya Institute of Technology

Nishimura Ryota
Feb, 2007

最優秀特別研究発表賞, 人間同士の対話現象を模倣した音声対話システムの研究, Toyohashi University of Technology

Nishimura Ryota
Dec, 2004

優秀発表賞, 自然な発話タイミングを生成する決定木の作成とその評価, Toyohashi University of Technology

Nishimura Ryota

Books and Other Publications

Introduction to Data Preprocessing in AI and Machine Learning --- Getting Started with Python

Kita Kenji, Nishimura Ryota, Matsumoto Kazuyuki

Kagakujyoho Shuppan Co., Ltd., Jun 16, 2021
A Multimodal Control System for Autonomous Vehicles Using Speech, Gesture, and Gaze Recognition

Kitaoka Norihide, takuma nakagawa, Nishimura Ryota, Yoshio Ishiguro, Shin'ichi Kojima, Shin Ohsuga

Walter de Gruyter & Co., 2020
Design of Reminiscence Therapy System for Elderly People with Dementia

Uchiya Takahiro, Nishimura Ryota, Hirano Takahiro, Sakurai Masaru

Springer, Nov 2, 2018
ここまで作れる! Raspberry Pi 実践サンプル集

太田一穂, 岡嶋和弘, Nishimura Ryota, 樋山淳

マイナビ出版, Jul 14, 2017
Integrating Symbols and Signals Based on Stream Reasoning and ROS

Morita Takeshi, Sugawara Yu, Nishimura Ryota, Yamaguchi Takahira

Springer, Aug 7, 2016
Development and evaluation of spoken dialog systems with one or two agents through two domains

Todo Yuki, Nishimura Ryota, Yamamoto Kazumasa, Nakagawa Seiichi

Springer, Sep 1, 2013
A spoken dialog system for chat-like conversations considering response timing

Nishimura Ryota, Kitaoka Norihide, Nakagawa Seiichi

Springer, Sep, 2007

Misc.

PRINTEPS : A Total Intelligent Application Development Platform based on ROS and Its Application

108 30-35, Jun 5, 2016
エージェントを用いたスマートフォン向け音声対話システム拡張機構の開発と評価

仲野良佑, 打矢隆弘, 西村良太, 山本大介, 内匠逸

研究報告知能システム（ICS）, 2015(2) 1-8, Mar 13, 2015
Analysis and Evaluation of Spoken Dialog System with Multiple Agents

2013(18) 1-7, Jan 25, 2013
Analysis and Evaluation of Spoken Dialog System with Multiple Agents

2013(18) 1-7, Jan 25, 2013
Estimation of Dialogue States in Database Search Spoken Dialogue System

Ryota Nishimura, Kazunori Komatani

IPSJ SIG Notes, 2012(20) 1-7, Jan 27, 2012
応答タイミングを考慮した雑談音声対話システム

西村良太, 北岡教英, 中川聖一

言語・音声理解と対話処理研究会, 46 21-26, Mar 3, 2006

Papers

Response Type Selection for Chat-like Spoken Dialog Systems Based on LSTM and Multi-task Learning (accepted)

Kengo Ohta, Nishimura Ryota, Kitaoka Norihide

Speech Communication, Vol.133(No.2021) 23-30, Oct, 2021 Peer-reviewed
Normalization of Transliterated Mongolian Words Using Seq2Seq Model with Limited Data (accepted)

BYAMBADORJ ZOLZAYA, Nishimura Ryota, Altangerel Ayush, Kitaoka Norihide

ACM Transactions on Asian and Low-Resource Language Information Processing, Jul, 2021 Peer-reviewed
End-to-end recognition of streaming Japanese speech using CTC and local attention

Chen JiaHao, Nishimura Ryota, Kitaoka Norihide

APSIPA Transactions on Signal and Information Processing, Vol.9(No.e25) 1-7, Nov 23, 2020 Peer-reviewed
Example Phrase Adaptation Method for Customized, Example-Based Dialog System Using User Data and Distributed Word Representations

Kitaoka Norihide, eichi seto, Nishimura Ryota

IEICE Transactions on Information and Systems, Vol.E103-D(No.11) 2332-2339, Jul 30, 2020 Peer-reviewed
Environmental Sounds Recognition with Convolutional-LSTM

Akihisa Komatsu, Ryota Nishimura, Norihide Kitaoka

2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), Oct, 2019
A New Corpus of Elderly Japanese Speech for Acoustic Modeling, and a Preliminary Investigation of Dialect-Dependent Speech Recognition

Meiko Fukuda, Ryota Nishimura, Hiromitsu Nishizaki, Yurie Iribe, Norihide Kitaoka

2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA), Oct, 2019
Small-Footprint Magic Word Detection Method Using Convolutional LSTM Neural Network

Taiki Yamamoto, Ryota Nishimura, Masayuki Misaki, Norihide Kitaoka

Interspeech 2019, Sep 15, 2019
Study on Editing Method to Improve Speech Intelligibility Based on Speech Perception Characteristics of Elderly People

Nishimura Ryota, Nagao Takumi, Ichimanda Ayato, Kitaoka Norihide

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, Vol.30(No.6) 840-845, Dec 15, 2018
Study on Editing Method to Improve Speech Intelligibility Based on Speech Perception Characteristics of Elderly People

Ryota Nishimura, Takumi Nagao, Ayato Ichimanda, Norihide Kitaoka

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, 1-6, Dec 15, 2018 Peer-reviewed
Web-based environment for user generation of spoken dialog for virtual assistants

Nishimura Ryota, Yamamoto Daisuke, Uchiya Takahiro, Takumi Ichi

EURASIP Journal on Audio, Speech, and Music Processing, Vol.2018(No.1) 1-13, Nov 16, 2018 Peer-reviewed
Customization of an example-based dialog system with user data and distributed word representations

Eichi Seto, Ryota Nishimura, Norihide Kitaoka

2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Nov, 2018
Mapping Acoustic Vector Space and Document Vector Space by RNN-LSTM

Ryota Nishimura, Miho Higaki, Norihide Kitaoka

2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), Oct, 2018
Construction of a Corpus for Elderly Japanese Speech Recognition

Meiko Fukuda, Hiromitsu Nishizaki, Ryota Nishimura, Yurie Iribe, Norihide Kitaoka

2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), Oct, 2018
Multi-modal Geometry Tutoring System Using Speech and Touchscreen Figure Tracing

Kanta Kiyohara, Ryota Nishimura, Norihide Kitaoka

2018 IEEE 7th Global Conference on Consumer Electronics (GCCE), Oct, 2018
RNN-LSTMによる音響ベクトル空間と文書ベクトル空間とのマッピング

Nishimura Ryota, 檜垣美帆, Kitaoka Norihide

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, Vol.30(No.4) 628-633, Aug 15, 2018
RNN-LSTMによる音響ベクトル空間と文書ベクトル空間とのマッピング

Ryota Nishimura, 檜垣美帆, Norihide Kitaoka

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, Vol.30(No.4) 628-633, Aug 15, 2018 Peer-reviewed
Construction of dialog database for development of spoken dialog breakdown detection methods

Kazuaki Kajinami, Ryota Nishimura, Norihide Kitaoka

2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA), Aug, 2018
Selecting Type of Response for Chat-like Spoken Dialogue Systems Based on Acoustic Features of User Utterances

Ohta Kengo, Nishimura Ryota, Kitaoka Norihide

North Atlantic University Union International Journal of Computers, Vol.2018(No.12) 1248-1252, Jun, 2018 Peer-reviewed
MMDAE: Dialog scenario editor for MMDAgent on the web browser

Nishimura Ryota, Yamamoto Daisuke, Uchiya Takahiro, Takumi Ichi

ICT Express, Vol.5(No.1) 47-51, Apr 12, 2018 Peer-reviewed
Recognizing emotions from speech using a physical model

Kitaoka Norihide, Segawa Shuhei, Nishimura Ryota, Takeda Kazuya

Acoustical Science and Technology, Vol.39(No.2) 167-170, Feb, 2018 Peer-reviewed

Presentations

111

Text to speech system for low resource languages by cross-lingual transfer learning and data augmentation

ZOLZAYA BYAMBADORJ, Nishimura Ryota, Altangerel Ayush, 太田健吾, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 12, 2021
Building low-resource speech recognizer: Transfer learning and data augmentation

NARANGEREL PUREVDORJ, Nishimura Ryota, Altangerel Ayush, 太田健吾, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 12, 2021
Development of a multimodal dialog system with photorealistic CG agent

Kitaoka Norihide, Nishimura Ryota, Kengo Ohta, Sunao Hara

日本音響学会研究発表会講演論文集, Mar 10, 2021
Developing a Japanese End-to-End Speech Synthesis Server Considering Accent Phrases

Kengo Ohta, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 10, 2021
Construction of EARS, a Speech Corpus for the Elderly, and Preliminary Study of Its Application to Speech Recognition

Fukuda Meiko, Yurie Iribe, Hiromitsu Nishizaki, Kazumasa Yamamoto, Nishimura Ryota, Kitaoka Norihide

IPSJ SIG Technical Report, Oct 22, 2020
A Study on the Analysis of Comics Using Deep Learning

tsubasa fukuda, Nishimura Ryota, Yoshida Minoru, Matsumoto Kazuyuki, Kita Kenji

令和2年度電気・電子・情報関係学会四国支部連合大会講演論文集, Sep 26, 2020
Tooth detection and segmentation from panoramic radiographs using Mask R-CNN

kazuki hara, kohei torii, Matsumoto Kazuyuki, Yoshida Minoru, Nishimura Ryota, Tsuruki Jiro, 小林健一郎, Kita Kenji

令和2年度電気・電子・情報関係学会四国支部連合大会講演論文集, Sep 26, 2020
Construction of End-to-End Japanese Speech Synthesis System with Emotional Expression

taiga yamazaki, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Sep 9, 2020
Improving Speech Recognition for the Elderly: A New Corpus of Elderly Japanese Speech and Investigation of Acoustic Modeling for Speech Recognition

Fukuda Meiko, Hiromitsu Nishizaki, Yurie Iribe, Nishimura Ryota, Kitaoka Norihide

Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), May 13, 2020
NORMALIZATION OF TRANSLITERATED WORDS USING SEQ2SEQ MODEL WITH SPELL CHECKER

zolzaya, Nishimura Ryota, Altangerel Ayush, Kitaoka Norihide

言語処理学会発表論文集, Mar 19, 2020
Streaming speech recognition with Uni-directional LSTM and local attention

CHEN Jiahao, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Construction of elderly Japanese speech corpus for acoustic modeling and analysis of the influence of age and dialects on elderly speech recognition

Fukuda Meiko, Hiromitsu Nishizaki, Yurie Iribe, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Evaluation of Language Model for Spontaneous Speech Recognition Trained Using Written Language-to-Spoken Language Text Conversion

Yuya Obashi, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
A spoken dialogue system with anaphoric analysis for spontaneous utterances

Raita Mori, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Construction of Geometric Problem Solving Assist Sys- tem Based on Integrative Understanding of Speech and Finger Pointing

Kanta Kiyohara, Nishimura Ryota, Kitaoka Norihide

情報処理学会全国大会講演論文集, Mar 6, 2020
Mapping of acoustic vector sequence and document vector sequence

Tomoaki Goto, Nishimura Ryota, Kita Kenji

情報処理学会全国大会講演論文集, Mar 6, 2020
E2E Streaming Speech Recognition Using CTC and Local Attention

Chen, Jiahao, Nishimura, Ryota, Kitaoka, Norihide

Proc. NCSP'20, Mar, 2020
E2E Streaming Speech Recognition Using CTC and Local Attention

Chen Jiahao, Nishimura Ryota, Kitaoka Norihide

Proc. NCSP'20, Feb 28, 2020
A New Corpus of Elderly Japanese Speech for Acoustic Modeling, and a Preliminary Investigation of Dialect Dependent Speech Recognition

Fukuda Meiko, Nishimura Ryota, Hiromitsu Nishizaki, Yurie Iribe, Kitaoka Norihide

Proceedings of The 22nd Conference of the Oriental COCOSDA (Oriental-COCOSDA2019), Oct 25, 2019
Automatic Conversion of Written Language into Spoken Language Using a Sequence-to-Sequence Model Trained with a Parallel Corpus

Yuya Obashi, Nishimura Ryota, Kitaoka Norihide

Proceedings of The 22nd Conference of the Oriental COCOSDA (Oriental-COCOSDA2019), Oct 25, 2019

Teaching Experience

Research Projects

スムーズな対話のための対話テンポのリアルタイム制御に基づく音声対話システム

Grants-in-Aid for Scientific Research, Apr, 2019 - Mar, 2022

西村良太
高齢者を対象とした音声認識・対話システム基盤技術の構築

Grants-in-Aid for Scientific Research, Apr, 2019 - Mar, 2022

北岡教英