Ryota NISHIMURA

Profile Information

Affiliation: Associate Professor, Graduate School of Technology, Industrial and Social Science, The University of Tokushima

Degree: Ph.D. in Engineering(Toyohashi University)

Researcher number: 50635878
J-GLOBAL ID: 201101016974366738
researchmap Member ID: B000000477

External link: http://ryota.nishimura.name/

I am currently an Assistant Professor in the Graduate School of Science and Technology, Keio University, Japan. I received the B.E., M.E. and Ph.D. degrees from Toyohashi University of Technology, Japan, in 2005, 2007 and 2010, respectively. I joined the faculty of Toyohashi University, in 2011, as a Researcher. From 2011 to 2012, I joined the faculty of Nagoya University as a Technical Assistant. From 2012 to 2015, I joined the faculty of Nagoya Institute of Technology as an Assistant Professor. Since 2015 I has been an Assistant Professor in the Keio University. I was developing some Spoken Dialogue System. I have published 5 transaction papers and 16 proceeding papers.

Research Interests

Spoken Dialogue Systems

Research Areas

Education

Apr, 2007 - Dec, 2010

電子・情報工学専攻, 工学研究科, Toyohashi University of Technology
Dec, 2010

豊橋技術科学大学大学院工学研究科博士後期課程電子・情報工学専攻修了
Apr, 2005 - Mar, 2007

情報工学専攻, 工学研究科, Toyohashi University of Technology
Mar, 2007

豊橋技術科学大学大学院工学研究科情報工学専攻修士課程修了
Apr, 2003 - Mar, 2005

情報工学科, 工学部, Toyohashi University of Technology
Apr, 1998 - Mar, 2003

電子情報工学科, National Institute of Technology, Suzuka College

Research History

Oct, 2018 - Present

徳島大学大学院社会産業理工学研究部講師
Apr, 2017 - Sep, 2018

Researcher, Graduate School of Technology, Industrial and Social Science, Tokushima University
Apr, 2015 - Mar, 2017

Assistant Professor, Graduate School of Science and Technology, School of Science for OPEN and Environmental Systems, Keio University
Apr, 2012 - Mar, 2015

Assistant Professor, Nagoya Institute of Technology
Feb, 2011 - Mar, 2012

Technical Assistant, Nagoya University
Dec, 2010 - Jan, 2011

Researcher, Toyohashi University of Technology

Committee Memberships

Mar, 2020 - Dec, 2022

Technical Program Committee, International Conference on Natural Language Processing and Artificial Intelligence (NLPAI)
Jan, 2021 - Mar, 2022

Conference Chair, IEEE LifeTech (Global Conference on Life sciences and Technologies)
Apr, 2008 - Apr, 2020

会員, Institute of Electronics, Information and Communication Engineers
Apr, 2006 - Apr, 2020

会員, The Acoustical Society of Japan
Apr, 2005 - Apr, 2020

会員, The Japanese Society for Artificial Intelligence
Apr, 2005 - Apr, 2020

会員, Information Processing Society of Japan
Feb, 2020 - Mar, 2020

自動文字起こし・AI要約技術活用事業に係る企画提案評価委員会，委員, Tokushima Prefectural Government
2020 - 2020

Conference Chair, IEEE Global Conference on Consumer Electronics (GCCE)
2019 - 2020

Chair, IEEE Consumer Electronics Society West Japan Joint Chapter
2019 - 2020

Publication Chair, IEEE LifeTech (Global Conference on Life sciences and Technologies)
2018 - 2020

Technical Program Committee Chair, IEEE Global Conference on Consumer Electronics (GCCE)
2017 - 2020

Organized Session Chair (OS-SLP), IEEE Global Conference on Consumer Electronics (GCCE)
2017 - 2020

Senior Member, IEEE
2015 - 2020

Organized Session Chair (OS-AIR), IEEE Global Conference on Consumer Electronics (GCCE)
2014 - 2020

Member, IEEE
2012 - 2020

査読委員, Information Processing Society of Japan
Oct, 2018 - Oct, 2018

Treasurer, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE2018)
2018 - 2018

Reviewer, The IEEE Region 10 Symposium (IEEE TENSYMP-2018)
2018 - 2018

Treasurer, IEEE Global Conference on Consumer Electronics (GCCE)
Oct, 2017 - Oct, 2017

Conference Chair, 2017 IEEE 6th Global Conference on Consumer Electronics (GCCE2017)

Professional Memberships

Awards

Oct, 2019

Best paper award, A new corpus of elderly Japanese speech for acoustic modeling, and a preliminary investigation of dialect-dependent speech recognition, IEEE

Fukuda Meiko, Nishimura Ryota
Nov, 2013

名古屋工業大学職員褒賞優秀賞, JST CREST uDialogue Project, Nagoya Institute of Technology

Nishimura Ryota
Feb, 2007

最優秀特別研究発表賞, 人間同士の対話現象を模倣した音声対話システムの研究, Toyohashi University of Technology

Nishimura Ryota
Dec, 2004

優秀発表賞, 自然な発話タイミングを生成する決定木の作成とその評価, Toyohashi University of Technology

Nishimura Ryota

Books and Other Publications

Introduction to Data Preprocessing in AI and Machine Learning --- Getting Started with Python

Kita Kenji, Nishimura Ryota, Matsumoto Kazuyuki

Kagakujyoho Shuppan Co., Ltd., Jun 16, 2021
A Multimodal Control System for Autonomous Vehicles Using Speech, Gesture, and Gaze Recognition

Kitaoka Norihide, takuma nakagawa, Nishimura Ryota, Yoshio Ishiguro, Shin'ichi Kojima, Shin Ohsuga

Walter de Gruyter & Co., 2020
Design of Reminiscence Therapy System for Elderly People with Dementia

Uchiya Takahiro, Nishimura Ryota, Hirano Takahiro, Sakurai Masaru

Springer, Nov 2, 2018
ここまで作れる! Raspberry Pi 実践サンプル集

太田一穂, 岡嶋和弘, Nishimura Ryota, 樋山淳

マイナビ出版, Jul 14, 2017
Integrating Symbols and Signals Based on Stream Reasoning and ROS

Morita Takeshi, Sugawara Yu, Nishimura Ryota, Yamaguchi Takahira

Springer, Aug 7, 2016
Development and evaluation of spoken dialog systems with one or two agents through two domains

Todo Yuki, Nishimura Ryota, Yamamoto Kazumasa, Nakagawa Seiichi

Springer, Sep 1, 2013
A spoken dialog system for chat-like conversations considering response timing

Nishimura Ryota, Kitaoka Norihide, Nakagawa Seiichi

Springer, Sep, 2007

Misc.

User adaptation of examples for example-based reminiscence therapy spoken dialog system using word embedding

117(250) 23-28, Oct 19, 2017
Development of Spoken Dialogue System which Integrates and Shares Information based on ROS Architecture

79 79-84, Mar 8, 2017
統合知能アプリケーション開発プラットフォームPRINTEPSとその応用事例

森田武史, 萬礼応, 小篠裕子, 西村良太, 高橋正樹, 中野有紀子, 斎藤英雄, 山口高平

人工知能学会全国大会論文集, 2017 4G1OS14a2-4G1OS14a2, 2017
PRINTEPS : A Total Intelligent Application Development Platform based on ROS and Its Application

108 30-35, Jun 5, 2016
PRINTEPS : Total Intelligent Application Development Tool based on Stream Reasoning and ROS

115(375) 55-60, Dec 17, 2015
エージェントを用いたスマートフォン向け音声対話システム拡張機構の開発と評価

仲野良佑, 打矢隆弘, 西村良太, 山本大介, 内匠逸

研究報告知能システム（ICS）, 2015(2) 1-8, Mar 13, 2015
音声対話エージェントのためのWebブラウザを用いたシナリオエディタの開発

西村良太, 山本大介, 打矢隆弘, 内匠逸

マルチメディア、分散協調とモバイルシンポジウム2013論文集, 2013 1796-1799, Jul 3, 2013
スマートメイちゃん：スマートフォンの機能を有するモバイル音声対話エージェント

山本大介, 西村良太, 打矢隆弘, 内匠逸

マルチメディア、分散協調とモバイルシンポジウム2013論文集, 2013 300-304, Jul 3, 2013
Analysis and Evaluation of Spoken Dialog System with Multiple Agents

2013(18) 1-7, Jan 25, 2013
Analysis and Evaluation of Spoken Dialog System with Multiple Agents

2013(18) 1-7, Jan 25, 2013
Analysis and Evaluation of Spoken Dialog System with One Agent and Multiple Agents

2012(19) 1-8, Jan 27, 2012
Estimation of Dialogue States in Database Search Spoken Dialogue System

Ryota Nishimura, Kazunori Komatani

IPSJ SIG Notes, 2012(20) 1-7, Jan 27, 2012
Development and evaluation of spoken dialog system using multiple dialog agents

IEICE technical report, 110(356) 31-36, Dec 20, 2010
Development and evaluation of spoken dialog system using multiple dialog agents

IEICE technical report, 110(357) 31-36, Dec 20, 2010
Development and Evaluation of Spoken Dialog System using Multiple Dialog Agents

NISHIMURA RYOTA, NAKAGAWA SEIICHI

2010(6) 1-6, Dec 13, 2010
Spoken Dialog System using Multiple Dialog Agents

2010(7) 1-6, Feb 5, 2010
Spoken Dialog System Considering The Response Timing and The Evaluation

NISHIMURA RYOTA, NAKAGAWA SEIICHI

2009(22) 1-6, Jul 10, 2009
Influence of Response Timing in Speech Dialogues

ITOH Toshihiko, KITAOKA Norihide, NISHIMURA Ryota

IEICE technical report, 108(283) 7-12, Nov 3, 2008
Subjective Experiments on Influence of Response Timing in Speech Dialogues

ITOH Toshihiko, KITAOKA Norihide, NISHIMURA Ryota

IPSJ SIG Notes, 2008(68) 99-104, Jul 11, 2008
対話における韻律変化・タイミングのモデル化と音声対話システムへの適用

西村良太, 北岡教英, 中川聖一

言語・音声理解と対話処理研究会, 48 37-42, Nov 16, 2006

Papers

A new speech corpus of super-elderly Japanese for acoustic modeling

Meiko Fukuda, Ryota Nishimura, Hiromitsu Nishizaki, Koharu Horii, Yurie Iribe, Kazumasa Yamamoto, Norihide Kitaoka

Computer Speech & Language, 77 101424-101424, Jan, 2023
Learning a Bimodal Emotion Recognition System Based on Small Amount of Speech Data

Junya Furutani, Xin Kang, Keita Kiuchi, Ryota Nishimura, Manabu Sasayama, Kazuyuki Matsumoto

2022 8th International Conference on Systems and Informatics (ICSAI), Dec 10, 2022
Facial Expression Emotion Recognition Based on Transfer Learning and Generative Model

Tomoki Kusunose, Xin Kang, Keita Kiuchi, Ryota Nishimura, Manabu Sasayama, Kazuyuki Matsumoto

2022 8th International Conference on Systems and Informatics (ICSAI), Dec 10, 2022
A Corpus-Based Analysis Of Age-Related Changes In The Acoustic Features Of Elderly To Super Elderly Speech

Meiko Fukuda, Masakazu Sugiyama, Ryota Nishimura, Yurie Iribe, Kazumasa Yamamoto, Norihide Kitaoka

2022 25th Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA), Nov, 2022
Extraction of Lifestyle Habits Described in Blogs of Diabetics

Tsubasa Miyashita, Kazuyuki Matsumoto, Minoru Yoshida, Ryota Nishimura, Kenji Kita

IEEJ Transactions on Electronics, Information and Systems, 142(10) 1144-1155, Oct 1, 2022
Implicit language information replacing method in Japanese encoder–decode ASR model

Daiki Mori, Kengo Ohta, Ryota Nishimura, Norihide Kitaoka

2022 9th International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA), Sep 28, 2022
End-to-End Spontaneous Speech Recognition Using Disfluency Labeling

Koharu Horii, Meiko Fukuda, Kengo Ohta, Ryota Nishimura, Atsunori Ogawa, Norihide Kitaoka

Interspeech 2022, Sep 18, 2022
フォトリアルCGエージェントとのマルチモーダル対話

北岡教英, 西村良太, 太田健吾

日本音響学会誌/, 78(5) 257-264, May, 2022 Invited
音声対話システムのための自由発話に対応した照応解析による入力発話への話題補完手法

西村良太, 森雷太, 太田健吾, 北岡教英

人工知能学会論文誌, 37(3) 1-13, May, 2022 Peer-reviewed
Text-to-speech system for low-resource language using cross-lingual transfer learning and data augmentation

Zolzaya Byambadorj, Ryota Nishimura, Altangerel Ayush, Kengo Ohta, Norihide Kitaoka

EURASIP Journal on Audio, Speech, and Music Processing, 2021(1), Dec, 2021
Response Type Selection for Chat-like Spoken Dialog Systems Based on LSTM and Multi-task Learning (accepted)

Kengo Ohta, Nishimura Ryota, Kitaoka Norihide

Speech Communication, Vol.133(No.2021) 23-30, Oct, 2021 Peer-reviewed
Normalization of Transliterated Mongolian Words Using Seq2Seq Model with Limited Data (accepted)

BYAMBADORJ ZOLZAYA, Nishimura Ryota, Altangerel Ayush, Kitaoka Norihide

ACM Transactions on Asian and Low-Resource Language Information Processing, Jul, 2021 Peer-reviewed
End-to-end recognition of streaming Japanese speech using CTC and local attention

Chen JiaHao, Nishimura Ryota, Kitaoka Norihide

APSIPA Transactions on Signal and Information Processing, Vol.9(No.e25) 1-7, Nov 23, 2020 Peer-reviewed
Example Phrase Adaptation Method for Customized, Example-Based Dialog System Using User Data and Distributed Word Representations

Kitaoka Norihide, eichi seto, Nishimura Ryota

IEICE Transactions on Information and Systems, Vol.E103-D(No.11) 2332-2339, Jul 30, 2020 Peer-reviewed
Type of Response Selection utilizing User Utterance Word Sequence, LSTM and Multi-task Learning for Chat-like Spoken Dialog Systems

Kengo Ohta, Ryota Nishimura, Norihide Kitaoka

2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Nov, 2019
Environmental Sounds Recognition with Convolutional-LSTM

Akihisa Komatsu, Ryota Nishimura, Norihide Kitaoka

2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), Oct, 2019
A New Corpus of Elderly Japanese Speech for Acoustic Modeling, and a Preliminary Investigation of Dialect-Dependent Speech Recognition

Meiko Fukuda, Ryota Nishimura, Hiromitsu Nishizaki, Yurie Iribe, Norihide Kitaoka

2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA), Oct, 2019
Small-Footprint Magic Word Detection Method Using Convolutional LSTM Neural Network

Taiki Yamamoto, Ryota Nishimura, Masayuki Misaki, Norihide Kitaoka

Interspeech 2019, Sep 15, 2019
Study on Editing Method to Improve Speech Intelligibility Based on Speech Perception Characteristics of Elderly People

Nishimura Ryota, Nagao Takumi, Ichimanda Ayato, Kitaoka Norihide

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, Vol.30(No.6) 840-845, Dec 15, 2018
Study on Editing Method to Improve Speech Intelligibility Based on Speech Perception Characteristics of Elderly People

Ryota Nishimura, Takumi Nagao, Ayato Ichimanda, Norihide Kitaoka

Journal of Japan Society for Fuzzy Theory and Intelligent Informatics, 1-6, Dec 15, 2018 Peer-reviewed

Presentations

111

Text to speech system for low resource languages by cross-lingual transfer learning and data augmentation

ZOLZAYA BYAMBADORJ, Nishimura Ryota, Altangerel Ayush, 太田健吾, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 12, 2021
Building low-resource speech recognizer: Transfer learning and data augmentation

NARANGEREL PUREVDORJ, Nishimura Ryota, Altangerel Ayush, 太田健吾, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 12, 2021
Development of a multimodal dialog system with photorealistic CG agent

Kitaoka Norihide, Nishimura Ryota, Kengo Ohta, Sunao Hara

日本音響学会研究発表会講演論文集, Mar 10, 2021
Developing a Japanese End-to-End Speech Synthesis Server Considering Accent Phrases

Kengo Ohta, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 10, 2021
Construction of EARS, a Speech Corpus for the Elderly, and Preliminary Study of Its Application to Speech Recognition

Fukuda Meiko, Yurie Iribe, Hiromitsu Nishizaki, Kazumasa Yamamoto, Nishimura Ryota, Kitaoka Norihide

IPSJ SIG Technical Report, Oct 22, 2020
A Study on the Analysis of Comics Using Deep Learning

tsubasa fukuda, Nishimura Ryota, Yoshida Minoru, Matsumoto Kazuyuki, Kita Kenji

令和2年度電気・電子・情報関係学会四国支部連合大会講演論文集, Sep 26, 2020
Tooth detection and segmentation from panoramic radiographs using Mask R-CNN

kazuki hara, kohei torii, Matsumoto Kazuyuki, Yoshida Minoru, Nishimura Ryota, Tsuruki Jiro, 小林健一郎, Kita Kenji

令和2年度電気・電子・情報関係学会四国支部連合大会講演論文集, Sep 26, 2020
Construction of End-to-End Japanese Speech Synthesis System with Emotional Expression

taiga yamazaki, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Sep 9, 2020
Improving Speech Recognition for the Elderly: A New Corpus of Elderly Japanese Speech and Investigation of Acoustic Modeling for Speech Recognition

Fukuda Meiko, Hiromitsu Nishizaki, Yurie Iribe, Nishimura Ryota, Kitaoka Norihide

Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), May 13, 2020
NORMALIZATION OF TRANSLITERATED WORDS USING SEQ2SEQ MODEL WITH SPELL CHECKER

zolzaya, Nishimura Ryota, Altangerel Ayush, Kitaoka Norihide

言語処理学会発表論文集, Mar 19, 2020
Streaming speech recognition with Uni-directional LSTM and local attention

CHEN Jiahao, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Construction of elderly Japanese speech corpus for acoustic modeling and analysis of the influence of age and dialects on elderly speech recognition

Fukuda Meiko, Hiromitsu Nishizaki, Yurie Iribe, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Evaluation of Language Model for Spontaneous Speech Recognition Trained Using Written Language-to-Spoken Language Text Conversion

Yuya Obashi, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
A spoken dialogue system with anaphoric analysis for spontaneous utterances

Raita Mori, Nishimura Ryota, Kitaoka Norihide

日本音響学会研究発表会講演論文集, Mar 16, 2020
Construction of Geometric Problem Solving Assist Sys- tem Based on Integrative Understanding of Speech and Finger Pointing

Kanta Kiyohara, Nishimura Ryota, Kitaoka Norihide

情報処理学会全国大会講演論文集, Mar 6, 2020
Mapping of acoustic vector sequence and document vector sequence

Tomoaki Goto, Nishimura Ryota, Kita Kenji

情報処理学会全国大会講演論文集, Mar 6, 2020
E2E Streaming Speech Recognition Using CTC and Local Attention

Chen, Jiahao, Nishimura, Ryota, Kitaoka, Norihide

Proc. NCSP'20, Mar, 2020
E2E Streaming Speech Recognition Using CTC and Local Attention

Chen Jiahao, Nishimura Ryota, Kitaoka Norihide

Proc. NCSP'20, Feb 28, 2020
A New Corpus of Elderly Japanese Speech for Acoustic Modeling, and a Preliminary Investigation of Dialect Dependent Speech Recognition

Fukuda Meiko, Nishimura Ryota, Hiromitsu Nishizaki, Yurie Iribe, Kitaoka Norihide

Proceedings of The 22nd Conference of the Oriental COCOSDA (Oriental-COCOSDA2019), Oct 25, 2019
Automatic Conversion of Written Language into Spoken Language Using a Sequence-to-Sequence Model Trained with a Parallel Corpus

Yuya Obashi, Nishimura Ryota, Kitaoka Norihide

Proceedings of The 22nd Conference of the Oriental COCOSDA (Oriental-COCOSDA2019), Oct 25, 2019

Teaching Experience

Research Projects

高齢者を対象とした永続的に利用できるマルチモーダル対話システム基盤技術の構築

科学研究費助成事業, 基盤研究(A), 日本学術振興会, Apr, 2023 - Mar, 2027

北岡教英, 小林彰夫, 山本一公, 西崎博光, 入部百合絵, 西村良太, 太田健吾, 東中竜一郎
スムーズな対話のための対話テンポのリアルタイム制御に基づく音声対話システム

Grants-in-Aid for Scientific Research, Apr, 2019 - Mar, 2022

西村良太
高齢者を対象とした音声認識・対話システム基盤技術の構築

Grants-in-Aid for Scientific Research, Apr, 2019 - Mar, 2022

北岡教英