Aphasia is one of the conditions of a higher brain function dysfunction. The aphasia decreases quality of life of patient with the dysfunction. Moreover, since patients with aphasia have handicap for talking, reading and understanding about rehabilitation program, the aphasia prevents progress of other rehabilitation. This paper describes a rehabilitation support system for patient with aphasia. The system employ tablet device as multimodal interface device. The system provides several tasks and measures their solution times and answers instead of speech therapist. And, the measured data send to cloud database to diagnose progress of that. In experiment, usability of our system was tested with six aphasia patients.