Working memory refers to the cognitive capacity to temporarily store and manipulate information from multiple sensory domains. Recent studies have shown that cognitive training can improve performance in both visual working memory and tactile working memory tasks. However, it is still unclear whether the effects of training can be transferred from one sensory modality to another. The current study assessed whether the training effect of the tactile orientation sequence task could transfer to visual orientation sequence and visuospatial working memory tasks. The results showed that participants’ accuracy in the tactile orientation sequence task was significantly increased after 9 days of training compared with that before training. Remarkably, participants’ accuracy in both the visual orientation sequence task and the visuospatial task was significantly improved after 9 days of training. These results suggest that it is possible to improve visual working memory through a transfer effect from tactile task training without practice in the visual domain, which opens a wide range of applications for tactile orientation sequence tasks.