It is important to establish an objective index to differentiate mood disorders (i.e., bipolar disorder; BD and major depressive disorder; MDD). The present study focused on the pattern of changes of physical activity in the amount of activity intraday, and examined the relationship between activity patterns and mood disorders. One hundred and eighteen inpatients with MDD or BD in a depressive state provided the activity data by using wearable activity trackers for 3 weeks. In order to illuminate the characteristic patterns of intraday activities, Principal Component Analysis (PCA) was adopted to extract the main components of intraday activity changes. We found that some of the PCs reflected the differences between the types of mood disorder. BD participants showed high activity pattern in the morning and low activity pattern in evenings. However, MDD showed the opposite. Our results suggest that activity tracking focused on daytime activity patterns may provide objective auxiliary diagnostic information.