Late-onset Alzheimer's disease (LOAD) is the most common form of dementia, and its pathogenesis is multifactorial. We previously reported a rare functional variant of SHARPIN (rs572750141, NP_112236.3:p.Gly186Arg) that was significantly associated with LOAD. In addition, several recent studies have suggested the potential role of SHARPIN in AD pathogenesis. In this study, we sought to identify additional functional variants of SHARPIN in Japanese population. Six highly deleterious variants of SHARPIN, comprising four missense variants, one frameshift variant, and one stop-gain variant were detected from whole-genome sequencing data for 180 patients with LOAD and 184 with mild cognitive impairment. One of these candidate variants (rs77359862, NP_112236.3:p.Arg274Trp) was significantly associated with an increased risk of LOAD in 5043 LOAD cases and 11984 controls (P = 0.0016, odds ratio = 1.43). Furthermore, this variant SHARPIN showed aberrant cellular localization and reduced the activation of NF-κB, a central mediator of inflammatory and immune responses. Further investigation of the physiologic role of SHARPIN may reveal the mechanism of onset of LOAD.