Adrenoleukodystrophy (ALD) is an X-linked disorder caused by a hemizygous mutation of the ABCD1 gene. Patients with ALD show progressive central nervous system demyelination and primary adrenal insufficiency. In Japan, most reported ALD cases were childhood-onset, and only one case of an adult patient with Addison’s disease form of ALD has ever been reported. Herein, we present a case of a 29-year-old man with Addison’s disease form of ALD. The patient had anorexia, weight loss, and skin pigmentation from 18 years of age. At first visit, his weight had decreased by 12 kg from 57 kg when he was 15 years old. Endocrinological examination showed low serum cortisol (1.2 μg/dL) with high plasma ACTH (4,750 pg/mL), and abdominal computed tomography showed normal adrenal glands. Very-long-chain fatty acid (VLCFA) levels were elevated, and the ABCD1 mutation, p.Gly116Arg, was identified in hemizygous state. He had no significant neurological findings on physical examination and no white matter lesions on brain magnetic resonance imaging (MRI). He was diagnosed with ALD presenting as Addison’s disease, and glucocorticoid replacement therapy was initiated. Four years after the diagnosis, he still did not show any neurological findings and any white matter lesions on brain MRI. Evaluating VLCFA levels for ALD diagnosis is important in young adult men with idiopathic primary adrenal insufficiency as well as in children. Early diagnosis enables more rational approaches including the early detection of neurological complications and might improve the prognosis of patients.