The aims of this study are to analyze the patterns of energy consumptions in agriculture, forestry and fishery sectors (AFF sectors hereafter) and to identify the deterministic factors underlying the changes in the patterns during the last two decades, particularly since 1995. The analysis includes indirect energy consumptions in other sectors induced by the production of AFF sectors as well as direct energy consumptions in the sectors, which differentiates this study from previous ones. In addition, we attempt to make energy input-output tables and decompose structurally the changes in total energy consumptions (encompassing both direct and indirect consumptions) of AFF sectors based on the tables. It turned out that total energy consumptions in the sectors had increased until around 2000 and have been gradually decreasing afterward, and that this fluctuation has been mainly led by the structural change in the composition of energy consumptions in AFF sectors and improved efficiencies of energy consumptions in livestock sector.