As sessile organisms, plants encounter various environmental stimuli including abiotic stresses during their lifecycle. To survive under adverse conditions, plants have evolved intricate mechanisms to perceive external signals and respond accordingly. Responses to various stresses largely depend on the plant capacity to modulate the transcriptome rapidly and specifically. A number of studies have shown that the molecular mechanisms driving the responses of plants to environmental stresses often depend on nucleosome histone post-translational modifications including histone acetylation, methylation, ubiquitination, and phosphorylation. The combined effects of these modifications play an essential role in the regulation of stress responsive gene expression. In this review, we highlight our current understanding of the epigenetic mechanisms of histone modifications and their roles in plant abiotic stress response.