During development, the precise relationships between transcription and chromatin modifications often remain unclear. We use the X chromosome inactivation (XCI) paradigm to explore the implication of chromatin changes in gene silencing. Using female mouse embryonic stem cells, we initiate XCI by inducing Xist and then monitor the temporal changes in transcription and chromatin by allele-specific profiling. This reveals histone deacetylation and H2AK119 ubiquitination as the earliest chromatin alterations during XCI. We show that HDAC3 is pre-bound on the X chromosome and that, upon Xist coating, its activity is required for efficient gene silencing. We also reveal that first PRC1-associated H2AK119Ub and then PRC2-associated H3K27me3 accumulate initially at large intergenic domains that can then spread into genes only in the context of histone deacetylation and gene silencing. Our results reveal the hierarchy of chromatin events during the initiation of XCI and identify key roles for chromatin in the early steps of transcriptional silencing.