Gave an invited talk at the French government DGFiP and DINUM about LLM pretraining and CroissantLLM.