The man lived in a dilapidated house made of mud and bricks.

Crumbling : breaking or falling apart into small fragments, especially as part of a process of deterioration.
Old : having lived for a long time; no longer young.
Thatched : cover (a roof or a building) with straw or a similar material.
Crashing : complete; total (used for emphasis).
Dilapidated : (of a building or object) in a state of disrepair or ruin as a result of age or neglect.

Synonym of Dilapidated is Crumbling