It's unavoidable: breakdowns in brain connections slow down our physical response times as we age, a new study suggests.