Brackets attached to fence post to hold rails