David Harbour has broken his silence after his ex-wife Lily Allen released a scathing album seemingly referencing their breakup and alleging the actor had an affair during their open marriage.