Advice about holiday pay?

i started a new job last march and my employer did not give me any wrtiten or verbal information about my holiday entitlement. now he says that i had taken 3 days too much accrued holiday last year and that he will deduct it from this years holiday entitlement. theres nothing in wrinting or verbally to this agreement but can he do it. i work in the uk.