I too had problems trying to defeat him. Got him down to where he had 1 health point and it was impossible to beat him. Formed a group and still couldn't beat him. Restarted my story and when back in and then it worked. Pretty sure it was bugged the first time.
once he gets down to one, you heal, then talk to him! you dont keep attacking!