Why not kill the heroine?

Those morons would undoubtedly blame Anastasia for anything that happens to the heroine, not to mention if Allen were to kill him the others would claim: "I've seen them be friendly and talking to each other, a duke's daughter could easily order a commoner to do their dirty bidding!!!"