Can you imagine believing you'd poisoned dozens of people? Children and elderly villagers, family members, all because you thought you got cocky?
Alternatively, do you think any of them knew? Do you think they realized Taako's food was killing them? That they were all going to die because they trusted him?
I love this mess of a wizard