When inviting people to my town, I've noticed that they don't have to confirm; they are automatically added to the town roster. This has potential for abuses such as stealing tax money from people. In order to preempt such problems, you can install the Questioner module which will automatically ask for confirmation when people are invited to a town. I've installed this mod on my private server before. Its very hassle-free.