Is it permissible to throw out the kittens once they have grown a little, due to their messing up the house?

There is no harm in expelling small cats after they become independent of their mother, if their presence causes harm. However, before that, they must be expelled along with their mother to avoid the harm resulting from separating them.