Does a garment lose its ritual purity after three days if worn by a person who does not pray, even though it has not become ritually impure?

The default state of things is purity, and impurity is an incidental quality. Every living thing is pure unless there is a text indicating its impurity. No evidence has come to suggest the impurity of the body of one who abandons prayer, which would then render his clothing impure. Therefore, this statement is invalid.