Why is it not a bad idea to delete things at garbage collection time!

Why is it not a bad idea to delete things at garbage collection time!