Sure, carelessly write your code cos the GC will clean up after you...
You would more than likely run out of memory depending on the amount of tasks you have faster than the GC could de-allocate them. There is no reason for you to have such a design and is more problematic than productive.