Soil and other organic matter will accumulate on top. The fabric itself will begin to degrade from exposure to the soil, fluctuating temperatures, or light. If you cut holes in it for planting ...