When you reassign villagers to stop collecting one resource to start collecting another, they shouldn't lose the resources they had already collected.

For example, a gold miner who's reassigned to be a farmer shouldn't lose the gold already collected. Each resource should have a different counter that is only depleted when the resource is deposited in the appropriate drop off building.