End of working from home dream shrinks £1m home club