Club says if neighbors don’t chip in, building will begin