You’re right, technically a land value tax should be not on the total value of the land but rather on the unimproved value, so even improvements made to the land itself would still be exempt from taxation.