More people are buying second homes, but less than half of owners use them for more than four weeks of the year