Leisure time is time in which there is no job to do, or at least not one that needs doing "right-a-way". This time can be used to do almost anything that brings rest and relaxation.
This time can be spent on two main kinds of leisure:
Lounging, "doing nothing": the kind of 'reclining-in-the-sun' type leisure, which implies going to sleep or a near-sleep lounging state. In a way it is "wasting time", but not really, if you like it (if not, it is called boredom).
Sport fishing may fall in both categories, depending on how active one is.
A more recent concept is that of quality time.