I think the issue is a widespread equation of "productive work" and "[wage] labor". Of course, a lot of people may not do much outside of work beyond watch TV (though how much of that is from tiredness from working at their job so much and dealing with the rest of life's obligations?), but plenty could fill their days with productive work that just happens not to align with what corporate institutions want to hire people for.