Jesus both worked and prayed, and so should his disciples.
Jesus prayed for God's will to be done both in heaven and on earth, and so should we.
John said Jesus DID get involved in a lot of other good causes, but he ran out of paper to record them (John 21:25).
I hope these truths will help you to adjust your judgement regarding what is trivial. Just because God hasn't told you to do it,
doesn't mean He won't, although there certainly are a lot of things that are a waste of time, which raises the interesting question whether affordable recreational activities are approved/okay/permissible/not sinful.
Perhaps Ecclesiastes 3:1 applies:
There is a time for everything, and a season for every activity under heaven:
a time for prayer and a time for putting feet to prayer,
a time for doing good works and a time for trivial activities or play, (etc.).
What do you think about this thought?