Temporal is the word that you seek because it delivers the meaning that you intend without having a familiar positive meaning attached to it, like the word worldly.
This word is also much more accurate than all the words that focus on pleasure because you do not need to be a hedonist in order to be temporal!
Think about it: You can be perfectly hardworking yet feverishly attached just to this world, its tangible, materialistic benefits and results. You can work so hard to accumulate as much money and gold as possible for this world, thus being temporal, without really having any significant amount of fun with that money.
In short, you can be a hardworking, stoic secularist; you can be temporal and allergic to pleasure, or temporal and hedonistic.
temporal (adj.)
- of or relating to time.
- pertaining to or concerned with the present life or this world; worldly: temporal joys.
- enduring for a time only; temporary; transitory (opposed to eternal).
- secular, lay, or civil, as opposed to ecclesiastical.