Is manual labor bad for piano fingers?

i work at a tile store, and i lift wickedly heavy boxes of tile and stack them around in the back room, and into ppl's cars. I've been playing piano for 7 years. Will this manual labor affect my playing? Cuz my fingers are kinda tired right after work.