ADHD

Long story short, Im 28, I work in a specific department in my factory called lighting, specifically I work in the truss department. Lately someone from a nearby but technically separate payroll has been "stealing me" to do drape (basically folding and putting away huge theater drapes) I'm getting annoyed because not only is this cutting into our current short timeline tasks, since I did okay the first time, now he specifically walks by all my colleagues and grabs me to do the drape. I've spent the last two days hiding in the bathroom whenever I get a chance to hide in case he wants my help, but I'm trying my best to avoid snapping and telling him to choose someone else, I'm not your drape guy! (This would be a bad idea)

So how about it, how do you all subdue your indignant rage over perceived injustices

Edit: I should preface some things: technically he's a building lead, so he can tell me what to do, I'm just more loyal to my department and would rather get our shit done

2: these are gruff factory dudes, just going "hey I'd rather not" is likely to get you laughed at

3: I'm not really looking for solutions to the problem, more my trouble controlling my emotions, I probably shouldn't have mentioned the example in the first place