No idea if this would work and it's likely not even a good idea, but you could eschew the elastic band and just use double sided sticky tape?
OR... or you could use sports strapping tape and secure it to your chest that way. I use that tape to keep the blood sugar monitor stuck to my son's arm.
P.S.
The title made me think this was about Human Resources making you do 2 jobs hahaha