Does he mean like someone was scared for him getting worked up too much and losing years because of stress or did someone threaten him ?

Would be so Ye to interpret a comment like this as a threat to silence him tbh

Yeah it's probably threats. I believe Ye was talking about his recent threats in his latest interview with BigBoy

I think it was just about people telling him to not 'wild out' on social media and post controversial s*** but he just wants to do and say whatever he wants and feels rather than keep it bottled up inside.

People saying tweeting gonna make you die early
How 'bout have my heart hurting?
Hold it all inside, that could make you die early

That's what the 3rd line makes me think it's all about