Following one's passion is not a matter of luxury. It is common sense. Some people are driven by the sense of making this world a better place. Some are focussed on meeting daily needs and some on adhering to social norms of success.
The single most important reason for you to follow your passion is YOU.
How to start?
Figure out what you are good at?
What do you normally do without any external motivation?
Can this be monetised?
If yes, what more skills must you pick up?