@burcidi-- Not at all. You can basically use this idiom whenever you're talking about something you love. It could be a hobby, a music band or a book.
The point is that you have an emotional attachment to that thing or person. It's closer to your heart than other things, and has a special place in your life.