I try to always have my (actually not so cheap) Contax T3 with me. Other cameras I love to use include a Canon AE-1, a Contax G2, a Yashica T5D, a Minox 35GL as well as an old Kodak Instamatic 400 and a Nimslo 3D and some others. My mother used to collect cameras, so from time to time I sneak into her room and get a new one to try.
Why analog? Cause it makes me think first and then shoot. Why cheap? I don't like to handle too much equipment. It's slowing down my work and I'll get annoyed.
So what I love about having a simple camera is that I always have it with me. It's small, light, cheap and I don't have to fear if it breaks or gets stolen. Actually it's already been twice that someone snatched my Yashica out of my pocket, but gave it back or dropped it cause they were thinking it's worthless.
What I like about photography is how it feeds our curiosity to discover and see everything there is. To collect memories and traveling was definitely the reason why I decided to give photography a shot.