My cheap camera is the Canon AE-1, which is basically my favorite camera. Loading it with Tri-X 400. It was the first camera that I seriously started using and I've taken most of my pictures with it, so I'm kind of attached to it. When travelling I always have it with me. It went through a lot and so some parts are already broken.
My camera being cheap is not that important for me. It's still able to take pictures and I like the results, I think that's what matters.
I started doing photography during my first big travelling experience going to Almaty, Kazakhstan and stayed there for a year. I travelled a lot since then. For me it was like going to another world which is so different from what I know. I simply wanted to capture every moments, the landscapes, and the people I've met.
I'm not a pro photographer so I don't know if I have the rights to give some advice. But for me, photography must and should be like a pleasure, a hobby, and that you can do it with any camera available to you at the moment. You don't necessarily need to get yourself a fancy camera to begin with. Perhaps a little camera can be a good start. Go little by little. Try to figure out how your camera works and experiment with it if you want to create/take great images.