My cheap camera is the Holga 120N which I purchased for around 20-45 Canadian dollars. I love the square 120mm negatives and the quirkiness of the Holga. I never leave home without at least one and often carry several, loaded with different films because they are so light. You can always count on happy accidents with them, the back falling off, the shutter sticking, corner vignetting, fat rolls, etc. They are truly versatile as well. I have shot some great macros with their cheap plastic close up lenses and some amazing infrareds with glass filters worth several times the cost of the camera. I love the brightness and contrast of their black and white negatives as well as the pop of cross processed slide film.
I got my first camera, a hand me down Brownie, when I was 12, but photography didn't really click with me until I went to college and took a course in photojournalism which was heavily weighted toward the darkroom. I was a frustrated artist by that point. I couldn't draw or paint but soon discovered that I could create in the darkroom. Forty years later, I have my own gallery and more ideas than time.
Great photography is about the eye behind the camera, not the camera or the equipment. Developing your vision is more important. You can do this by experimenting with any camera.