We can ride two wheel bicycles because of the conservation of
angular momentum otherwise it would be very difficult to keep it upright. You
can find explanations
here,
here, and
here.

Learning to ride a bicycle takes a bit of learning how to get that angular
momentum up to a value that can't be overcome easily. Perhaps adding a
supplement gyroscope would help. See
here.

Thanks to Andrew Vanis.