Kepler's elliptical orbitals are but one example of the possible orbits in a gravitational field. Only ellipses (and their special case, the circle) lead to bound orbits; the others are associated with one-time gravitational encounters.
For a given central force, increasing the velocity causes the orbit to change from a circle to an ellipse to a parabola to a hyperbola, with the changes occurring at certain critical velocities. For example, if the speed of the Earth (which is in a nearly circular gravitational orbit) were increased by about a factor of 1.4, the orbit would change into a parabola and the Earth would leave the Solar System forever.