What is the idea behind the definition of an exponential map on a manifold?

Given a Riemannian Manifold, the exponential map at a point is a function acting on a vector in the tangent space at that point defined using a constant speed geodesic originating at that point with initial velocity as the tangent vector on which it is acting. What is this definition actually serving? What is the motivation behind the definition?