In the right climate conditions, growing fruit trees can be a very satisfying hobby.
Fruit trees do not grow quickly and it may even take many years before you ever see fruit. If you choose to get a head start on the process you may be able to buy trees in more mature stages at a tree nursery. You may still wait a year or two for even a mature plant to produce fruit after it has been transplanted. The process of transplanting can be a shock to a tree and it may need a season or two of growth to take firm root and return to its regular growth pattern. This is still much faster though than starting from seed. It is very possible to start an orange fruit tree from the seeds of an orange, but it will be many many years before you will see it bear fruit.
The growth of fruit trees, or any tree for that matter, is very slow compared to other plants you will find in your garden. Most vegetables will go from seed to a natural death all in one growing season. This is not the same with fruit. Other than a few exceptions fruit comes from more permanent plants. Some commercial orchards boast a few old trees they start much of their producing trees from.
A hardy fruit tree that is popular in many parts of the world is the apple tree. It comes in many different varieties from small and tart to large, juicy and sweet. Apples also lend themselves to preserving in many ways making it an easy fruit to make full use of.