This is a large format forum, so we only talk about 4x5 or larger formats here. Yes, you can "start out" with a press camera costing far less than the most expensive enlargers. I don't believe there are many enlargers that are new any more other than Intrepid. Prices are somewhat supply and demand related. There seem to be tons of 4x5 press cameras, lenses and cut film holders available for sale on the used market. That's because so many of these were manufactured over the years.
With all large format cameras, the tripod is the accessory that yields the greatest freedom. Hand holding a press camera is very limiting of what you can photograph. Indoors, you will need a large flash unit. Outside, you will be shooting with large apertures (4.5-8) that give very shallow depth of field and need more focusing precision. Hand holding, you will always need a very fast film. Royal-X, which was a popular 1000 speed sheet film, is no longer available. You will need to push process a 400-ish speed film (which are closer to 200 speed in practice), which limits even more. There are reasons the 4x5 press cameras became obsolete during the 1960's, mostly the improving quality of camera films in general, and changes in lithographic printing processes that once favored larger formats for newspaper and other press photographic applications.
Alan Townsend