For both fiction and non-fiction self-published is a red flag since the authors often don't see the need for an editor or think that it is all about spotting typos etc. You will still get absolute gems, but the signal to noise ratio is extreme. With books of photography that is a much smaller issue since the buyer is either already familiar with your work or is standing at the table leafing through the book. A good editor would still be an advantage in terms of selecting the final cut of photographs for the book and what sequence they appear in but won't be a make or break thing.

Right now self published "photobooks" are all the rage and there was even a weekend event for them inside the National Gallery of Victoria, the most prestigious art space in my home town (Melbourne) and one of the top galleries in the country. They are usually at the lower end of the quality range or aiming at a handmade aesthetic but I would say that there is no intrinsic shame whatsoever in a self published monograph of your own photos. Get as much advice as you can and find a printer who is used to printing books of photography.