You have to have separate "records" of the Red, Blue and Green content of the original scene to be able to combine all three in photoshop to get a full color image. If you shoot without filters, then the film will record all colors at once as shades of gray. When you filter your camera, you are excluding all colors except for the one you wish to record on a particular piece of film. I am sure you can see that you need separate "captures" of each primary color (as shades of gray) to be able to reproduce the colors correctly when combined in photoshop.
Bookmarks