Change Color Independent of Fill Color

I have element templates that allow setting multiple properties quickly in VBA by using:

PropertyHandler.SelectByAccessString "Template"

After setting the value of the property handler to the name of the template, I would like to override one of the properties (color) without affecting anything else.

It seems that setting the color is also setting the fill color at the same time.

How should I isolate and change just the color without the fill color?