Pivot Chart needs to show different colors for different labels

I am trying to get different labels to show different colors in a pivot chart.

Untitled-1.png

I am able to get all of them to have different colors if I use: Format Data Series -> Fill -> "Vary colors by point" but this is just making it more confusing to look at

In this instance how would I have just two colors?

Thanks!

Transfer data (Year) for the column labels in a PivotTable