Sumproduct - 2 criteria with different array sizes

I have a range of cells conditionally formatted to highlight cells in column e that are not blank and less than the corresponding row in column a, AND column b equals either "YES", or "N/A". But I haven't been able to convert that formula into something that will give me the number of times this condition exists in a given range.
Each of the arguments in my formula provide the correct number of true/false answers when evaluated on their own

=SUMPRODUCT((E6:E64<A6:A64,B6:B64="N/A")+(E6:E64<A6:A64,B6:B64="YES"))

Col. A Col. B Col. E
1/1/11 N/A 31-Dec-11
1/1/11 N/A 31-Dec-11
1/1/11 N/A 31-Dec-11
8/7/12 N/A
8/7/12 N/A
6/24/11 NO
7/24/12 NO
9/23/11 YES 31-Dec-11
1/1/11 N/A 31-Dec-11
9/24/12 N/A 31-Dec-11
10/4/11 N/A