Summing matrix values based on X & Y axis values

The simplified example below is intended to calculate the sums from the data values in the upper data set and place them in the appropriate cells in the lower summary table.

Raw Data
Apr May Jun Jul
Yes 2 4 6 8
No 1 2 3 4
Yes 4 8 12 16


Summation
Apr May Jun Jul
Yes 6 12 18 24
No 1 2 3 4

I would like to find a single-cell formula that will handle the multiple instances of either the X or Y headings (ex: there are two 'Yes' Rows) and still reach the appropriate summations. I would like to accomplish this without resorting to Macros or manual cell references if possible.

I've acheived some limited success with array formulae so far, but find that the multiple instances of 'Yes' cause only one row to be summed before the formula finishes.

Does this formula in B10, copied across and down.. accomplish that, or did I misunderstand your question?

=SUMIF(Tasks,$A10,B$3:B$5)

or

maybe:

=SUMPRODUCT((Tasks=$A10)*(Dates=B$9),Data)

copied across and down...