Change AVERAGEIFS formula to AGGREGATE or similar formula

I have a data set consisting of numbers 0 and larger along with some #N/A errors for use in graphing on a chart. The following formula can only work if there are no #N/A errors in the data set. I need another formula that is able to filter out or ignore #N/A errors contained in the range being averaged. I am thinking the AGGREGATE formula may be able to accomplish this but I am not able to come up with something that works. ?*

=IFERROR(AVERAGEIFS($E$5:$E$1111,$B$5:$B$1111,">="&EOMONTH(F5,-1)+1,$B$5:$B$1111,"<="&F5),NA())

On the attached file, this AVERAGEIFS formula (see orange column G) can only work on the data set on column E. I need a different formula (inside the green area of column H) that will work with the data set on column D so that columns G and H will have matching values.