How to change cell reference for countif formula for every nth row

Hello, my question is regarding changing cell reference for every 5th row.

My formula in use is as such,

From Cell E2 to E5
IF(COUNTIF(D$2:D$5,"2")>=3,"Active",IF(AND(COUNTIF(D$2:D$5,"2")>=1,COUNTIF(D$2:D$5,"2")<3),"Rarely active","Inactive"))

But from Cell E6 to E9 I need the formula to change cell reference. So the formula should become
IF(COUNTIF(D$6:D$9,"2")>=3,"Active",IF(AND(COUNTIF(D$6:D$9,"2")>=1,COUNTIF(D$6:D$9,"2")<3),"Rarely active","Inactive"))

And this goes for about 10k rows. Therefore I need a quicker way to make the cell reference change. Please help me!

Thanks ExcelForum fam!