Simplifying RANK,MATCH, INDEX Formula

Attached is an example of a much more complex spreadsheet where I want to find the two most frequent numbers in a column and set a conditional format to highlight anything outside their boundries. Ideally, I'd like the formula to be self contained in the conditional formatting window but I don't think this is possible. I had to create a table of 4 columns to come up with my boundries

Column 1 lists the numbers using the MAX function (my numbers always exhibit themselves as powers of 2 and wouldn't exceed 6 levels)

Column 2 has a countif to get the frequency

Column 3 Ranks them in such a way that there are no duplicates even if the frequency is the same

Column 4 uses INDEX and MATCh to trace back to the numbers with the most frequency and place them in cells that the Conditional Formatting will reference.

Is there an easier way?

Thanks

ChemistB