Creating difficult chart based on cell colour with 9 years of weekly data

Backstory
I am a big fan of data and self improvement. Every week for the last 9 years I have tracked my performance in 4 different areas of my life. Those areas are;

• Fitness
• Life
• Work
• Finances

Each week I allocate a colour (fill) based on my performance.

• Complete = green
• Majority Complete = close to dark green 15 (#006600)
• Majority Not Complete = Orange
• Not Complete = Red
• N/A (Meaning no goals set, holiday, illness, etc) = Blue

The colour allocated to each cell is based on separate spreadsheets in which I track my goals for the week and they have the same colour scoring system for each goal.

I would like to plot the last 9 years of weekly data on a line chart to find trends and plan for 2024. For example; which months I see a dip in performance in a certain area, and which areas impact other areas.

The X axis should be weeks (1 - 52). (I would also settle for a monthly X axis considering the amount of data).
The Y Axis should be the performance based on the colour scale (I guess).
I would like to overlay the years on top of each other and have 1 line representing each year.

I also have notes on each week which I would like to plot on the chart where relevant, (if that is possible).

I am concerned that the current format of my spreadsheet is not conducive to build a chart from. I feel like each colour would need a number allocated to it in order to plot on a chart. But honestly, I don't even know where to start.

I attached a sample below. I am happy to share a link to the Googlesheets where this lives, or an XLS download of the full sheet, but since I am a newer member I cannot post the link here.

The notes are often personal so I have removed them but the column is still there.

p.s this might be impossible, but I though it would be worth posting

I'm going to give this a shot and report back. Thank you for the helpful tips!