Placing Blocks on a Random Pattern

Hi guys, 

I have 5 different rectangular panels, and I placed them in a bigger rectangle randomly. Each of these panels are color coded by using an RGB value. So the first image you see has 5 different shades and as I mentioned they are randomly placed. 

I am trying to place window panels on this surface per its RGB value. I have 5 different window frames, and they are blocks in Rhino. I called them Type A, Type B, and so forth. For example, the white panels would only get type A, and the black panels would only get type E, if that makes sense.

I can individually place them since this is not that big of a surface but I want to understand the logic behind this. How do I really match a list of 5 panels, with 5 window frame blocks, and place them accordingly? You can check the second image to see what I was trying. It places the window frames, but doesn't match with the colors.