10
\$\begingroup\$

Look at these photographs of natural scenes, with one of the RGB channels taken out of them:

an idyllic forest with no red

Source (with red): https://en.wikipedia.org/wiki/File:Altja_j%C3%B5gi_Lahemaal.jpg

an Antarctic shore with no green

Source (with green): https://commons.wikimedia.org/wiki/File:2007_mather-lake_hg.jpg

a red fox with no blue

Source (with blue): https://commons.wikimedia.org/wiki/File:Fox_01.jpg

Even without one of the channels, you can probably make out what colours certain things are supposed to be, or at least have a good idea if a reconstruction of the missing channel is accurate.

For example, here is the first picture with a red channel added back onto it which is just random noise:

photo 1 with noise added

This image clearly isn't an accurate reconstruction of the red channel. This is because nature photos generally don't use the entire RGB spectrum, but only a subset of "natural-looking colours". Also, the shades of red will follow certain gradients that correlate with the others.


Your task is to build a program that will take a photograph that's had one channel removed and attempt to approximate the original image as closely as possible by reconstructing what it believes is the missing channel.

Your program will be scored on how closely the missing channel matches with the channel of the original image, by counting the percentage of pixels whose values of that channel are within ±15 (inclusive) of the actual value in the original image (where the values range from 0 to 255 as in a standard 8-bit colour channel).

The test cases that your program will be scored on can be found here (9.04 MB zip file, 6 images). Currently it only contains the three example images above and their originals, but I'll add a few more later to make the full suite once I've done them.

Each image is scaled down and cropped to 1024 x 768, so they will have the same weight in your score. The program that can predict the most pixels within the given tolerance wins.

\$\endgroup\$
  • 1
    \$\begingroup\$ Could you write a scoring program, e.g. in Python? \$\endgroup\$ – orlp May 3 '16 at 7:29
  • \$\begingroup\$ I'll get to that tomorrow. Right now I need to go to bed. \$\endgroup\$ – Joe Z. May 3 '16 at 7:30
  • \$\begingroup\$ Is there a limit to runtime of the program? \$\endgroup\$ – Lause May 4 '16 at 13:43
  • \$\begingroup\$ @Lause The limit is your patience for the program to actually produce output. \$\endgroup\$ – Joe Z. May 4 '16 at 14:21
18
\$\begingroup\$

Python 3 + scikit-image

Simply sets the color of the missing channel to the average of the other two.

import sys
from skimage import io, color

im = io.imread(sys.argv[1])
h, w, c = im.shape

removed_channel_options = {0, 1, 2}
for y in range(h):
    for x in range(w):
        if len(removed_channel_options) == 1: break
        removed_channel_options -= {i for i, c in enumerate(im[y][x]) if c > 0}
removed_channel = removed_channel_options.pop()

for y in range(h):
    for x in range(w):
        p = [float(c) / 255 for c in im[y][x][:3]]
        p = [sum(p)/2 if i == removed_channel else p[i]
             for i in range(3)]
        im[y][x] = [int(c*255) for c in p] + [255]*(c == 4)

io.imsave(sys.argv[2], im)

And the restored images:

forest fox icy

\$\endgroup\$
  • 3
    \$\begingroup\$ average of the other two - apparently a lot more accurate (subjectively) than I would have guessed. +1. \$\endgroup\$ – Digital Trauma May 3 '16 at 15:53
  • 2
    \$\begingroup\$ They are reminiscent of hand tinted daguerreotypes of long ago. Very nice. +1 \$\endgroup\$ – Yimin Rong May 3 '16 at 18:20
5
\$\begingroup\$

Lua, Love2D

Just sets the missing channel to the smaller of the two remaining channels.

local inp = love.image.newImageData(arg[2])

local channels = {1, 2, 3}
local removed = nil
local removed_options = {true,true,true}

inp:mapPixel(function(x,y,r,g,b)
    local o = {r,g,b}
    for k,v in pairs(o) do
        if v > 0 then
            removed_options[k] = false
        end
    end
    return r,g,b
end)

for k,v in pairs(removed_options) do
    if v then
        removed = k
        break
    end
end
inp:mapPixel(function(x,y,r,g,b)
    local o = {r,g,b}
    o[removed] = math.min(o[removed%3+1], o[(removed+1)%3 + 1])
    return unpack(o)
end)

inp:encode('png', IMAGE:gsub("%.png", "2.png"))

Takes a filename as an argument on the command line.

Forest Fox Snow

Bonus

I tried setting the missing channel to 255-(a+b), clamping the value. As to "fill in the gap". The results are useless but glorious.

Forrest Red Teal Fox Yellow Blue Snow Purple Green

And with 255-(a+b)/2

Forest Red Cyan Boring Fox Yellow Blue Boring Snow Purple Green Boring

\$\endgroup\$
  • \$\begingroup\$ The images look even more realistic than the other answer. Great job! Out of curiousity, what happens if you do 255-(a+b)/2 instead (no need for clamping)? \$\endgroup\$ – ETHproductions Oct 21 '16 at 1:17
  • \$\begingroup\$ Results are a less saturated version of the ones posted above. I'll add them to the answer for the giggles. \$\endgroup\$ – ATaco Oct 21 '16 at 1:29
  • \$\begingroup\$ I did, in fact, giggle. Thank you. \$\endgroup\$ – Gabriel Benamy Oct 21 '16 at 1:50

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.