Sorting shadows?

Im making a 2d topdown game (with shadows). But the problem is my door is casting shadows onto my walls which i dont want. I only want the door to cast shadows on everything else except the walls. How do i make this happen?