I have been tweaking a tool to let me switch layers according to the focused app on windows. Since it would be a feature other could want. I decided to release it on github.
For the ones interested, check Kaleidoscope Companion. It is quite rough on the edges, feel free to make feedback, share ideas or whatever.