Janky, at least as published yesterday by GitHub, is set up to run on top of Heroku. The Heroku app files are stored in a Gist, and can be deployed to Heroku in just a few commands. Naturally, you'll need a Jenkins install as well.

Once deployed, Janky is controlled with GitHub's Hubot. It looks like Campfire (the collaboration/chat solution from 37Signals) is required to use Janky at the moment, but if Janky takes off I'd expect to see an IRC option as well.