At the moment we note that you can't run machine jobs locally:

However there are situations where jobs with a machine executor would be best tested locally, so adding support to the CLI would be great.