‘Frankfurt-style cases' (FSCs) are widely considered as having refuted the Principle of Alternate Possibilities (PAP) by presenting cases in which an agent is morally responsible even if he could not have done otherwise. However, Neil Levy (J Philos 105:223–239, 2008) has recently argued that FSCs fail because we are not entitled to suppose that the agent is morally responsible, given that the mere presence of a counterfactual intervener is enough to make an agent lose responsibility-grounding abilities. Here, I distinguish two kinds of Frankfurt counter-arguments against the PAP: the direct and the indirect counter-arguments. I then argue that Levy's argument, if valid, can shed doubt on the indirect argument but leaves the direct argument untouched. I conclude that FSCs can still do their job, even if we grant that the mere presence of a counterfactual intervener can modify an agent's abilities.