Levinas never engaged closely with Fichte’s work, but there are two places in the chapter “Substitution,” in Otherwise than Being (1974), where he mentions Fichte by name. The point that Levinas underscores in both of these passages is that the other’s encounter with the subject is not the outcome of the subject’s freedom; it is not posited by the subject, as Fichte has it, but is prior to any free activity. The aim of this paper is to deepen the comparison between Levinas and Fichte, giving special attention to Fichte's own novel theory of intersubjectivity and the summons. One result that emerges from this treatment is that both Levinas and Fichte view the second person in a way that has no equivalent in the current philosophical landscape. On this reading, each thinker views responsibility to the other, not only as an immediate and particular obligation, but also as an asymmetrical relation that gives the other moral priority.