Oatmeal, Almond, Pear and Plum Crisp

• 1/2 cup quick-cooking oats
• 1/2 cup (packed) golden brown sugar
• 3 tablespoons all-purpose flour
• 2 tablespoons vegetable oil
• 2 tablespoons sliced almonds

• 3 medium pears (about 18 ounces), peeled, cored, thinly sliced
• 3 large plums (about 10 ounces), halved, pitted, thinly sliced
• 2 tablespoons sugar
• 1 tablespoon fresh lemon juice
• Pinch of ground nutmeg
• Nonfat frozen yogurt (optional)