Dried lavender is easy to find in the spice section of the supermarket. If you prefer, you can substitute 1/4 cup coarsely chopped fresh mint leaves for the lavender.
Combine honey, 1/3 cup water, lavender, pepper, and salt in a small saucepan. Bring to a simmer over medium heat, stirring until honey has dissolved. Remove from heat, and cover; let steep 10–15 minutes or until room temperature. Strain into a serving bowl; discard lavender and stir in lime juice.
Add peach, nectarine, and plum slices to honey mixture, and toss well. Add berries and mint, and toss gently to combine. Refrigerate 1 hour or until chilled. Serve.