Secure tea bags around the handle of a small lidded pot filled with 4 cups water. Bring to a boil. Turn off heat, stir in sugar and cover. Let steep 30 minutes. Cool completely.
Pour cooled tea into a pitcher with 4 cups cold water. Add lemon slices and enough ice to fill pitcher. Serve over ice in tall glasses. Garnish with more lemon slices, if desired.