If traveling "with a backpack" is already boring, rent a car to explore the historic sites of Sherbrooke. You can get a car at one of the rental companies' offices: Rock Forest, Downtown, Fleurimont, etc. You will immediately understand the difference: seeing the planned attractions will be several times faster, and traveling around Sherbrooke is much more pleasant.