Line a 9X13-inch baking pan with foil.

Lay crackers on the foil covering the entire surface without overlapping.

In a large sauce pan, melt butter over medium heat, then add the graham cracker crumbs, brown sugar, milk and sugar. Bring to a boil and let this boil for 5 minutes, stirring frequently.

Pour half the mixture over the crackers. {Use a spatula to spread to coat evenly.} Place another single layer of crackers, then top with the remaining butter mixture and one more layer of crackers.

In a small saucepan over medium heat, combine peanut butter, chocolate chips and butterscotch chips. Melt completely, stirring constantly.

Spread mixture on top of crackers.

Cover and chill in the refrigerator for about 1 hour.

Cut into desired sized pieces and serve!