Finely crush 65 vanilla wafers in a plastic bag with a rolling pin or use a food processor. Reserve about 1/4 cup of the crumbs to top the pie.
Mix together crushed vanilla wafers and melted butter until blended. Firmly press on the bottom, up sides, and onto lip of a buttered 9" pie plate.
Bake for about 12 minutes, or until lightly browned. Remove from oven and place on a wire race, and allow to completely cool (about 30 minutes).
Pudding
In a large bowl whisk together the sugar and the flour. Once it is a fine powder whisk in eggs and egg yolks, and continue whisking until a smooth paste is formed.
Slowly whisk in one cup of milk, once it is fully incorporated whisk in the remaining cup of milk. Transfer to a heavy bottom saucepan, cook on medium heat.
Whisking constantly cook for 10-15 minutes, or until it reaches the thickness of chilled pudding. When it is ready the pudding will begin to bubble and will be thick enough to hold soft peaks when whisk is lifted.
Remove from heat, and stir in vanilla.
Assemble the Pie
In a large bowl mix one cup of caramel sauce and 1 teaspoon fleur de sel, add bananas and stir until bananas are coated in salted caramel.
Arrange ½ of the banana slices evenly over the bottom of the crust. Spread half of hot vanilla pudding filling over the bananas, with 20 full vanilla wafers on top of the pudding.
Cover vanilla wafers with the remaining banana and salted caramel mixture and spread the remaining vanilla pudding on top.
Refrigerate the pie for 2 hours.
Make Whipped Cream
In a large bowl, whip cream until stiff peaks are just about to form. Whip in almond extract and sugar until peaks form.
Spread over the pie.
Finish with a caramel swirl and Vanilla Wafer crumbs if desired (that were reserved from earlier).
Notes
The pie has the best flavor when the pudding has time to set up and chill in the fridge for 2 hours. Don't rush it! You can make this pie much faster by using store-bought crust, store-bought caramel, using boxed pudding and store-bought whipped cream.