Navigate to Alter WLB -> Alter WLB -> Dashboard Options
From the list of available widgets select unwanted widgets checkbox to remove widgets.
Note: If any widgets are missing in list which is actually shown in dashboard, just visit the dashboard page and come back to Alter WLB -> Dashboard Options. Now you can see the dashboard widgets list updated and refreshed.