White took the stage in leather ankle boots released in collaboration with John Fluevog and the musician's Third Man Records