TimePicker dialog theme change

In support library 23.4.0, my TimePicker looks as follows:

In support library 24.4.0 my TimePicker now looks like this:

How can I force the dark theme to be used for this dialog? All other dialogs are following the correct dark theme that is in my app