Hello Daniel,
If new window pops up outside of WPM recorder, it means that WPM does not detect the window and is not able to interact with it. Why is it happening is hard to tell without more details. As it worked before, was there any change like upgrade of IE to newer version or change in the website itself? I recommend opening a support ticket so that we can look at logs and investigate this further.