I noticed that the initial opening of mkv files was becoming increasingly slow and that it appeared to depend on the number of mkv files in the same folder.
The culprit? A setting in Haali Media Splitter.
To prevent the scanning of other mkv files when playback begins use this setting in Haali:
Options -> Input -> Try to open linked files -> NO