When having to choose whether the film should be Mainstream or have a niche market, I looked at some mainstream psychological thrillers, and its clear from the information that there is still a market for psychological thrillers.
E.g of Psychological Thrillers
(Mainstream)
Black Swan (2010) - $106,952,327
(USA)
Se7en (1995) -
£19,234,230 (UK)
Psycho (1960) -
$32,000,000 (USA)
Memnto (2000)- $25,530,884 (USA)
Inception (2010)- $292,568,851 (USA)