I think your problem was the movie was more like an episode of Star Trek than an action sci-fi movie, which is what the fans wanted. The problem is that the old school Trek formula doesn't sell to a mainstream audience which is why Star Trek will always play second fiddle to Star Wars.
The problem is more that they didn't really sell it at all.
It was still an action sci-fi movie.
Which is often what The Original Series WAS.
The movie's disappointing box office came mostly because Paramount didn't even really attempt to let people know what the fuck it was, or when it was coming out. It was the 50th anniversary and they sold it like it was Star Trek Insurrection.
The fandom being the fandom, made sure to wipe their ass all over it, for the most part, partially as "penance" for Into Darkness daring to (and fumbling the attempt) tap into Wrath of Khan, and partially because the fandom's Constitution-class stick up their ass refuses to give the Kelvinverse anything other than a passing sneer at its success because it's way more comfortable to adhere to the (bullshit) narrative that the Kelvinverse trilogy somehow sucked all the brains out of Star Trek and replaced it with Redbull.