The MC manages to bring down an otherwise potentially interesting story. The rest of the reviews pretty much nail it. The MC is disgustingly attached to his college friend/party member, which is deeply ironic considering that their interaction in flash backs implies that they havne't really known each other that long. Basically it boils down to the fact that the MC has zero self-esteem, for no apparent reason, and literally EVERY action of his is due to said lack of self-esteem, and places his former party leader on a massive pedestal, and ALL actions are just for him. Girl is planning to leave the party with the MC because he can't keep up? Well, lets break up with her so she stays with the hero's party, regardless of her feelings. (Or the MC's own? can't have been a good relationship if he breaks up with her just so she can help out the hero)
That happens all the time. MC gets anxious because he's not good enough for the hero's party (despite being gone from them for over a year), goes to solo a B-rank dungeon. Has a shitty mood because it took him so long, laments on his own inferiority, basking in how pitiful he is, and 'woe is me'.
Oh, and he treats literally every member of his old party like trash, as pure foils just for the hero. Doesn't matter what they do or say or think, they literally never factor into his decision making. Just 'will this be a good party for the hero'. Despite being their comrade and part of the reason they were recruited in the first place.
Basically, the MC has no 'self' at all, and places every part of his psyche upon the party leader. No other person matters, he's dense as hell, and has a massive inferiority complex.
Honestly, if the MC were AVERAGE, let along decent, this manga could be really good. Characters are interesting, the fief management could be interesting, the cast (and yes, the girls) are great for the most part. Even the hero character isn't the 2-dimensional cutouts that many 'banished from the hero's party' heroes are. But the MC is SO BAD, he drops the level of the entire story down.
**** Side Note: Some of the raws use AWFUL black bar censorship, that isn't remotely subtle. Expect entire frames to be unreadable. They've gone back and corrected a few of the early chapters, so it's mostly the mid-story ones (maybe like 10-20 ish?). It's... truly horrific at times. Just be warned. *****