Thoughts on Diplomacy and what game does it well?

Hey all! (Sorry for long post)

About me:
After a year, heading into 2 years of actually playing 4X games in general. Have played Civ and EL1 in the past, like 5-7 years ago, but only a little bit because it was time consuming and it was lot to learn. I consider myself as fresh and new to this day.

I'm still having so much fun playing 4X games especially AOW4, Planetfall, ES2, Zephon etc

What I look for:
I love the Diplomacy mechanics in 4X games in general but I want to get more deeper in interacting with allies, enemies, or even on a neutral pact. I want to engage more by influencing the AI decisions and connect with them a bit more deeper. I would like it, if the AI can do those things back to me as well. I know Civ games do really well in this aspect but there only humans and no aliens, demons, cyborgs in those games. Basically Sci-fi and fantasy preferred. I'm about to play EL1 again and explore a bit more in its diplomacy civ like building empire fantasy.

One of my favourite games is still Planetfall but the diplomacy is very simple, straightforward and primarily war focus. However I love planetfall's espionage, population killing, hacking empire, disabling units and with diplomacy added to that it would be such a crazy deep meaningful game, even though it is.

I've heard games like Solium infernum has a really interesting political diplomacy backstabbing, arch angel, Devilish kind. Man that sounds brilliant but I hear its better with multiplayer. So I'll have find people in the Pacific.

Short Examples

ES2
Diplomacy is fantastic especially for my first time out in space but I feel the AI lacks in any commitment, pressure and it doesn't really trade anything with me. It lacks interaction or self-implication engagement. It Seems to only care if its losing, lol. However ES2 has one of my favourite LORE and deep meaningful factions and Minor factions populations are used like their real living sentient beings in my civilization. CIV Games does this well too if your into Historical empire playstyles.

AOW4
Does a really interesting free city, multiple pacts, good and evil alignment mechanics and how it affects your playstyles. Which interconnects well with your choices in diplomacy and how some free cities won't join you because you're too evil for their liking. This is a fantastic way to influence certain allies under your empire. But I feel like everything in AOW4 is more combat focus. While your able to gain specific Rally of the liege units, its mostly to support the war to come. However I do love the different personalities that you can customize and allow your ruler to be a Demonic Warlord, being so aggressive or being Harmonious playing a more peaceful style. Planetfall does personalities too. These all affect diplomacy, playstyle and the varieties in gameplay.

Question With an Explanation
I'm looking for a new 4X game that goes a bit more deeper in diplomacy 4X mechanics while still maintaining a strong building empire, resource management, trading system and many more 4x fundamental mechanics in a Sci-Fi or Fantasy setting. I have spent a whole year trial and error and still trialing them out. I just can't find the game that the AI interacts or tries to counter diplomatic means in a very deep engaging way. Maybe this is a problem that 4X games have. I'm not sure. Another thing, it doesn't have to have good combat, I care less for combat anyways and focus more on Empire management and I love how buildings give me specific resources done in many different ways. ES2 is a good example of this. Diplomacy and personalities of specific factions make the game so real it feels like I can relate.

Maybe you know that game I am suppose to be playing?