In Actor-Critic, we have both policy and value functions (or a combination of value-based and policy-based). This method is the best of both worlds:
Policy
Value Function
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.