Bennett preached unity, but Herzog scolded him for crossing the "red line" in the elections.
The fluent Hebrew-speaking IDF veteran believes Israel's "right wing government" is the obstacle to peace.
The meeting will help Herzog put Livni, another suitor, in her place, but also could preclude a three-way merger to tackle Netanyahu.
The conference was in part a commemoration of Rav Herzog.