There’s a real opportunity for an ambitious AI researcher to:

- create an evaluation framework for testing agent harnesses like Openclaw, Hermes, and all the other “claws”
- extend evaluation to different tools / configs so we know how performance changes with different setups
- run robust evals across diff models including local vs API
- benchmark and publish results, then do ongoing updates as the agents and models evolve
The opportunity is to be THE go-to source for objective agent benchmarks
Maybe someone is already doing this and I’m just not aware? Not one-off comps but real standard testing and evals so we can truly compare results