...on a 4x 3090 rig. The game ran 299 moves, giving katago 100 minutes if it exhausted time on each move (which must be the optimal strategy under that time control). Shin used about 205 minutes, over twice as much time and of course had leeway to spend more time on difficult moves.
Is 20 seconds on that hardware really overkill and well into the diminishing-returns curve, as a top-level comment suggested, or is it plausible katago could have played better if given 40 seconds per move?
As another question, does it not operate similarly to the top chess engines? The way the neural network systems work is by using the probabilistic matching paired with a Monte Carlo simulation. So you can get to extreme depth very rapidly. Obviously the breadth is going to be limited, but if the neural network side is well tuned (so high probability hits are indeed generally the most challenging moves), then that's not such a problem.
And you can run a huuuuuuuge number of sims in 16 seconds.
I believe the basic idea is similar, but there's an enormous difference in the space of possible moves between chess and Go. Go has a larger board and moves are less restricted. There was a major breakthrough in Go playing programs a decade or two ago when good Monte Carlo methods were developed for it. But still I think the ability to simulate many moves is less powerful in Go.
I've not looked at the specific game in question, but in general, doubling the thinking time leads to a very notable strength improvement regardless of the base level of play. The increase becomes slightly smaller at higher levels but does not really diminish, and it currently looks like the ceiling is still a bit away.
If it is "only" 4x3090 at 16s, you will definitely get a drastic playing strength boost from doubling the thinking time. This is still clearly within the interval of a linear relationship between thinking time and playing strength, i.e. elo ~ log time. The relationship, to my knowledge, becomes less clear only starting at about 10-20x the number of playouts.
Considering the original AlphaGo ran on a full Google TPU rack, and here KataGo seems to run on a $10k computer, and won with 2 stones handicap, this is showing just how much advance there was in computer go
Based on the youtube video, it looks like katago was only using 16 seconds per move, is that right? https://www.youtube.com/watch?v=-86zF4mTWOY
Is 20 seconds on that hardware really overkill and well into the diminishing-returns curve, as a top-level comment suggested, or is it plausible katago could have played better if given 40 seconds per move?
match details: https://gostonebase.com/blog/shin-jinseo-vs-katago-kishin-ma...