KataGo Distributed Training

About This Run

KataGo is a strong open-source self-play-trained Go engine, with many improvements to accelerate learning (arXiv paper and further techniques since). It can predict score and territory, play handicap games reasonably, and handle many board sizes and rules all with the same neural net.

This site hosts KataGo's first public-distributed training run! With the help of volunteers, we are attempting to resume training from the end of KataGo's previous official run ("g170") that ended in June 2020, and see how much further we can go. If would like to contribute, see below!

Updates

  • 2023-06-13 - We are upgraded now - kata1-b18c384nbt-s6582M is the first 18-nested-block neural net with the new improved output heads! You will need to be on version v1.13.0 or later to use the nets from here onward.

  • 2023-05-23 - KataGo v1.13.0 is released! Supports a new version of neural nets with improved output heads for policy and error prediction and various other analysis and search and training improvements. Once most or all contributors upgrade, we will be able to switch to the improved nets. If you're an active contributor please upgrade when you can!

  • 2023-03-04 - We're fully switched to v1.12 now and the first new net of the new architecture, b18c384nbt, has been uploaded for testing! Note the learning rate has been kept far higher than every other network, so it might not be as strong yet as the "uec" version of the new net on the releases page.

  • 2023-02-18 - KataGo is now up to version v1.12.4, with some bugfixes for training data generation! Once enough users are upgraded to this version and particularly off of v1.11, we can try the new improved b18 net and architecture for rating games and data generation. Please upgrade if you can!

  • 2023-01-07 - New release of KataGo, v1.12.0, supporting a new neural net architecture! The new net, b18-uec is about as strong as the 60-block nets but should be faster to run.

  • 2022-05-16 - Disabling support for versions older than v1.11.0 in selfplay data contribution so that we can make full use of new graph search parameters for search during selfplay.

  • 2022-03-20 - KataGo v1.11.0 is released! New graph search algorithm instead of tree search, and various parameter improvements.

  • 2022-01-27 - Switching to 60-block net for selfplay data contribution! 40-block net will continue to be trained as well on the data and be rated as well.

Downloading KataGo

If you simply want to run KataGo, the latest releases are here and you can download the latest networks from here. You very likely want a GUI as well, because the engine alone is command-line-only. Some possible GUIs include KaTrain, Lizzie, and q5Go, more can be found searching online.

How to Contribute

Contributors are much appreciated! If you'd like to contribute your spare GPU cycles to generate training data for the run, the steps are:

First, create an account on this site, picking a username and secure password. Make sure to verify your email so that the site considers your account fully active. Note: the username you pick will be publicly visible in statistics and on the games you contribute.

Then pick one of the following methods.

Likely easiest method, for a home desktop computer:

  • Download and install KaTrain
  • Inside the GUI menu, select the option for distributed training, provide the username and password for the account you created, and choose a few settings, then just let it run!

Command line method: if running on a remote server, or have already set up KataGo for other things, or if you want a command line that will work in the background without any GUI, or want slightly more flexibility to configure things:

  • Download KataGo from the latest release.
  • Edit the contribute_example.cfg that came when you downloaded KataGo, use a text editor to fill in your username, password, and the few different settings you want.
  • Run it on the command line like: ./katago contribute -config contribute_example.cfg on Linux, or katago.exe contribute -config contribute_example.cfg on Windows. If it is working, it should print out various stats as it runs, including when it finishes and uploads a game.

Either way, once some games are finished, you can view the results at https://katagotraining.org/contributions/ - scroll down and find your username! If anything looks unusual or buggy about the games, or KataGo is behaving weirdly on your machine, please let us know, so we can avoid uploading and training on bad data. Or, if you encounter any error messages, feel to ask for help on KataGo's GitHub or the Discord chat.

For advanced users, instead of downloading a release, you can also build it from source. If you do so, use the stable branch, NOT the master branch. The example config can be found in cpp/configs/contribute_example.cfg

And if you're interested contribute to development via coding, or have a cool idea for a tool, check out either KataGo's GitHub or the this website's GitHub, and/or the Discord chat where various devs hang out. If you want to test a change that affects the distributed client and you need a test server to experiment with modified versions of KataGo, it is available at test.katagodistributed.org, contact lightvector or tychota in Discord for a testing account.

Stats for kata1

This run is named kata1 and began on 2020-11-28 20:23:43 UTC.

Data Generation

Across all time, 941 distinct users have uploaded 2302817925 rows of training data, 44652109 training games, and 991664 rating games.

In the last week, 55 distinct users have uploaded 23367579 rows of training data, 477542 new training games, and 15738 new rating games.

In the last 24h, 34 distinct users have uploaded 2359449 rows of training data, 48779 new training games, and 1766 new rating games.

Look up and view games for this run here.

Networks

A total of 631 networks have been uploaded for kata1.

Latest network: kata1-b18c384nbt-s7011680768-d3531781714

Strongest confidently-rated network: kata1-b18c384nbt-s6981484800-d3524616345

Approximate Elo Ratings Graph
Graph is based on about 991664 rating games using mid to high hundreds of playouts. Ratings might still be mildly inflated due to only playing other KataGo nets, but otherwise are fresh and unbiased and involve a variety of nets to avoid rock-paper-scissors. Vertical bars indicate approximately a 95% confidence interval.

Click and drag to zoom. Double-click or click on a button to reset zoom.

2.3G2.4G2.5G2.6G2.7G2.8G2.9G3G3.1G3.2G3.3G3.4G3.5G3.6G3.7G13,24013,26013,28013,30013,32013,34013,36013,38013,40013,42013,44013,46013,48013,50013,52013,54013,56013,58013,60013,62013,64013,66013,68013,70013,72013,74013,76013,78013,800randomb6c96b10c128b15c192b18c384nbtb20c256b20c256x2b40c256b60c320

Top Contributors

See here for a full list of contributors for kata1.

In the Last 24h

ユーザー Training Rows Training Games Rating Games
水底2022 709196 rows generated 14652 training games 366 rating games
Friday9i 476103 rows generated 9695 training games 24 rating games
maomaochong 248691 rows generated 5157 training games 117 rating games
maxueba 183718 rows generated 3735 training games 92 rating games
菜刀指导 145200 rows generated 3024 training games 0 rating games
maverick 118132 rows generated 2473 training games 32 rating games
SymplectGO 90200 rows generated 1831 training games 0 rating games
luotiany 74061 rows generated 1518 training games 36 rating games
OmnipotentEntity 57268 rows generated 1167 training games 20 rating games
soya 50566 rows generated 1004 training games 12 rating games
yxy 48827 rows generated 1028 training games 0 rating games
yaoge123 38208 rows generated 1033 training games 886 rating games
peter 29196 rows generated 576 training games 4 rating games
ntkylin 21903 rows generated 434 training games 16 rating games
Zhq 13529 rows generated 309 training games 0 rating games

In the Last Week

ユーザー Training Rows Training Games Rating Games
yaoge123 10638372 rows generated 216939 training games 10041 rating games
水底2022 4456195 rows generated 91458 training games 2269 rating games
Friday9i 2839927 rows generated 57810 training games 258 rating games
maomaochong 1754878 rows generated 36095 training games 822 rating games
maxueba 1240727 rows generated 25333 training games 563 rating games
maverick 504942 rows generated 10338 training games 188 rating games
菜刀指导 403202 rows generated 8209 training games 0 rating games
luotiany 253429 rows generated 5161 training games 160 rating games
ntkylin 225919 rows generated 4671 training games 149 rating games
soya 209455 rows generated 4233 training games 76 rating games
peter 169278 rows generated 3432 training games 110 rating games
直接进入 113230 rows generated 2326 training games 4 rating games
SymplectGO 90200 rows generated 1831 training games 0 rating games
egri-nagy 68259 rows generated 1374 training games 52 rating games
OmnipotentEntity 57268 rows generated 1167 training games 20 rating games

Overall

ユーザー Training Rows Training Games Rating Games
yaoge123 343836990 rows generated 6817857 training games 106301 rating games
luckyangman 342435207 rows generated 6418062 training games 140115 rating games
AiqiGo 148551176 rows generated 2819086 training games 53342 rating games
Friday9i 112987045 rows generated 2279690 training games 41788 rating games
jiusi010302 111549344 rows generated 2157135 training games 32148 rating games
水底2022 100931556 rows generated 2071028 training games 46901 rating games
maomaochong 81374503 rows generated 1650418 training games 35133 rating games
VegetableKnife 79204855 rows generated 1470688 training games 23367 rating games
katavip.net 70355820 rows generated 1379526 training games 18872 rating games
jameswen429 65701378 rows generated 1211481 training games 30013 rating games
badukmegapack 54514821 rows generated 1070455 training games 17625 rating games
kcwu 45131243 rows generated 865458 training games 90968 rating games
菜鸟老树 35251287 rows generated 714139 training games 10872 rating games
Sponsorship 35233550 rows generated 668781 training games 13461 rating games
spark9 34586663 rows generated 663843 training games 13537 rating games