https://wins-m.github.io/302/en/tags/machine-learning/Recent content in Machine-Learning on WM's BlogHugoenSat, 22 Nov 2025 16:18:58 +0800https://wins-m.github.io/302/en/posts/2025/exp_track/Sat, 22 Nov 2025 16:18:58 +0800https://wins-m.github.io/302/en/posts/2025/exp_track/<ul> <li><a href="#experiment-tracking--doc-writing" >Experiment Tracking &amp; Doc Writing</a> <ul> <li><a href="#experiment" >Experiment</a> <ul> <li><a href="#1-use-configs-for-all-pipeline-level-hyperparameters" >1. Use configs: for all pipeline-level hyperparameters</a></li> <li><a href="#2-save-results-config-logs-prediction-metrics-panels" >2. Save results: config, logs, prediction, metrics, (panels)</a></li> <li><a href="#3-have-one-script-to-compare-ipynb" >3. Have one script to compare: <code>*.ipynb</code></a></li> </ul> </li> <li><a href="#weekly-doc-writing" >Weekly Doc Writing</a> <ul> <li><a href="#structure" >Structure</a></li> </ul> </li> </ul> </li> </ul> <!-- --- marp: true theme: default size: 16:9 style: | section { font-size: 20px; } h1 { font-size: 36px; } h2 { font-size: 28px; } h3 { font-size: 24px; } p, li { font-size: 20px; } img { width: 75%; } footer: swmao @ Futuristic paginate: true --> <hr> <!--_paginate: false--> <h1 id="experiment-tracking--doc-writing"> Experiment Tracking &amp; Doc Writing <a class="heading-link" href="#experiment-tracking--doc-writing"> <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> <span class="sr-only">Link to heading</span> </a> </h1> <hr> <h2 id="experiment"> Experiment <a class="heading-link" href="#experiment"> <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> <span class="sr-only">Link to heading</span> </a> </h2> <ol> <li>Use configs</li> <li>Save results</li> <li>Have one script to compare</li> </ol> <hr> <h3 id="1-use-configs-for-all-pipeline-level-hyperparameters"> 1. Use configs: for all pipeline-level hyperparameters <a class="heading-link" href="#1-use-configs-for-all-pipeline-level-hyperparameters"> <i class="fa-solid fa-link" aria-hidden="true" title="Link to heading"></i> <span class="sr-only">Link to heading</span> </a> </h3> <ul> <li>Base config: captures every optional feature in the pipeline, shared across experiments</li> <li>Experiment config: modifies 1–2 items from the base config (overrides)</li> <li>Stored config: for each experiment run, make sure it can be traced back later</li> </ul> <blockquote> <p>Recommend using <code>*.yaml</code> for better readability <a href="https://github.com/MagicianQuant/TheMagicQuant/blob/swmao_dev/alpha_model_hyperliquid/configs/training_configs.yaml" class="external-link" target="_blank" rel="noopener">example</a></p>