microduck_rl
microduck_rl: análisis de un rollout al optimizador
Fixtures deterministas para reset, acción, reward y export.
Qué aprenderás
- Map environment, simulator, and runner
- Run a reproducible simulation
- Identify sim-to-real gates
Antes de empezar
- Basic Git and command-line usage
- Comfort reading a project README
You can explain the project, run its documented first step, and decide what to verify before adopting it.
Conclusiones clave
- A single rollout exposes most contracts.
- Seed and device behavior need tests.
- Simulation fixtures are safer than hardware regressions.
Read the repository as a graph
Sigue reset, observation, action clip, physics, reward, done, buffer y optimizer y registra shapes, device y contadores.
Use the pinned source evidence, record versions and assumptions, and ask a qualified reviewer to validate the result before adopting it.
Trace a rollout
Follow reset, observation construction, action clipping, physics stepping, reward accumulation, termination, buffer insertion, and optimizer update. Record tensor shapes, devices, and episode counters.
Safe contributions
Add fixtures for reward terms, reset determinism, action bounds, seed parity, checkpoint metadata, and simulator failures without requiring a physical robot.
Use the pinned source evidence, record versions and assumptions, and ask a qualified reviewer to validate the result before adopting it.
Cómo elegir
| Criterio | Opción A | Opción B |
|---|---|---|
| Best when | You need predictable behavior and easy auditing | You need adaptive optimization and have reliable telemetry |
| Main risk | May leave performance on the table | Can become difficult to explain or debug |
Pasos de implementación
- 1
Pin source and dependencies.
- 2
Trace reset-to-update symbols.
- 3
Inspect limits, rewards, and logs.
- 4
Add deterministic fixture tests.
Ejemplo para copiar
fixture -> env registry -> reset/obs
-> policy/action clip -> mjlab step
-> reward/done -> buffer -> optimizer/exportPreguntas frecuentes
Can I inspect the code without GPU?
Usually yes with static analysis and tiny CPU fixtures; validate GPU-specific paths separately.
What is a useful first issue?
A deterministic test for reset, reward, action bounds, or checkpoint metadata.
Fuentes
- microduck_rl repositoryFuente verificada 2026-08-31