[SOT] Handle `in_sot_simulation_mode` same as psdb functions #73332

DrRyanHuang · 2025-06-14T10:19:03Z

PR Category

Execute Infrastructure

PR Types

Improvements

Description

原有的 guard sot_simulation_mode_guard 主要是用来记录是否在进行SOT模拟这个状态

def in_sot_simulation_mode() -> bool:
	return global_var._in_sot_simulation_mode_

sot_simulation_mode_guard 和 in_sot_simulation_mode 其实都通过访问 global_var 这个全局变量来进行状态的读写

但在 nn.Layer 的 __call__ 中：

    def __call__(self, *inputs: Any, **kwargs: Any) -> Any:
        if (
            (not in_to_static_mode())
            and (not self._forward_pre_hooks)
            and (not self._forward_post_hooks)
            and (self.__class__._build_once is Layer._build_once or self._built)
            and in_dygraph_mode()
            and (not in_profiler_mode() or in_sot_simulation_mode())
        ):
            return self.forward(*inputs, **kwargs)
        else:
            return self._dygraph_call_func(*inputs, **kwargs)

在模拟执行过程中，开启 profile 时，in_sot_simulation_mode 会被加入 guard 中，导致 Guard miss 多次后，自动回退到动态图执行

[Cache] missed at frame.f_locals['self'].embeddings.__call__.__globals__['in_to_static_mode'].__globals__['global_var']._in_sot_simulation_mode_ == True

这里我们直接移除 global_var._in_sot_simulation_mode_ 来避免被加到 guard 中

同时 in_sot_simulation_mode 直接返回 False

def in_sot_simulation_mode() -> bool:
	return False

在非SOT模拟过程中，这里原生Python执行，直接返回 False，没毛病
在 SOT 模拟时，in_sot_simulation_mode 是 UserDefinedFunctionVariable 只需要在这里特判一下，让其返回 True 即可

cc @SigureMo
PCard-66972

SigureMo

LGTMeow

DrRyanHuang requested review from XiaoguangHu01, zhiqiu, Xreki and qili93 as code owners June 14, 2025 10:19

rm sot_simulation_mode_guard

3e64450

DrRyanHuang force-pushed the sot_simulation_mode_guard branch from 933fd2a to 3e64450 Compare June 14, 2025 10:19

SigureMo changed the title ~~[SOT] rm sot_simulation_mode_guard~~ [SOT] Handle in_sot_simulation_mode same as psdb functions Jun 14, 2025

SigureMo changed the title ~~[SOT] Handle in_sot_simulation_mode same as psdb functions~~ [SOT][3.13] Handle in_sot_simulation_mode same as psdb functions Jun 14, 2025

SigureMo changed the title ~~[SOT][3.13] Handle in_sot_simulation_mode same as psdb functions~~ [SOT] Handle in_sot_simulation_mode same as psdb functions Jun 14, 2025

SigureMo approved these changes Jun 14, 2025

View reviewed changes

SigureMo merged commit 5024e24 into PaddlePaddle:develop Jun 14, 2025
97 of 130 checks passed

DrRyanHuang deleted the sot_simulation_mode_guard branch June 15, 2025 05:23

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[SOT] Handle `in_sot_simulation_mode` same as psdb functions #73332

[SOT] Handle `in_sot_simulation_mode` same as psdb functions #73332

Uh oh!

DrRyanHuang commented Jun 14, 2025 •

edited

Loading

Uh oh!

SigureMo left a comment

Uh oh!

Uh oh!

Uh oh!

[SOT] Handle in_sot_simulation_mode same as psdb functions #73332

[SOT] Handle in_sot_simulation_mode same as psdb functions #73332

Uh oh!

Conversation

DrRyanHuang commented Jun 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

PR Category

PR Types

Description

Uh oh!

SigureMo left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

[SOT] Handle `in_sot_simulation_mode` same as psdb functions #73332

[SOT] Handle `in_sot_simulation_mode` same as psdb functions #73332

DrRyanHuang commented Jun 14, 2025 •

edited

Loading