The implementation of patch_accelerate_recursively_apply contains duplicated code for defining and applying _patched_recursively_apply. Since accelerate.utils.recursively_apply is just a re-export of accelerate.utils.operations.recursively_apply, we can define the wrapper once and reuse it, which improves maintainability and readability.

def patch_accelerate_recursively_apply():
    """
    Patch accelerate.utils.operations.recursively_apply to avoid raising
    TypeError when encountering Unsloth's EmptyLogits class.
    """
    try:
        import accelerate.utils.operations as acc_ops
        original_recursively_apply = acc_ops.recursively_apply

        @functools.wraps(original_recursively_apply)
        def _patched_recursively_apply(func, data, *args, **kwargs):
            if type(data).__name__ == "EmptyLogits":
                return data
            return original_recursively_apply(func, data, *args, **kwargs)

        acc_ops.recursively_apply = _patched_recursively_apply

        try:
            import accelerate.utils as acc_utils
            if hasattr(acc_utils, "recursively_apply"):
                acc_utils.recursively_apply = _patched_recursively_apply
        except Exception:
            pass
    except Exception:
        pass

According to PEP 8, spaces should not be used around the = sign when used to indicate a keyword argument or a default parameter value. Please remove the spaces around = in error_on_other_type = True.

Handle EmptyLogits before Accelerate debug verification

When Accelerate debug mode is enabled in distributed evaluation (ACCELERATE_DEBUG_MODE=1 / PartialState().debug), gather runs its verification wrapper before it reaches _gpu_gather and this patched recursively_apply; that wrapper calls find_device/get_shape on the logits structure, so a top-level EmptyLogits still raises before the bypass, and a nested one can make shape comparison fail across processes. This means the evaluation path this patch is meant to fix still breaks under Accelerate's debug mode unless the EmptyLogits case is handled at the operation/wrapper level as well.

Useful? React with 👍 / 👎.