nemo-relay-instrument-calls
SolidUse this skill when an application owns tool or LLM/provider call sites and needs to wrap them with NeMo Relay scopes and managed execution APIs for lifecycle events, middleware, or guardrails.
AI & Automation 122 stars
57 forks Updated today Apache-2.0
Install
Quality Score: 86/100
Stars 20%
Recency 20%
Frontmatter 20%
Documentation 15%
Issue Health 10%
License 10%
Description 5%
Skill Content
# Instrument Tool And LLM Calls
Use this skill when an app already has tool functions or model/provider calls and
needs to run them through NeMo Relay correctly.
Keep the original callable behavior stable while adding Relay lifecycle capture.
## Default Guidance
- Put a scope around the natural agent, request, workflow, or graph boundary.
- Use managed execution APIs first:
- Rust: `tool_call_execute(ToolCallExecuteParams::builder()...)`,
`llm_call_execute(LlmCallExecuteParams::builder()...)`
- Python: `tools.execute(...)`, `llm.execute(...)`
- Node.js: `toolCallExecute(...)`, `llmCallExecute(...)`
- Go: `tools.Execute(...)`, `llm.Execute(...)` or the top-level wrappers
- Use manual lifecycle APIs only when the host framework cannot be wrapped by the
managed execute helpers.
## Embedded Runtime Semantics
- Managed tool and LLM execution runs conditional-execution guardrails first on
the raw input. If rejected, the runtime emits a standalone mark event and does
not run request intercepts or the callable.
- Request intercepts run after conditional guardrails and rewrite the real input
that reaches execution intercepts and the callback.
- Sanitize-request guardrails affect emitted start-event payloads only. They do
not rewrite the caller-visible request or arguments.
- Execution intercepts wrap the callback with the middleware `next` pattern and
may short-circuit by returning their own result.
- Sanitize-response guardrails affect emitted end-event p...
Details
- Author
- NVIDIA
- Repository
- NVIDIA/NeMo-Relay
- Created
- 4 months ago
- Last Updated
- today
- Language
- Rust
- License
- Apache-2.0
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
AI & Automation Solid
nemo-relay-instrument-context-isolation
Use this skill when concurrent requests, async tasks, threads, workers, goroutines, or agents need independent NeMo Relay scope stacks and correct ancestry propagation.
122 Updated today
NVIDIA AI & Automation Solid
nemo-relay-debug-runtime-integration
Use this skill when NeMo Relay is installed or imported but application-side runtime behavior is missing or incorrect, including load failures, inactive scopes, missing events, and plugin or adaptive wiring problems.
122 Updated today
NVIDIA AI & Automation Solid
add-middleware
Add a new guardrail or intercept type to the NeMo Relay middleware pipeline
122 Updated today
NVIDIA