What is Tool Calling?

Published: November 2026

How tool calling works

An application describes one or more tools to the model, including their names, purpose, and expected inputs. When the model decides a tool is needed, it returns a structured tool request. The application validates and executes the request, then returns the tool result to the model. The model can use that result to answer the user, call another tool, or continue a multi-step workflow.

Tool calling vs. function calling

The terms are often used interchangeably. Function calling traditionally refers to models generating structured arguments for developer-defined functions. Tool calling is broader and can include hosted tools, search, code execution, computer use, MCP servers, or other capabilities. The underlying pattern is the same: the model requests an external capability instead of pretending it can perform the action itself.

Customer service examples

An AI agent might call a tool to look up an order, verify an account, retrieve a policy, schedule an appointment, create a case, issue an approved credit, or update a customer record. Tool access makes resolution possible because many customer requests require changes in operational systems, not just answers from a knowledge base.

Security and governance

Treat model-generated tool requests as untrusted input. Validate arguments, enforce role and customer permissions, limit available tools, use least-privilege credentials, and require approval for high-impact actions. Audit logs should record the requested action, execution result, and identity or agent responsible.

Related terms

How NiCE is Redefining Customer Experience

NiCE offers the industry’s only unified AI platform for customer service automation. CXone revolutionizes how organizations automate customer service from start to finish—with channels, data, end-to-end workflows, and enterprise knowledge converging to improve customer experience at scale. With domain specific AI trained on the industry’s largest CX dataset, an open framework with endless integration possibilities, and a complete suite of advanced AI applications, CXone is one platform built for organizations of all sizes to deliver seamless customer service experiences, boost operational efficiency, and drive better outcomes.

Back to Glossary

Contact us

If you would like to know more about our platform or just have additional questions about our products or services, please submit the contact form. For general questions or customer support please visit our Contact us page.

Frequently asked questions