Artificial Intelligence |
Authors: Md Shafiul Alam
Large language model (LLM) applications used in business settings are often optimized by informal prompt editing: shortening instructions, adding examples, increasing retrieved context, or imposing output constraints. Such edits are usually evaluated anecdotally, even though each prompt component affects quality, cost, latency, and operational risk. This paper introduces Marginal Value of Tokens (MVT), a component-level framework for measuring the incremental business utility of prompt segments relative to their token and cost footprint.The framework treats a prompt as a structured composition of functional components, including system instructions, task rules, business policy, retrieved context, chat history, few-shot examples, tool definitions, and output schemas. We define cost- and latency-adjusted utility, propose paired ablation and coalition-based estimators for component attribution, and give operational rules for classifying prompt components as high-value, low-value, negative-value, reusable, model-dependent, or workflow-dependent. The methodology is designed for common business workloads, including customer support and policy question answering, document summarization, and structured information extraction. The central argument is that business LLM systems should not minimize tokens blindly. They should maximize useful business output per token by preserving necessary context, pruning harmful context, compressing redundant history, caching reusable prefixes, and measuring prompt changes under non-inferiority constraints. The contribution is a practical measurement framework and experimental protocol for cost-efficient LLM adoption in business environments.
Comments: 17 Pages.
Download: PDF
[v1] 2026-04-27 05:11:18
Unique-IP document downloads: 7 times
ai.Vixra.org is a AI assisted e-print repository rather than a journal. Articles hosted may not yet have been verified by peer-review and should be treated as preliminary. In particular, anything that appears to include financial or legal advice or proposed medical treatments should be treated with due caution. ai.Vixra.org will not be responsible for any consequences of actions that result from any form of use of any documents on this website.
Add your own feedback and questions here:
You are equally welcome to be positive or negative about any paper but please be polite. If you are being critical you must mention at least one specific error, otherwise your comment will be deleted as unhelpful.