ZIP: 317
Title: Proportional Transfer Fee Mechanism
Owners: Aditya Bharadwaj <nighthawk24@gmail.com>
Daira Hopwood <daira@electriccoin.co>
Credits: Madars Virza
Kris Nuttycombe
Jack Grigg
Francisco Gindre
Status: Active
Category: Standards / Wallet
Obsoletes: ZIP 313
Created: 2022-08-15
License: MIT
Discussions-To: <https://forum.zcashcommunity.com/t/zip-proportional-output-fee-mechanism-pofm/42808>
Pull-Request: <https://github.com/zcash/zips/pull/631>
Terminology 
The key words "SHOULD", "SHOULD NOT", "RECOMMENDED", and "MAY" in this document are to be interpreted as described in BCP 14 1 when, and only when, they appear in all capitals.
The term "conventional transaction fee" in this document is in reference to the value of a transaction fee that is conventionally used by wallets, and that a user can reasonably expect miners on the Zcash network to accept for including a transaction in a block.
The terms "Mainnet, "Testnet", and "zatoshi" in this document are defined as in 2.
Abstract
The goal of this ZIP is to change the conventional fees for transactions by making them dependent on the number of inputs and outputs in a transaction, and to get buy-in for this change from wallet developers, miners and Zcash users.
Motivation
In light of recent Mainnet network activity, it is time to review and update the standard 1,000 zatoshi transaction fee set in ZIP 313 6.
The conventional transaction fee presently is 0.00001 ZEC or 1,000 zatoshis, as specified in ZIP 313. This allowed exploration of novel use cases of the Zcash blockchain. The Zcash network has operated for almost 2 years at a conventional transaction fee of 1,000 zatoshis, without consideration for the total number of inputs and outputs in each transaction. Under this conventional fee, some usage of the chain has been characterized by high-output transactions with 1,100 outputs, paying the same conventional fee as a transaction with 2 outputs.
The objective of the new fee policy, once it is enforced, is for fees paid by transactions to fairly reflect the processing costs that their inputs and outputs impose on various participants in the network. This will tend to discourage usage patterns that cause either intentional or unintentional denial of service, while still allowing low fees for regular transaction use cases.
Requirements
- The conventional fee formula should not favour or discriminate against any of the Orchard, Sapling, or transparent protocols.
- The fee for a transaction should scale linearly with the number of inputs and/or outputs.
- Users should not be penalised for sending transactions constructed with padding of inputs and outputs to reduce information leakage. (The default policy employed by zcashd and the mobile SDKs pads to two inputs and two outputs for each shielded pool used by the transaction).
- Users should be able to spend a small number of UTXOs or notes with value below the marginal fee per input.
Specification
Notation
Let
\(\mathsf{min}(a, b)\)
be the lesser of
\(a\)
and
\(b\!\)
.
Let
\(\mathsf{max}(a, b)\)
be the greater of
\(a\)
and
\(b\!\)
.
Let
\(\mathsf{floor}(x)\)
be the largest integer
\(\leq x\!\)
.
Let
\(\mathsf{ceiling}(x)\)
be the smallest integer
\(\geq x\!\)
.
Fee calculation
This specification defines several parameters that are used to calculate the conventional fee:
| Parameter | Value | Units |
|---|---|---|
| \(marginal\_fee\) | \(5000\) | zatoshis per logical action (as defined below) |
| \(grace\_actions\) | \(2\) | logical actions |
| \(p2pkh\_standard\_input\_size\) | \(150\) | bytes |
| \(p2pkh\_standard\_output\_size\) | \(34\) | bytes |
Wallets implementing this specification SHOULD use a conventional fee calculated in zatoshis per the following formula:
The inputs to this formula are taken from transaction fields defined in the Zcash protocol specification 3:
| Input | Units | Description |
|---|---|---|
| \(tx\_in\_total\_size\) | bytes | total size in bytes of the tx_in field |
| \(tx\_out\_total\_size\) | bytes | total size in bytes of the tx_out field |
| \(nJoinSplit\) | number | the number of Sprout JoinSplits |
| \(nSpendsSapling\) | number | the number of Sapling spends |
| \(nOutputsSapling\) | number | the number of Sapling outputs |
| \(nActionsOrchard\) | number | the number of Orchard actions |
It is not a consensus requirement that fees follow this formula; however, wallets SHOULD create transactions that pay this fee, in order to reduce information leakage, unless overridden by the user.
Rationale for logical actions
Click to show/hide
The intention is to make the fee paid for a transaction depend on its impact on the network, without discriminating between different protocols (Orchard, Sapling, or transparent). The impact on the network depends on the numbers of inputs and outputs.
A previous proposal used \(inputs + outputs\) instead of logical actions. This would have disadvantaged Orchard transactions, as a result of an Orchard Action combining an input and an output. The effect of this combining is that Orchard requires padding of either inputs or outputs to ensure that the number of inputs and outputs are the same. Usage of Sapling and transparent protocols does not require this padding, and so this could have effectively discriminated against Orchard.
Rationale for the chosen parameters
Click to show/hide
Grace Actions
Why not just charge per-action, without a grace window?
- This ensures that there is no penalty to padding a 1-action transaction to a 2-action transaction. Such padding is desirable to reduce information leakage from input and output arity, and is the standard approach used by zcashd and the mobile SDK transaction builder.
- Without a grace window, an input with value below the marginal fee would never be worth including in the resulting transaction. With a grace window, an input with value below \(marginal\_fee\) is worth including, if a second input is available that covers both the primary output amount and the conventional transaction fee.
Why a grace window of 2?
A 1-in, 2-out (or 2-action) transaction is the smallest possible transaction that permits both an output to a recipient, and a change output. However, as stated above, zcashd and the mobile SDK transaction builder will pad the number of inputs to at least 2.
Let \(min\_actions\) be the minimum number of logical actions that can be used to execute economically relevant transactions that produce change. Due to the aforementioned padding, \(min\_actions = 2\) .
Having a grace window size greater than \(min\_actions\) would increase the cost to create such a minimal transaction. If the cost we believe that users will tolerate for a minimal transaction is \(B\) , then possible choices of \(marginal\_fee\) are bounded above by \(B / \max(min\_actions, grace\_actions)\) . Therefore, the optimal choice of \(grace\_actions\) to maximize the per-logical-action cost of denial-of-service attacks for a given \(B\) , is \(grace\_actions = min\_actions = 2\) . This also ensures that a denial-of-service adversary does not gain a significant per-logical-action cost advantage by using transactions with a smaller or larger number of logical actions.
Transparent Contribution
The specified formula calculates the contribution of transparent inputs and outputs based on their total size relative to a typical input or output. Another considered approach was to calculate this contribution simply as \(\mathsf{max}(transparent\_inputs, transparent\_outputs)\) . However, this would allow a denial-of-service adversary to create transactions with transparent components containing arbitrarily large scripts.
The chosen values for \(p2pkh\_standard\_input\_size\) and \(p2pkh\_standard\_output\_size\) are based on the maximum encoded length for P2PKH inputs and outputs, as follows:
-
\(p2pkh\_standard\_input\_size\)
- outpoint: 36 bytes
- script: 110 bytes
- 1 (overall length) + 1 (signature length) + 72 (signature) + 1 (sighash type) + 1 (pubkey length) + 33 (pubkey) + 1 (margin)
- sequence: 4 bytes
-
\(p2pkh\_standard\_output\_size\)
- value: 8 bytes
- script: 26 bytes
- 1 (script length) + 25 (P2PKH script)
P2SH outputs are smaller than P2PKH outputs, but P2SH inputs may be larger than P2PKH inputs. For example a 2-of-3 multisig input is around 70% larger, and is counted as such when computing the number of logical actions.
Marginal Fee
This returns the conventional fee for a minimal transaction (as described above) to the original conventional fee of 10000 zatoshis specified in 6, and imposes a non-trivial cost for potential denial-of-service attacks.
Transaction relaying
zcashd, zebrad, and potentially other node implementations, implement fee-based restrictions on relaying of mempool transactions. Nodes that normally relay transactions are expected to do so for transactions that pay at least the conventional fee as specified in this ZIP, unless there are other reasons not to do so for robustness or denial-of-service mitigation.
If a transaction has more than \(block\_unpaid\_action\_limit\) "unpaid actions" as defined by the Recommended algorithm for block template construction, it will never be mined by that algorithm. Nodes MAY drop these transactions, or transactions with more unpaid actions than a configurable limit (see the Deployment section for actual behaviour of node implementations).
Mempool size limiting
zcashd and zebrad limit the size of the mempool as described in 7. This specifies a \(low\_fee\_penalty\) that is added to the "eviction weight" if the transaction pays a fee less than the conventional transaction fee. This threshold is modified to use the new conventional fee formula.
Block production
Miners, mining pools, and other block producers, select transactions for inclusion in blocks using a variety of criteria. The algorithm in the following section is planned to be implemented by zcashd and zebrad.
Recommended algorithm for block template construction
Define constants \(weight\_ratio\_cap = 4\) and \(block\_unpaid\_action\_limit = 50\!\) .
Let \(conventional\_fee(tx)\) be the conventional fee for transaction \(tx\) calculated according to the section Fee calculation.
Let \(unpaid\_actions(tx) = \begin{cases}\mathsf{max}\!\left(0,\, \mathsf{max}(grace\_actions,\, tx.\!logical\_actions) - \mathsf{floor}\!\left(\frac{tx.fee}{marginal\_fee}\right)\right),&\textsf{if }tx\textsf{ is a non-coinbase transaction} \\ 0,&\textsf{if }tx\textsf{ is a coinbase transaction.}\end{cases}\)
Let \(block\_unpaid\_actions(block) = \sum_{tx \,\in\, block}\, unpaid\_actions(tx)\) .
The following algorithm is RECOMMENDED for constructing a block template from a set of transactions in a node's mempool:
- Set the block template \(T\) to include a placeholder for the coinbase transaction (see Note below).
- For each transaction \(tx\) in the mempool, calculate \(tx.\!weight\_ratio = \mathsf{min}\!\left(\frac{\mathsf{max}(1,\, tx.fee)}{conventional\_fee(tx)},\, weight\_ratio\_cap\right)\!\) and add the transaction to the set of candidate transactions.
- Repeat while there is any candidate transaction that pays at least the conventional fee:
- Pick one of those transactions at random with probability in direct proportion to its \(weight\_ratio\!\) , and remove it from the set of candidate transactions. Let \(B\) be the block template \(T\) with this transaction included.
- If \(B\) would be within the block size limit and block sigop limit 4, set \(T := B\!\) .
- Repeat while there is any candidate transaction:
- Pick one of those transactions at random with probability in direct proportion to its \(weight\_ratio\!\) , and remove it from the set of candidate transactions. Let \(B\) be the block template \(T\) with this transaction included.
- If \(B\) would be within the block size limit and block sigop limit 4 and \(block\_unpaid\_actions(B) \leq block\_unpaid\_action\_limit\!\) , set \(T := B\!\) .
- Return \(T\!\) .
Note: In step 1, the final coinbase transaction cannot be included at this stage because it depends on the fees paid by other transactions. In practice, this difficulty can be overcome by reserving sufficient space and sigops to allow modifying the coinbase transaction as needed, when testing against the block space and block sigop limits in steps 3b and 4b.
Rationale for block template construction algorithm
It is likely that not all wallets will immediately update to pay the (generally higher) fees specified by this ZIP. In order to be able to deploy this block template algorithm more quickly while still giving transactions created by such wallets a reasonable chance of being mined, we allow a limited number of "unpaid" logical actions in each block. Roughly speaking, if a transaction falls short of paying the conventional transaction fee by \(k\) times the marginal fee, we count that as \(k\) unpaid logical actions.
Regardless of how full the mempool is (according to the ZIP 401 7 cost limiting), and regardless of what strategy a denial-of-service adversary may use, the number of unpaid logical actions in each block is always limited to at most \(block\_unpaid\_action\_limit\!\) .
The weighting in step 2 does not create a situation where the adversary gains a significant advantage over other users by paying more than the conventional fee, for two reasons:
- The weight ratio cap limits the relative probability of picking a given transaction to be at most \(weight\_ratio\_cap\) times greater than a transaction that pays exactly the conventional fee.
- Compare the case where the adversary pays \(c\) times the conventional fee for one transaction, to that where they pay the conventional fee for \(c\) transactions. In the former case they are more likely to get each transaction into the block relative to competing transactions from other users, but those transactions take up less block space, all else (e.g. choice of input or output types) being equal. This is not what the attacker wants; they get a transaction into the block only at the expense of leaving more block space for the other users' transactions.
The rationale for choosing \(weight\_ratio\_cap = 4\) is as a compromise between not allowing any prioritization of transactions relative to those that pay the conventional fee, and allowing arbitrary prioritization based on ability to pay.
Calculating \(tx.\!weight\_ratio\) in terms of \(\mathsf{max}(1,\, tx.\!fee)\) rather than just \(tx.\!fee\) avoids needing to define "with probability in direct proportion to its \(weight\_ratio\!\) " for the case where all remaining candidate transactions would have \(weight\_ratio = 0\!\) .
Incentive compatibility for miners
Miners have an incentive to make this change because:
- it will tend to increase the fees they are due;
- fees will act as a damping factor on the time needed to process blocks, and therefore on orphan rate.