Proof-of-Useful-Work forced us to invent a quantization format that did not exist.
Pearl Protocol adds noise to both the weights and activations before matrix multiplication. That creates a constraint ordinary inference stacks do not have - the model values and the noise must fit together inside INT8. So we quantize the model to an effective W7A7 range, reserving one bit of headroom for the noise. The perturbed operands still fit in INT8, multiplication uses INT8 inputs with INT32 accumulation, and the low-rank noise can then be peeled off exactly, recovering the exact result of the quantized computation.
Existing quantization for INT7 were unsatisfactory, so we built our own - a non-trivial fusion of GPTQ-style weight reconstruction, SmoothQuant-style activation smoothing and custom inference kernels. The result is an end-to-end W7A7 pipeline that, in our internal benchmarks, even outperforms many FP8 baselines (in quality and in efficiency). We are writing a paper detailing this technique so stay tuned.
Looking forward, W7A7 is only an intermediate step. Our upcoming upgrade is designed to support FP8 workloads directly, eliminating the need for the extra integer-quantization step.