Valley Semiconductor runs a 27B Qwen model on an FPGA in AWS. The 50 tok/s chip is still a slide
Valley Semiconductor streams a 27B Qwen model at 7.9 tokens/s from an FPGA in AWS. The 50 tok/s chip, and its touted power advantage, remain projections.

On 16 November Valley Semiconductor posted a demo to r/LocalLLM: a 27B Qwen model answering questions in a browser, served from an FPGA rented in AWS. About 260 points and 87 comments followed. The measured figures are real, the headline ones are projections, and the company's site prints both side by side.
VECTRA, the product, is a programmable inference chip for defense, robots and field equipment. It sits beside an existing Jetson or x86 host, targets a 25 W envelope and 32 GB of LPDDR5X. There is no silicon yet.
Measured on that FPGA, 4-bit weights, all 64 layers:
- 147 to 155 ms of FPGA time per token, 7.9 tokens/s on short prompts, 5.5 in the live chat with network, answers capped at 96 tokens
- 13.54 GB of weights streamed per token at 432.7 GB/s, 93.9% of peak HBM
- 0 of 248,320 outputs differing from the 4-bit reference, perplexity within 2.5% of full precision
- Llama 3.1 8B at 16 tokens/s, OLMoE at 41, same bitstream
The fast version is not built
The 50-plus tokens per second is the next target, using speculative decoding in the same 25 W. The nearest evidence is a simulation: the Gen 3 design in RTL at 15.6 to 22.2 tokens/s at 4K context. The site says it plainly: "The power and cost advantage is projected until the chip exists," and, lower down, "The power advantage is unproven until the chip exists."
Eight tokens a second, measured
A datacentre GPU serves the same model at a throughput the FPGA cannot approach, so the demo is a proof of function rather than of speed. It compares against a Jetson AGX Orin, claiming 8x the throughput of a denominator it measured itself, 5.9 tokens/s at 32 W.
The thread noticed. u/qualverse asked: "This is not a particularly interesting insight, everyone knows that already. What are you doing differently to solve the problem?" u/Ledeste went at context: "Because chip running llm is not new, but they always miss the ram needed to handle usable context."
What a note of interest is worth
It is raising money to put the core in silicon, calls the team "founder plus plan" and names Jack Al-Kahwati as founder. On 29 October 2026 Goodman Technologies signed a letter of support for VECTRA on its Puller counter-UAS vehicle, which the company calls "a statement of interest, not a purchase commitment." The Q1 2027 target is three written statements and one paid FPGA pilot.
Publishing that caveat yourself is rarer than the demo. The reason to watch is not serving, which on-device models that actually ship already do on established parts, but whether 93.9% of peak bandwidth on an FPGA becomes a 25 W card a robot can carry.

