: Realizing they could not stop the community, a company called Benchmark Sims (BMS) sought to legitimize their work. The Masterpiece Reborn: Falcon BMS
One of the most significant performance improvements in Falcon is its use of Multi-Query Attention. While standard transformers use Multi-Head Attention (MHA), Falcon 40B implements MQA, which significantly reduces the memory bandwidth requirements during inference. Specifically, the model uses . This 16:1 ratio dramatically reduces the size of the KV cache during autoregressive decoding, leading to faster generation times and lower memory usage. The source code for this crucial component can be found in the modelling_RW.py file.
For a decade, the BMS team operated under a "Don't Ask, Don't Tell" policy with the corporate owners. They weren't selling the game; they were fixing a masterpiece. The exclusive code allowed them to do the impossible: rewrite the graphics engine for DirectX 11, implement high-fidelity flight models, and make the F-16's cockpit so realistic that real-world pilots began using it for "desk training." falcon 40 source code exclusive
For organizations that meet sub‑millisecond latency and require a supported, enterprise‑grade product, Falcon 40 presents a compelling option—provided they are comfortable with the licensing model and the associated vendor lock‑in.
The inference code ( serve/falcon_server.py ) shows built-in support for: : Realizing they could not stop the community,
TII is reportedly preparing a "Source Available Plus" license for Falcon 180 that releases the custom Flash kernels to the public, keeping only the orchestration layer proprietary.
Today, Falcon 4.0 lives on through the continuous updates of Falcon BMS, which features modern graphics, rewritten avionics, and VR support. The 2013 code leak did not destroy the franchise; instead, it cemented Falcon 4.0 as an immortal blueprint for complex simulation engineering. Specifically, the model uses
As graphics hardware evolved throughout the early 2000s, modders injected support for DirectX upgrades, high-resolution textures, and entirely new aircraft models into the hardcoded architecture of the engine. The Legal High-Wire Act and Falcon BMS
Falcon 40B emerged from TII's ambitious goal to create the best open-source LLM available. The result is a 40-billion-parameter causal decoder-only model trained on an unprecedented of data. The primary source of this data is the "RefinedWeb" dataset, a high-quality, filtered, and deduplicated web corpus that TII developed and enhanced with curated corpora.