FTAS 4.1: AI Factory Automation, Expanded FMCLI Coverage, and Large-Scale Validation

We’re excited to announce FTAS 4.1. This release adds 142 new test cases and brings the framework to 1,072 test cases in total. Its headline feature is automated validation for AI Factory fabrics.
Spotlight: AI Factory (N-S) automation
AI-scale fabrics are built and operated through orchestration, not box-by-box configuration. Validating them needs the same end-to-end view. FTAS 4.1 adds an ordered 39-case AI Factory test plan that checks the full ONES-driven fabric lifecycle:
- Design and planning: creating a design, fabric types, scalable units, tenancy modes, network planes, addressing and segmentation, storage mode and isolation options.
- Deployment and onboarding: device and topology views, switch and server inventory, border-leaf ports, fabric deployment and tenant orchestration.
- Control-plane parity: ONES API inventory compared with the switch CLI, gNMI agent checks, and host IP, VLAN, and gateway verification.
- Data-plane proof: Ixia traffic across the deployed fabric, with checks on ECMP, tenant isolation, same-VRF and cross-VRF connectivity, route leaking and border connectivity.
The plan runs as a single ordered flow and cleans up its lab files at the end. A ready-made suite file is included to launch it.
By the numbers
New test cases in this release
| Category | Count |
|---|---|
| Total new test cases added | 142 |
| SONiC Framework | 88 |
| FMCLI | 54 |
Total test cases after this release
| Category | Count |
|---|---|
| SONiC Framework | 599 |
| FMCLI | 188 |
| Telemetry | 285 |
| Total FTAS test cases | 1072 |
What else is new
- FTAS with FMCLI: 54 new test cases bring FMCLI coverage to 188.
- BGP flap stability: 3 tests check that BGP stays stable under ARP clear, staggered interface flaps and server subnet scans.
- BGP convergence at IPv6 scale: 18 tests at 32k, 64k and 128k routes, with 2k NDP entries.
- BGP unnumbered: link flap, route churn, burst flap and rapid flap.
- Numbered SVI with 32 and 64 ECMP: link flap, burst flap and rapid flap.
- L3VNI multi-tenancy: 12 tests cover 3 VRFs with 128 VLANs, ARP aging and forced clear, uplink and underlay link flaps, spine power-off, Ixia port change, max-ACL ingress drop and cleanup.
- L2VNI scale VLANs: 4 new tests cover spine power-off and underlay link sweep, each with FDB aging and FDB clear.
- BFD session scale: 4 tests with 64 and 128 sessions cover silent failure and BGP container restart.
- ACL loader (CONFIG_DB): 6 tests cover incremental update and switchover.
Frequently Asked Questions
How do I validate an AI factory fabric end-to-end?
FTAS 4.1 adds an ordered 39-case AI Factory test plan that checks the full ONES-driven fabric lifecycle. It covers design and planning, deployment and onboarding, control-plane parity, and data-plane proof, and runs as a single ordered flow.
How do I verify that orchestrator inventory matches what is on the switches?
The FTAS 4.1 AI Factory plan compares ONES API inventory with the switch CLI. It also runs gNMI agent checks and verifies host IP, VLAN, and gateway settings.
How do I test tenant isolation in a multi-tenant AI fabric?
FTAS 4.1 sends Ixia traffic across the deployed fabric and checks ECMP, tenant isolation, same-VRF and cross-VRF connectivity, route leaking, and border connectivity.
How do I test BGP convergence at large IPv6 route scale?
FTAS 4.1 includes 18 BGP convergence tests at 32k, 64k, and 128k IPv6 routes, with 2k NDP entries.
How do I test BGP stability under link flaps?
FTAS 4.1 includes 3 tests that check BGP stays stable under ARP clear, staggered interface flaps, and server subnet scans. It also tests BGP unnumbered against link flap, route churn, burst flap, and rapid flap.
How do I test L3VNI multi-tenancy resilience?
FTAS 4.1 adds 12 L3VNI tests across 3 VRFs with 128 VLANs. They cover ARP aging and forced clear, uplink and underlay link flaps, spine power-off, Ixia port change, max-ACL ingress drop, and cleanup.
How do I test BFD at session scale?
FTAS 4.1 includes 4 BFD tests with 64 and 128 sessions, covering silent failure and BGP container restart.
What is new in FTAS 4.1?
FTAS 4.1 adds 142 new test cases, bringing the total to 1,072. The headline feature is automated validation for AI Factory fabrics, along with 54 new FMCLI test cases that bring FMCLI coverage to 188.
Ready to validate your AI Factory fabric end-to-end? See how FTAS 4.1 automates testing from design and deployment through control-plane and data-plane checks.


