CABiNet (ICRA 2021) vs YOLO26-sem on UAVid: accuracy, compute, and GPU latency [P]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
| Disclosure up front: I'm the original first author of CABiNet (ICRA 2021), so I'm not a neutral party. Everything below is reproducible from the repo. BackgroundCABiNet is a dual-branch CNN for real-time semantic segmentation: a high-res spatial branch, a lightweight context branch (global aggregation + local distribution) over a MobileNetV3 backbone, fused with a small FFM. Published 2021, then it went quiet. I came back this year, rebuilt the repo (PyTorch 2.x, Hydra, AMP, EMA, poly-LR, OHEM loss, CI + tests), and used it to ask one question on **UAVid**, the aerial dataset the original paper targeted: how does a purpose-built 2021 efficient architecture compare to a 2026 general multi-task model with a dedicated semantic-segmentation variant? What's actually controlled (and what isn't)Both models run off the same converted dataset and splits, the same ENet inverse-log class weighting (`cls_pw=0.5`), EMA weights for eval, and the same evaluation protocol: single-scale, no test-time augmentation. What is not matched: So this is not an architecture-only ablation. It's a controlled benchmark: the data representation, class weighting and evaluation are standardized, while each model keeps a model-specific training recipe. None of the rows above is an isolated experiment, so I haven't measured how much any single one is worth. Results — UAVid test split, 1024×1024, single-scale The dashed line is the accuracy/latency Pareto frontier: YOLO26n and YOLO26s sit on it as legitimate lower-latency points, while YOLO26m/l/x are dominated, each being both slower and less accurate than at least one CABiNet variant. CABiNet occupies the higher-accuracy end of the frontier. Three things worth pulling out:
MobileNetV3's depthwise convs are FLOP-cheap but not GPU-latency-cheap, which is why the frontier looks the way it does. The story is accuracy per millisecond at the higher-accuracy end, not "smallest and fastest." Qualitative — CABiNet-L vs YOLO26x-semWhere the +2.7 mIoU comes from. Per-class IoU on the UAVid test split, matched single-scale: UAVid Test Set Qualitative Comparison The gap is almost entirely the small / thin classes: people and vehicles. On the big region classes the two are within half a point, and YOLO26x is marginally ahead on Building. Two UAVid test frames, both single-scale; columns are input · YOLO26x-sem · CABiNet-L · ground truth. Row 2 shows a failure mode behind the Static-Car number: YOLO26x collapses the parking-lot structure into one Static-Car/Clutter mass and bleeds Building into the lot, while CABiNet-L tracks the ground truth more closely. These two frames were chosen to illustrate the per-class differences above, not as a representative random sample. Scope / limitations
Open-sourced
Links
The criticism I'd most like: is standardizing the data representation, class weighting and evaluation, while letting each model keep its native training recipe, a useful way to compare architectures from different lineages? If not, what would you standardize or change instead? [link] [comments] |
More from r/MachineLearning
-
Jev's calibration was measured. The LLMs won [D]
Sep 21
-
I built a framework-free prototype learner that lets local LLMs learn and correct facts instantly (1.6x–4x faster than backprop)[R]
Sep 21
-
For NeurIPS: Is Paris or Syndey better for networking with U.S. tech companies? [D]
Sep 21
-
Systems for Machine Learning[D]
Sep 21
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.