Artificial Intelligence |
Authors: Brent Hartshorn
Robotic vision policies trained on photorealistic synthetic imagery fail when the real world presentsa texture, a shadow or a reflection the renderer never produced. We argue the fault is the representation rather than the realism: a policy that consumes photographs must learn to ignore appearance, when it could instead be handed a representation from which appearance has already been removed. We describe a chained architecture in which a perception stage converts camera input into a non-photorealistic line drawing paired with a semantic map, and a control policy consumes only that abstraction. Decoupling perception from control allows each to be trained independently [4], and abstract intermediate representations such as sketches are known to preserve spatial grounding while discarding visual distraction [5].The contribution is an open simulator that makes the architecture testable end to end: it generatesthe aligned multi-modal corpus the interface requires — photorealistic, line art, object index and metric depth from one viewpoint — carries a physically grounded robot with an optional rigid-body contact backend, imports externally authored scenes and assets [3], and executes the real control firmware against the simulated plant at two distinct fidelities: a value-level seam fast enough for the training loop, and an offline register-level gate in which the same commands are driven through emulated I2 C peripherals, H-bridges and a serial lidar protocol [11]. The second catches a class of defect the first cannot represent, and we quantify the divergence between them. We report a perception result on 479 samples, a multi-label scene-description head trained from labels the renderer already knew, and a control policy cloned from a privileged expert that reaches its goal in 8/8 held-out scenes while seeing only the abstraction.Every number is reported beside the score of doing nothing, and we record the two hypotheses about thecontrol bottleneck that measurement destroyed, together with two measurement choices the register-level gate itself invalidated.
Comments: 13 Pages.
Download: PDF
[v1] 2026-09-12 18:40:58
Unique-IP document downloads: 15 times
ai.Vixra.org is a AI assisted e-print repository rather than a journal. Articles hosted may not yet have been verified by peer-review and should be treated as preliminary. In particular, anything that appears to include financial or legal advice or proposed medical treatments should be treated with due caution. ai.Vixra.org will not be responsible for any consequences of actions that result from any form of use of any documents on this website.
Add your own feedback and questions here:
You are equally welcome to be positive or negative about any paper but please be polite. If you are being critical you must mention at least one specific error, otherwise your comment will be deleted as unhelpful.