LayCoder: UI Layout Completion with an Encoder-Only Transformer and Layout Tokenizer

Abstract: The growing complexity of user interface (UI) design calls for effective methods to understand, complete, and refine layout structures. While prior work has focused pre-dominantly on generating UI layouts from scratch, completing partially designed interfaces is equally critical, particularly in iterative design workflows and scenarios involving incomplete prototypes. In this study, we address the UI layout completion task for mobile app screens using an encoder-only transformer architecture with masked modeling and a layout tokenizer. By representing UI elements as discrete tokens, we formulate layout completion as a sequence prediction problem that leverages global context to infer missing components. We evaluate our approach on subsets of the RICO dataset designed with varying constraints on UI element types and spatial overlap, and report results using standard layout metrics: Coverage, Intersection over Union (IoU), Max IoU, and Alignment. The experiments demonstrate that the proposed method achieves substantial improvements over LayoutFormer++, a widely adopted baseline in UI layout generation, particularly in Coverage, and in several cases, IoU, Max IoU, and Alignment. Additional experiments on noise-reduced subsets reveal that dataset curation can enhance spatial consistency but may also reduce Coverage, reflecting an inherent trade-off between completeness and structural precision. These findings highlight both the effectiveness and the limitations of encoder-only masked modeling for layout completion, and underscore the importance of balancing model design with dataset construction when tackling complex UI design tasks.

Iskandar Salama, Luiz Henrique Mormille and Masayasu Atsumi. “LayCoder: UI Layout Completion with an Encoder-Only Transformer and Layout Tokenizer”. International Journal of Advanced Computer Science and Applications (IJACSA) 17.2 (2026). http://dx.doi.org/10.14569/IJACSA.2026.0170209

@article{Salama2026,
title = {LayCoder: UI Layout Completion with an Encoder-Only Transformer and Layout Tokenizer},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2026.0170209},
url = {http://dx.doi.org/10.14569/IJACSA.2026.0170209},
year = {2026},
publisher = {The Science and Information Organization},
volume = {17},
number = {2},
author = {Iskandar Salama and Luiz Henrique Mormille and Masayasu Atsumi}
}