ModelMate: A recommender for textual modeling languages based on pre-trained language models
2024 (English)In: 27TH INTERNATIONAL ACM/IEEE CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS, MODELS, ASSOC COMPUTING MACHINERY , 2024, p. 183-194Conference paper, Published paper (Refereed)
Abstract [en]
Current DSL environments lack smart editing facilities intended to enhance modeler productivity and cannot keep pace of current developments of integrated development environments based on AI. In this paper, we propose an approach to address this shortcoming through a recommender system specifically tailored for textual DSLs based on the fine-tuning of pre-trained language models. We identify three main tasks: identifier suggestion, line completion, and block completion, which we implement over the same fine-tuned model and we propose a workflow to apply these tasks to any textual DSL. We have evaluated our approach with different pre-trained models for three DSLs: Emfatic, Xtext and a DSL to specify domain entities, showing that the system performs well and provides accurate suggestions. We compare it against existing approaches in the feature name recommendation task showing that our system outperforms the alternatives. Moreover, we evaluate the inference time of our approach obtaining low latencies, which makes the system adequate for live assistance. Finally, we contribute a concrete recommender, named ModelMate, which implements the training, evaluation and inference steps of the workflow as well as providing integration into Eclipse-based textual editors.
Place, publisher, year, edition, pages
ASSOC COMPUTING MACHINERY , 2024. p. 183-194
Keywords [en]
Recommendation; Meta-modeling; Model; Driven Engineering; Machine learning
National Category
Embedded Systems
Identifiers
URN: urn:nbn:se:liu:diva-209110DOI: 10.1145/3640310.3674089ISI: 001322650200011ISBN: 9798400705045 (print)OAI: oai:DiVA.org:liu-209110DiVA, id: diva2:1910887
Conference
27th International Conference on Model Driven Engineering Languages and Systems (MODELS), Linz, AUSTRIA, sep 22-27, 2024
Note
Funding Agencies|MCIN/AEI [TED2021-129381B-C22, PID2022-140109NB-I00]; NextGenEU/PRTR [TED2021-129381B-C22]; FEDER/UE [PID2022-140109NB-I00]; MICIU/AEI [CNS2022-135578]
2024-11-062024-11-062024-11-22