liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On the Use of GPT-4 for Creating Goal Models: An Exploratory Study
McGill Univ, Canada.
McGill Univ, Canada.
Univ Ottawa, Canada.
McGill Univ, Canada.
Show others and affiliations
2023 (English)In: 2023 IEEE 31ST INTERNATIONAL REQUIREMENTS ENGINEERING CONFERENCE WORKSHOPS, REW, IEEE, 2023, p. 262-271Conference paper, Published paper (Refereed)
Abstract [en]

The emergence of large language models and conversational front-ends such as ChatGPT is revolutionizing many software engineering activities. The extent to which such technologies can help with requirements engineering activities, especially the ones surrounding modeling, however, remains to be seen. This paper reports on early experimental results on the potential use of GPT-4 in the latter context, with a focus on the development of goal-oriented models. We first explore GPT-4s current knowledge and mastering of a specific modeling language, namely the Goal-oriented Requirement Language (GRL). We then use four combinations of prompts with and without a proposed textual syntax, and with and without contextual domain knowledge to guide the creation of GRL models for two case studies. The first case study focuses on a well-documented topic in the goal modeling community (Kids Help Phone), whereas the second one explores a context for which, to our knowledge, no public goal models currently exist (Social Housing). We explore the interactive construction of a goal model through specific follow-up prompts aimed to fix model issues and expand on the model content. Our results suggest that GPT-4 preserves considerable knowledge on goal modeling, and although many elements generated by GPT-4 are generic, reflecting what is already in the prompt, or even incorrect, there is value in getting exposed to the generated concepts, many of which being non-obvious to stakeholders outside the domain. Furthermore, aggregating results from multiple runs yields a far better outcome than from any individual run.

Place, publisher, year, edition, pages
IEEE, 2023. p. 262-271
Series
IEEE International Requirements Engineering Conference Workshops, ISSN 2770-6826, E-ISSN 2770-6834
Keywords [en]
Large Language Models; GPT-4; ChatGPT; Goal Modeling; Goal-oriented Requirement Language; GRL
National Category
Other Computer and Information Science
Identifiers
URN: urn:nbn:se:liu:diva-199349DOI: 10.1109/REW57809.2023.00052ISI: 001085223300047ISBN: 9798350326918 (electronic)ISBN: 9798350326925 (print)OAI: oai:DiVA.org:liu-199349DiVA, id: diva2:1815358
Conference
31st IEEE International Requirements Engineering Conference (RE), Hannover, GERMANY, sep 04-05, 2023
Note

Funding Agencies|NSERC Discovery/Discovery Accelerator programs; FRQNT-B2X project [319955, IT30340]; Wallenberg AI, Aut. Systems & Software Program (WASP), Sweden

Available from: 2023-11-28 Created: 2023-11-28 Last updated: 2024-12-03

Open Access in DiVA

fulltext(313 kB)11 downloads
File information
File name FULLTEXT02.pdfFile size 313 kBChecksum SHA-512
a0fe53fabc7ff89dcc6ebf9082c052d3098da22ec43de0243f805f1cd4b1ff6ce834904558eaf21cb73038bbc06e51bd4df5e59d2d4721aaa2ae01c41dfb0e7b
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Varro, Daniel

Search in DiVA

By author/editor
Varro, Daniel
By organisation
Software and SystemsFaculty of Science & Engineering
Other Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 11 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 112 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf