liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Psychometric evaluation of the Telenursing Interaction and Satisfaction Scale
Linköping University, Department of Health, Medicine and Caring Sciences, Division of Nursing Sciences and Reproductive Health. Linköping University, Faculty of Medicine and Health Sciences.
Linköping University, Department of Health, Medicine and Caring Sciences, Division of Nursing Sciences and Reproductive Health. Linköping University, Faculty of Medicine and Health Sciences.ORCID iD: 0000-0002-9786-7326
Linköping University, Department of Health, Medicine and Caring Sciences, Division of Nursing Sciences and Reproductive Health. Linköping University, Faculty of Medicine and Health Sciences. Region Östergötland, Primary Care Center, 1177 Vårdguiden.
Linnaeus Univ, Sweden; Dept Res Reg Kalmar Cty, Sweden.
2023 (English)In: Scandinavian Journal of Caring Sciences, ISSN 0283-9318, E-ISSN 1471-6712, Vol. 37, no 3, p. 687-697Article in journal (Refereed) Published
Abstract [en]

Aims and Objectives Interaction between caller and telenurse in telenursing is important for caller satisfaction and subsequent compliance. Despite this, satisfaction measures with focus on interaction in telenursing are scarce and rarely anchored in nursing theory. The aim was to evaluate the psychometric properties of the Telenursing Interaction and Satisfaction Scale (TISS) with focus on data quality, factor structure, convergent validity, and reliability.Methodological Design and Justification This psychometric study was based on cross-sectional data.Research Methods, Instruments, and/or Interventions Callers to the National Medical Advisory Service in Sweden (n = 616) completed the 60-item Telenursing Interaction and Satisfaction Questionnaire based on Coxs Interaction Model of Client Health Behavior. Twenty-five of these items were selected to form the TISS in four subscales according to the model. Data quality was evaluated in terms of missing data patterns and score distributions. The factor structure was evaluated with confirmatory factor analysis for ordinal data, convergent validity with Spearman correlations, internal consistency with ordinal alpha, scale reliability with composite reliability coefficients, and test-retest reliability with intraclass correlations.Results The amount of missing data was acceptable and equally distributed. Data deviated significantly from a normal distribution. All response options were endorsed. The factor analysis confirmed the hypothesised four-factor structure; factor loadings ranged from 0.56 to 0.97 and factor correlations were high (0.88-0.96). Internal consistency (ordinal alpha = 0.82-0.97), scale reliability (0.88-0.99), and test-retest reliability (ICC = 0.77-0.86) were satisfactory for all scales.Study Limitations The study design did not allow drop-out analysis.Conclusions The TISS showed satisfactory psychometric properties in the study sample. It provides a measure that enables quantitative measurement of caller satisfaction with interaction in telenursing.

Place, publisher, year, edition, pages
WILEY , 2023. Vol. 37, no 3, p. 687-697
Keywords [en]
interaction; nurse-patient relations; patient satisfaction; psychometrics; surveys and questionnaires; telenursing; telephone nursing
National Category
Other Medical Sciences not elsewhere specified
Identifiers
URN: urn:nbn:se:liu:diva-192343DOI: 10.1111/scs.13149ISI: 000923595200001PubMedID: 36718016OAI: oai:DiVA.org:liu-192343DiVA, id: diva2:1743595
Note

Funding Agencies|Forskningsradet i Sydostra Sverige [FORSS-847311, FORSS-930659]; Region Ostergotland [RO LiO-925191, RO LiO-938203]

Available from: 2023-03-15 Created: 2023-03-15 Last updated: 2024-05-02Bibliographically approved
In thesis
1. "I'm calling for hope, comfort and maybe some advice...": Interaction and caller satisfaction in telenursing
Open this publication in new window or tab >>"I'm calling for hope, comfort and maybe some advice...": Interaction and caller satisfaction in telenursing
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Background: The provision of nursing over the telephone is an appreciated asset in many parts of the world. Interaction between telenurse and caller is important for caller satisfaction, and satisfaction in turn is positively related to outcomes such as adherence, engagement in self-care and well-being. Despite the long history of telehealth services, research about interaction in telenursing is still in a developmental stage.

Aim: The overall aim of the thesis was to develop a questionnaire that enables valid and reliable exploration of telenurse–caller interaction, and caller satisfaction with calls, and to explore interaction and its importance for caller satisfaction.

Methods: The thesis applied a deductive approach based on a theoretical nursing model; the Interaction Model of Client Health Behavior (IMCHB). Interaction in the IMCHB, is divided into four components: health information, affective support, decisional control, and professional-technical competencies. In the first study (I), the Telenursing Interaction and Satisfaction Questionnaire (TISQ) was developed. Variables were identified through a literature review, structured according to the IMCHB, and worded as questionnaire items. Content validity was evaluated with input from cognitive interviews with callers, and professionals using the Content Validity Index (CVI). A consecutive sample of 1,400 callers received the TISQ by post, and test-retest reliability of single items was evaluated. In Study two (II), 25 items from the TISQ focusing on interaction between callers and telenurses were selected to form the Telenursing Interaction and Satisfaction Scale (TISS), a scale for the measurement of caller satisfaction with interaction in four subscales according to the IMCHB. Psychometric properties of the TISS were evaluated with a focus on data quality, factor structure, convergent validity, and reliability. In Study three (III), caller satisfaction with interaction (i.e., TISS scores) and their associations to overall satisfaction with calls were explored using descriptive statistics, repeated measures ANOVA and ordinal logistic regression models. In Study four (IV), 30 transcripts of authentic calls were analysed using content analysis with directed approach. A coding scheme based on the four components of interaction in the IMCHB was developed and applied for deductive categorisation of data. Manifest content of conversations (n = 37,447 words) was presented quantitatively and qualitatively. In addition, data was coded and analysed in relation to phases in the conversation process for telenursing: opening, listening, analysing, motivating, and ending.

Results: The 60 item TISQ showed good content validity in the telenursing setting (I), with a Scale-CVI of 0.91. Test–retest reliability of single items was moderate to good (I). TISS-data deviated significantly from a normal distribution, but all response options were endorsed (II). The confirmatory factor analysis confirmed the four-factor structure of the TISS, and factor correlations were high (rs = 0.88 to 0.96) (II). A higher order model showed marginally deteriorated model fit values (II). Ordinal alpha, scale reliability, and test–retest reliability were satisfactory for all scales, and convergent validity was satisfactory (II). Callers expressed the highest level of satisfaction with affective support, while their satisfaction with decisional control was comparatively lower (III). Callers’ satisfaction with interaction was positively associated with overall satisfaction with calls, even when considering experienced waiting time, main result of the call, fulfilment of expectations, age, gender, self-rated health status and time of call (III). A total of 97% of manifest words in conversations were identified as nursing interaction based on the IMCHB (IV). Health information was the primary focus, particularly during the listening and analysing phases (IV). Affective support was the least prominent component, and callers’ reactions to advice were seldom discussed (IV). The opening phase was the shortest, and analysing phase the most word consuming (IV).

Conclusions: The TISQ, including the TISS, provide a valid and reliable questionnaire for the study of telenurse-caller interaction, and caller satisfaction. Caller satisfaction with the interaction can be measured using the four subscales in the TISS. In cases where there is a problem with multicollinearity, a total scale score from the TISS can be utilized. All four components of interaction in the IMCHB play a crucial role in determining overall caller satisfaction with calls. Therefore, the development of interaction in telenursing need to consider all four components. The exchange of health information presents challenges for both telenurses and callers, and affective support can be provided to callers without verbalizing emotions. Among the four components, decisional control may have the largest potential for improvement in the studied setting. This can be achieved by acknowledging callers’ reactions to advice.

Abstract [sv]

Bakgrund: Omvårdnad via telefon är en värdefull och uppskattad resurs i många delar av världen. Interaktionen mellan telefonsjuksköterska och uppringare har stor betydelse för uppringares nöjdhet med samtalen. Ökad nöjdhet leder i sin tur till högre grad av följsamhet till råd, ökat engagemang i egenvård och förbättrat välbefinnande. Trots att vård via telefon har funnits länge, befinner sig forskningen om interaktion via telefon fortfarande i ett utvecklingsskede.

Syfte: Det övergripande syftet med avhandlingen var att utveckla en enkät som möjliggör utforskandet av interaktion mellan uppringare och telefonsjuksköterskor, samt att utforska interaktionens betydelse för uppringares nöjdhet med samtal.

Metod: Avhandlingsarbetet har genomförts med en deduktiv ansats baserad på en teoretisk modell för omvårdnad, the Interaction Model of Client Health Behavior (IMCHB). I modellen består interaktion av fyra komponenter; hälsoinformation, affektiv support, inflytande över beslut och professionell-teknisk kompetens. I den första delstudien (I) utvecklades en enkät, the Telenursing Interaction and Satisfaction Questionnaire (TISQ). Relevanta variabler identifierades i litteratur, sorterades utifrån strukturen i IMCHB, och formulerades därefter till frågor i en enkät. Enkätens innehållsvaliditet utvärderades med hjälp av kognitiva intervjuer med uppringare, och med professionella personers bedömning av frågornas relevans med hjälp av Content Validity Index (CVI). Ett konsekutivt urval av 1 400 uppringare till 1177 direkt fick TISQ via postutskick, och enskilda frågors test-retest reliabilitet utvärderades (I). I delstudie två (II) valdes 25 frågor i TISQ ut, för att bilda en mätskala, the Telenursing Interaction and Satisfaction Scale (TISS). TISS består av fyra delskalor baserat på de fyra interaktionskomponenterna i IMCHB, och syftar till att mäta uppringares nöjdhet med interaktion. TISS utvärderades psykometriskt med fokus på datakvalitet, faktorstruktur, kriterievaliditet och reliabilitet. I Studie tre (III) utforskades uppringares nöjdhet med interaktion, samt dess betydelse för övergripande nöjdhet med hela samtalet, med hjälp av deskriptiv statistik, rANOVA och ordinal logistisk regression. I den fjärde delstudien (IV) analyserades 30 telefonsamtal (n = 37 447 ord) med hjälp av innehållsanalys med deduktiv ansats. Data kategoriserades med hjälp av ett kodningsschema baserat på de fyra interaktionskomponenterna i IMCHB. Det manifesta innehållet i samtalen beskrevs kvantitativt och kvalitativt. I tillägg analyserades innehållet i relation till Samtalsprocessen, ett arbetssätt som används vid 1177 direkt, och som består av följande faser; öppna, lyssna, analysera, motivera, och avsluta.

Resultat: TISQ, bestående av 60 frågor, uppvisade god innehållsvaliditet i den studerade kontexten (Scale-CVI/Ave = 0.91). Test-retest reliabilitet för enskilda frågor var medelgod till god för alla frågor utom en (I). Data som genererats med hjälp av TISS avvek signifikant från normalfördelningen, men alla svarsalternativ användes (II). De fyra delskalorna i TISS bekräftades i en konfirmatorisk faktoranalys, och korrelationer mellan de fyra faktorerna var höga (rs = 0.88 to 0.96) (II). En higher-ordermodell visade marginellt försämrad modellanpassning (II). Reliabilitet för samtliga delskalor var tillfredsställande, liksom kriterievaliditet (II). Uppringare var mest nöjda med affektiv support, medan nöjdheten med inflytande över beslut var jämförelsevis lägre (III). Uppringares nöjdhet med samtliga fyra interaktionskomponenter uppvisade ett positivt och signifikant samband med övergripande nöjdhet med samtal, även efter korrigering för upplevd väntetid, huvudresultat av samtalet, grad av uppfyllda förväntningar, ålder, kön, självskattat hälsotillstånd och tidpunkt för samtal (III). Totalt 97% av manifest innehåll i de transkriberade samtalen kodades som omvårdnadsinteraktion i enlighet med IMCHB (IV). Hälsoinformation dominerade samtalsinnehållet, speciellt i lyssna och analysfas. Affektiv support var minst förekommande, och uppringares reaktioner på råd diskuterades sällan (IV). Öppnafasen var kortast, och analysfasen var längst (IV).

Konklusion: TISQ, vilken inkluderar TISS, uppvisar god validitet och reliabilitet i den studerade kontexten, och kan användas för att studera interaktion mellan uppringare och telefonsjuksköterska, och uppringares nöjdhet. Uppringares nöjdhet med interaktion kan mätas med hjälp av de fyra delskalorna i TISS. I de fall multikollinearitet är ett problem kan en total-score användas. Nöjdhet med samtliga fyra interaktionskomponenter är viktigt för uppringares övergripande nöjdhet med samtal. Därför bör alla fyra beaktas vid utveckling av omvårdnadsinteraktion på telefon. Interaktion som berör hälsoinformation kan vara utmanande för både telefonsjuksköterska och uppringare, och affektiv support kan förmedlas utan att verbalisera känslor. Bland de fyra interaktionskomponenterna uppvisade inflytande över beslut störst potential till utveckling. Detta kan uppnås genom att telefonsjuksköterskor i större utsträckning uppmärksammar uppringares reaktioner på givet råd.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2023. p. 80
Series
Linköping University Medical Dissertations, ISSN 0345-0082 ; 1856
Keywords
Telenursing, Telephone nursing, Social interaction, Nurse-patient relations, Patient satisfaction, Nursing models, Surveys and questionnaires
National Category
Nursing
Identifiers
urn:nbn:se:liu:diva-194314 (URN)10.3384/9789180752022 (DOI)9789180752015 (ISBN)9789180752022 (ISBN)
Public defence
2023-09-01, Önnesjösalen (K3), Kåkenhus, Campus Norrköping, Norrköping, 13:00 (Swedish)
Opponent
Supervisors
Note

Funding agencies: Region Östergötland (RÖ), the Research Council of Southeast Sweden (FORSS), and Linköping University (LiU)

2023-06-02 The thesis was first published online. The online published version reflects the printed version. 

2024-06-12 The thesis was updated with an errata list which is also downloadable from the DOI landing page. Before this date the PDF has been downloaded 327 times.

Available from: 2023-06-02 Created: 2023-06-02 Last updated: 2024-06-12Bibliographically approved

Open Access in DiVA

fulltext(562 kB)401 downloads
File information
File name FULLTEXT01.pdfFile size 562 kBChecksum SHA-512
82574db86e242682aa9a3ad3a3a097a6ad78b15d74b42bf893074c95b11824ea5ac05ad489f0567902b5df51bfe3c51ff22ec9785cce1124bd1105d2c9574443
Type fulltextMimetype application/pdf

Other links

Publisher's full textPubMed

Authority records

Mattisson, MarieBörjeson, SussanneLindberg, Malou

Search in DiVA

By author/editor
Mattisson, MarieBörjeson, SussanneLindberg, Malou
By organisation
Division of Nursing Sciences and Reproductive HealthFaculty of Medicine and Health Sciences1177 Vårdguiden
In the same journal
Scandinavian Journal of Caring Sciences
Other Medical Sciences not elsewhere specified

Search outside of DiVA

GoogleGoogle Scholar
Total: 402 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
pubmed
urn-nbn

Altmetric score

doi
pubmed
urn-nbn
Total: 367 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf