liu.seSök publikationer i DiVA
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
On Machine Learning-Based Control for Energy Management in Construction Machines
Linköpings universitet, Institutionen för ekonomisk och industriell utveckling, Fluida och mekatroniska system. Linköpings universitet, Tekniska fakulteten.ORCID-id: 0000-0002-2781-3752
2022 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

High energy efficiency is a key requirement for modern construction machinery. This is because of stricter environmental targets, electrification, and reduction of operation costs. To meet this requirement, the powertrain architectures of the machines are becoming increasingly complex, for example through hybridisation of drivetrain and work functions, or with improved hydraulic systems. However, the more complex the architecture is, the harder the management of splitting power between different sources and consumers. The number of work functions, operating environments, and tasks these machines engage in, along with the added degrees of freedom with respect to how energy can be recovered, ex-changed, and reused, makes them unique. Therefore, the development of control strategies for energy management in such machines requires specific research and development with their architecture and application in focus. This doctoral thesis presents an analysis of two methods for the development of machine learning-based energy management strategies for construction machines. One is based on supervised learning and the other on reinforcement learning. The methods use optimisation to find optimised solutions for the control problem of the systems and machine learning for learning and implementing the control decisions. In both methods, models of the physical systems are used for the learning and training. The thesis highlights and confirms, with experimental results, the potential of such methods to derive control strategies for these machines. The studied methods can learn and implement improved control decisions in the real systems that result in the potential for increased efficiency. At the same time, their robustness is shown in the application to unseen scenarios during training, although that does not eliminate the need for further training in the real systems after deployment. The thesis also increases the comprehensiveness on energy management for construction machines. The thesis was completed in a double-degree format between the Federal University of Santa Catarina, Florianópolis, Brazil, and Linköping University, Linköping, Sweden.

Abstract [sv]

Hög effektivitet är ett nyckelkrav för moderna byggmaskiner. Detta på grund av strängare miljömål, elektrifiering och sänkta driftskostnader. För att möta detta krav blir maskinernas arkitektur mer komplex, till exempel genom hybridisering av drivlina och arbetsfunktioner. Men ju mer komplex arkitekturen är desto svårare blir hanteringen av maktdelning mellan olika källor och konsumenter. Antalet arbetsfunktioner, drifts-miljö och uppgifter de engagerar tillsammans med de ökade frihetsgraderna med avseende på hur kraft kan återvinnas, bytas ut och återanvändas, gör dem unika. Därför kräver utvecklingen av styrstrategier specifik utveckling med deras arkitektur och tillämpning i fokus. Denna doktors-avhandling presenterar en analys av två metoder för utveckling av optimerade och intelligenta energihanteringsstrategier i realtid för delsystem av komplexa entreprenadmaskiner. De utvärderade metoderna använder optimering för att hitta optimala lösningar för systemens kontrollproblem, och använder maskininlärning som ett sätt att lära sig och implementera de optimerade besluten. I båda metoderna används modeller för lärandet och träningen. Avhandlingen belyser och bekräftar experimentellt potentialen hos sådana metoder för att härleda kontrollstrategier för dessa maskiner. De studerade metoderna kan lära sig och implementera optimerade styrbeslut i de verkliga systemen vilket leder till ökad effektivitet. Samtidigt visar det sig att de är robusta mot osynliga scenarier under träning, även om det inte eliminerar behovet av vidare-utbildning i de verkliga systemen efter utplacering. Examensarbetet ökar också heltäckningen om energihantering för entreprenadmaskiner. Avhandlingen har utvecklats i ett dubbelgradersformat med Federal University of Santa Catarina, Florianópolis, Brasilien och Linköpings Universitet, Linköping, Sverige.

Abstract [pt]

Alta eficiência energética é um requisito para máquinas de construção modernas, sendo este uma consequência das metas ambientais, eletrificação e redução de custos. Para atender este requisito as arquiteturas dos trens de potência das máquinas têm se tornado mais complexas, por exemplo, através da hibridização do sistema de tração e funções de trabalho, ou  sistemas hidráulicos melhorados. Entretanto, quanto mais complexa a arquitetura, mais difícil se torna o gerenciamento da divisão de potência entre as fontes e consumidores. O número de funções de trabalho, ambientes de operação e tarefas que elas executam, juntamente com os graus de liberdade relacionados à como energia pode ser recuperada, trocada e reutilizada, às tornam únicas. Dessa maneira, o desenvolvimento de estratégias de controle requer pesquisa e desenvolvimento específicos com as suas arquiteturas e aplicações em foco. Esta tese de doutorado apresenta uma análise de dois métodos para o desenvolvimento de estratégias baseadas em aprendizado de máquina para o gerenciamento de energia em máquinas de construção. Um é baseado em aprendizado supervisionado e outro em aprendizado por reforço. Os métodos avaliados usam otimização para encontrar soluções otimizadas para o problema de controle dos sistemas, e usam aprendizado de máquina como meio para aprender e implementar as decisões de controle. Em ambos os métodos, modelos dos sistemas físicos são utilizados para o aprendizado e treinamento. A tese destaca e confirma através de resultados experimentais, o potencial destes métodos em obter estratégias de controle para estas máquinas. Os métodos estudados são capazes de aprender e implementar decisões de controle melhores nos sistemas reais resultando em potencial aumento de eficiência energética. Ao mesmo tempo, é mostrado a sua robustez na prática a cenários não vistos durante o treinamento, apesar de isso não eliminar a necessidade de continuar o treinamento depois de implementadas no sistema real. A tese também aumenta a compressão sobre gerenciamento de energia em máquinas de construção. A tese foi desenvolvida em formato de cotutela com a Universidade Federal de Santa Catarina, Florianópolis, Brasil, e a Universidade de Linköping, Linköping, Suécia.

Ort, förlag, år, upplaga, sidor
Linköping: Linköping University Electronic Press, 2022. , s. 104
Serie
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2244
Nyckelord [en]
Machine Learning, Energy Management, Construction Machines
Nyckelord [pt]
Aprendizado de Máquina, Gerenciamento de Energia, Máquinas de Construção
Nationell ämneskategori
Maskinteknik
Identifikatorer
URN: urn:nbn:se:liu:diva-187244DOI: 10.3384/9789179294168ISBN: 9789179294151 (tryckt)ISBN: 9789179294168 (digital)OAI: oai:DiVA.org:liu-187244DiVA, id: diva2:1687553
Disputation
2022-09-12, Rum A38, A-Building, Campus Valla, Linköping, 10:15 (Engelska)
Opponent
Handledare
Tillgänglig från: 2022-08-16 Skapad: 2022-08-16 Senast uppdaterad: 2022-08-29Bibliografiskt granskad
Delarbeten
1. Energy Management Based on Neural Networks for a Hydraulic Hybrid Wheel Loader
Öppna denna publikation i ny flik eller fönster >>Energy Management Based on Neural Networks for a Hydraulic Hybrid Wheel Loader
Visa övriga...
2020 (Engelska)Ingår i: 2020 IEEE Global Fluid Power Society PhD Symposium, 2020Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

This paper presents a method to derive optimized energy management strategies for a hydraulic hybrid wheel loader. Energy efficiency is a key aspect for the sustainability of off-road mobile machines. Energy management strategies for on-road hybrid vehicles cannot be directly applied to off-road hybrid machines. One significant reason is that there are added degrees of freedom with respect to how power can be recovered, exchanged and reused in the different functions, such as drivetrain or work functions. This results in more complex energy management strategies being derived. This paper presents an analysis and preliminary conclusions for a proposed method to derive optimised online energy management strategies for a hydraulic hybrid wheel loader. Dynamic programming is used to obtain optimal offline energy management strategies for a series of drive cycles. The results are used as examples to train a neural network. The trained neural network then implements the energy management strategy and is used to make optimised control decisions. Through simulation, the neural network’s ability to learn the dynamic programming decision-making process is shown, resulting in the machine operating with fuel consumption similar to that of the offline optimal energy management strategy. Aspects of simplicity to model these machines for dynamic programming optimisation, the data necessary to train the network, the training process, variables used to learn the dynamic programming decision-making process and the robustness of the network when facing unseen operational conditions are discussed. The paper demonstrates the simplicity of the method for taking into account variables that affect the control decisions, therefore achieving optimised solutions.

Nyckelord
Construction Machines, Hydraulic Hybrid, Energy Management Strategies
Nationell ämneskategori
Energisystem
Identifikatorer
urn:nbn:se:liu:diva-173170 (URN)9781728141381 (ISBN)
Konferens
2020 IEEE Global Fluid Power Society PhD Symposium, Guilin China, October 19-21, 2020
Tillgänglig från: 2021-02-08 Skapad: 2021-02-08 Senast uppdaterad: 2022-08-16Bibliografiskt granskad
2. DESIGN OPTIMISATION STRATEGIES FOR A HYDRAULIC HYBRID WHEEL LOADER
Öppna denna publikation i ny flik eller fönster >>DESIGN OPTIMISATION STRATEGIES FOR A HYDRAULIC HYBRID WHEEL LOADER
2018 (Engelska)Ingår i: PROCEEDINGS OF THE BATH/ASME SYMPOSIUM ON FLUID POWER AND MOTION CONTROL, 2018, AMER SOC MECHANICAL ENGINEERS , 2018, artikel-id V001T01A001Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

This paper deals with design optimisation of hydraulic hybrid drivelines during early concept design phases. To set the design parameters of a hybrid driveline such as gear ratios, pump/motor displacements and size of energy storage, the energy management of the hybrid machine needs to be considered as well. This is problematic since a nested design and control optimisation normally requires substantial computer power and is time-consuming. Few previous studies have treated combined design and control optimisation of hydraulic hybrid vehicles using detailed, non-linear component driveline models. Furthermore, previously proposed design optimisation methods for on road vehicles are not suitable for heavy off-road machines operating in short repetitive cycles with high transient power output. The paper demonstrates and compares different optimisation approaches for design and control optimisation combining deterministic dynamic programming and non-gradient based numerical optimisation. The results show that a simple rule-based energy management strategy can be sufficient to find the optimal hardware design even though non-optimal control laws are used.

Ort, förlag, år, upplaga, sidor
AMER SOC MECHANICAL ENGINEERS, 2018
Serie
Proceedings of the ASME-BATH Symposium on Fluid Power and Motion Control, ISSN 2475-7004
Nationell ämneskategori
Farkost och rymdteknik
Identifikatorer
urn:nbn:se:liu:diva-155963 (URN)10.1115/FPMC2018-8802 (DOI)000460491500001 ()978-0-7918-5196-8 (ISBN)
Konferens
BATH/ASME Symposium on Fluid Power and Motion Control
Tillgänglig från: 2019-04-01 Skapad: 2019-04-01 Senast uppdaterad: 2026-03-12
3. Extended Analysis of a Valve-Controlled System with Multi-Chamber Actuator
Öppna denna publikation i ny flik eller fönster >>Extended Analysis of a Valve-Controlled System with Multi-Chamber Actuator
Visa övriga...
2022 (Engelska)Ingår i: International Journal of Fluid Power, ISSN 1439-9776, Vol. 23, nr 1, s. 79-108Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

This paper outlines an extended analysis on how multi-chamber actuators can improve the efficiency of valve-controlled systems. Resistive control is a major source of energy losses in valve-controlled systems that share the same pump to drive multiple loads. By combining different chambers, the load on multi-chamber actuators can be transformed into different pressure and flow rate levels. This allows the adaptation of its load to the loads on other actuators. This can lead to a reduction of resistive control energy losses that occur between pump and actuators when driven simultaneously. As a case study to highlight how the system efficiency can be improved, a load sensing system with a conventional and a multi-chamber actuator is analysed. The equations that describe the system steady state behaviour are presented to evaluate the effect of the load transformations on the system efficiency. A disadvantage of such architecture is the fact that load transformations result in different actuator speeds. To reduce this effect, a compensation factor for the command signal to the proportional valve is presented. The highlight from this paper is the potential for efficiency improvement enabled by the adoption of multi-chamber actuators in a valve-controlled architecture. Further research is required for the selection of number of chambers and their areas since they directly affect the system efficiency.

Ort, förlag, år, upplaga, sidor
RIVER PUBLISHERS, 2022
Nyckelord
Digital fluid power; multi-chamber actuators; resistive control losses
Nationell ämneskategori
Annan elektroteknik och elektronik
Identifikatorer
urn:nbn:se:liu:diva-181633 (URN)10.13052/ijfp1439-9776.2314 (DOI)000722192000004 ()2-s2.0-85136391529 (Scopus ID)
Anmärkning

Funding Agencies|Brazilian Coordination for the Improvement of Higher Education Personnel (CAPES)Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (CAPES); Brazilian National Council forScientific and Technological Development (CNPq)Conselho Nacional de Desenvolvimento Cientifico e Tecnologico (CNPQ); Swedish Energy Agency (Energimyndigheten)Swedish Energy Agency [P49119-1]

Tillgänglig från: 2021-12-06 Skapad: 2021-12-06 Senast uppdaterad: 2025-09-04Bibliografiskt granskad
4. Boom energy recuperation system and control strategy for hydraulic hybrid excavators
Öppna denna publikation i ny flik eller fönster >>Boom energy recuperation system and control strategy for hydraulic hybrid excavators
Visa övriga...
2022 (Engelska)Ingår i: Automation in Construction, ISSN 0926-5805, E-ISSN 1872-7891, Vol. 135, artikel-id 104046Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

In this paper, a boom potential energy recovery hydraulic system for an excavator and its controller is proposed and evaluated. It is a trend in the construction machinery sector to adopt hybrid systems to recuperate potential energy from heavy loads. Many studies have been conducted to improve the efficiency of boom potential energy recovery. However, most of the proposed solutions have limitations regarding commercialization due to low controllability and high cost. The proposed system in this paper uses only electronically controlled hydraulic components. Different operation modes are defined to increase performance, efficiency or a balance between the two. The system is mathematically analysed to derive a control strategy that is able to increase machine efficiency and control performance while maintaining its controllability. The system and control strategy are applied to a prototype machine, a Volvo 30-ton class excavator, to verify the effectiveness of the proposed approach. Experimental results demonstrate that the working cycle becomes around 3% faster, and the fuel consumption becomes around 9% lower than the operation in non-hybrid mode.

Ort, förlag, år, upplaga, sidor
ELSEVIER, 2022
Nyckelord
Hydraulic excavator; Hydraulic hybrid; Boom energy recuperation; Control strategy; Energy efficiency
Nationell ämneskategori
Byggprocess och förvaltning
Identifikatorer
urn:nbn:se:liu:diva-184748 (URN)10.1016/j.autcon.2021.104046 (DOI)000781039500002 ()
Anmärkning

Funding Agencies|Brazilian Coordination for the Improvement of Higher Education Personnel (CAPES)Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (CAPES) [P49119-1]; Brazilian National Council for Scientific and Technological Development (CNPq)Conselho Nacional de Desenvolvimento Cientifico e Tecnologico (CNPQ); Swedish Energy Agency (Energimyndigheten)Swedish Energy Agency

Tillgänglig från: 2022-05-11 Skapad: 2022-05-11 Senast uppdaterad: 2026-03-12

Open Access i DiVA

fulltext(7402 kB)791 nedladdningar
Filinformation
Filnamn FULLTEXT01.pdfFilstorlek 7402 kBChecksumma SHA-512
9da1484daaf742e3590cf76d1829392d0394e4f2d7f67f56cbf58ac527f5686d420c7d95afc8b04b14042b14fbfbe1a79bc0d69afa806bfdd52138b645032cf9
Typ fulltextMimetyp application/pdf
Beställ online >>

Övriga länkar

Förlagets fulltext

Person

Raduenz, Henrique

Sök vidare i DiVA

Av författaren/redaktören
Raduenz, Henrique
Av organisationen
Fluida och mekatroniska systemTekniska fakulteten
Maskinteknik

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 791 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

doi
isbn
urn-nbn

Altmetricpoäng

doi
isbn
urn-nbn
Totalt: 1349 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf