liu.seSearch for publications in DiVA
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
On Machine Learning-Based Control for Energy Management in Construction Machines
Linköping University, Department of Management and Engineering, Fluid and Mechatronic Systems. Linköping University, Faculty of Science & Engineering.ORCID iD: 0000-0002-2781-3752
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

High energy efficiency is a key requirement for modern construction machinery. This is because of stricter environmental targets, electrification, and reduction of operation costs. To meet this requirement, the powertrain architectures of the machines are becoming increasingly complex, for example through hybridisation of drivetrain and work functions, or with improved hydraulic systems. However, the more complex the architecture is, the harder the management of splitting power between different sources and consumers. The number of work functions, operating environments, and tasks these machines engage in, along with the added degrees of freedom with respect to how energy can be recovered, ex-changed, and reused, makes them unique. Therefore, the development of control strategies for energy management in such machines requires specific research and development with their architecture and application in focus. This doctoral thesis presents an analysis of two methods for the development of machine learning-based energy management strategies for construction machines. One is based on supervised learning and the other on reinforcement learning. The methods use optimisation to find optimised solutions for the control problem of the systems and machine learning for learning and implementing the control decisions. In both methods, models of the physical systems are used for the learning and training. The thesis highlights and confirms, with experimental results, the potential of such methods to derive control strategies for these machines. The studied methods can learn and implement improved control decisions in the real systems that result in the potential for increased efficiency. At the same time, their robustness is shown in the application to unseen scenarios during training, although that does not eliminate the need for further training in the real systems after deployment. The thesis also increases the comprehensiveness on energy management for construction machines. The thesis was completed in a double-degree format between the Federal University of Santa Catarina, Florianópolis, Brazil, and Linköping University, Linköping, Sweden.

Abstract [sv]

Hög effektivitet är ett nyckelkrav för moderna byggmaskiner. Detta på grund av strängare miljömål, elektrifiering och sänkta driftskostnader. För att möta detta krav blir maskinernas arkitektur mer komplex, till exempel genom hybridisering av drivlina och arbetsfunktioner. Men ju mer komplex arkitekturen är desto svårare blir hanteringen av maktdelning mellan olika källor och konsumenter. Antalet arbetsfunktioner, drifts-miljö och uppgifter de engagerar tillsammans med de ökade frihetsgraderna med avseende på hur kraft kan återvinnas, bytas ut och återanvändas, gör dem unika. Därför kräver utvecklingen av styrstrategier specifik utveckling med deras arkitektur och tillämpning i fokus. Denna doktors-avhandling presenterar en analys av två metoder för utveckling av optimerade och intelligenta energihanteringsstrategier i realtid för delsystem av komplexa entreprenadmaskiner. De utvärderade metoderna använder optimering för att hitta optimala lösningar för systemens kontrollproblem, och använder maskininlärning som ett sätt att lära sig och implementera de optimerade besluten. I båda metoderna används modeller för lärandet och träningen. Avhandlingen belyser och bekräftar experimentellt potentialen hos sådana metoder för att härleda kontrollstrategier för dessa maskiner. De studerade metoderna kan lära sig och implementera optimerade styrbeslut i de verkliga systemen vilket leder till ökad effektivitet. Samtidigt visar det sig att de är robusta mot osynliga scenarier under träning, även om det inte eliminerar behovet av vidare-utbildning i de verkliga systemen efter utplacering. Examensarbetet ökar också heltäckningen om energihantering för entreprenadmaskiner. Avhandlingen har utvecklats i ett dubbelgradersformat med Federal University of Santa Catarina, Florianópolis, Brasilien och Linköpings Universitet, Linköping, Sverige.

Abstract [pt]

Alta eficiência energética é um requisito para máquinas de construção modernas, sendo este uma consequência das metas ambientais, eletrificação e redução de custos. Para atender este requisito as arquiteturas dos trens de potência das máquinas têm se tornado mais complexas, por exemplo, através da hibridização do sistema de tração e funções de trabalho, ou  sistemas hidráulicos melhorados. Entretanto, quanto mais complexa a arquitetura, mais difícil se torna o gerenciamento da divisão de potência entre as fontes e consumidores. O número de funções de trabalho, ambientes de operação e tarefas que elas executam, juntamente com os graus de liberdade relacionados à como energia pode ser recuperada, trocada e reutilizada, às tornam únicas. Dessa maneira, o desenvolvimento de estratégias de controle requer pesquisa e desenvolvimento específicos com as suas arquiteturas e aplicações em foco. Esta tese de doutorado apresenta uma análise de dois métodos para o desenvolvimento de estratégias baseadas em aprendizado de máquina para o gerenciamento de energia em máquinas de construção. Um é baseado em aprendizado supervisionado e outro em aprendizado por reforço. Os métodos avaliados usam otimização para encontrar soluções otimizadas para o problema de controle dos sistemas, e usam aprendizado de máquina como meio para aprender e implementar as decisões de controle. Em ambos os métodos, modelos dos sistemas físicos são utilizados para o aprendizado e treinamento. A tese destaca e confirma através de resultados experimentais, o potencial destes métodos em obter estratégias de controle para estas máquinas. Os métodos estudados são capazes de aprender e implementar decisões de controle melhores nos sistemas reais resultando em potencial aumento de eficiência energética. Ao mesmo tempo, é mostrado a sua robustez na prática a cenários não vistos durante o treinamento, apesar de isso não eliminar a necessidade de continuar o treinamento depois de implementadas no sistema real. A tese também aumenta a compressão sobre gerenciamento de energia em máquinas de construção. A tese foi desenvolvida em formato de cotutela com a Universidade Federal de Santa Catarina, Florianópolis, Brasil, e a Universidade de Linköping, Linköping, Suécia.

Place, publisher, year, edition, pages
Linköping: Linköping University Electronic Press, 2022. , p. 104
Series
Linköping Studies in Science and Technology. Dissertations, ISSN 0345-7524 ; 2244
Keywords [en]
Machine Learning, Energy Management, Construction Machines
Keywords [pt]
Aprendizado de Máquina, Gerenciamento de Energia, Máquinas de Construção
National Category
Mechanical Engineering
Identifiers
URN: urn:nbn:se:liu:diva-187244DOI: 10.3384/9789179294168ISBN: 9789179294151 (print)ISBN: 9789179294168 (electronic)OAI: oai:DiVA.org:liu-187244DiVA, id: diva2:1687553
Public defence
2022-09-12, Rum A38, A-Building, Campus Valla, Linköping, 10:15 (English)
Opponent
Supervisors
Available from: 2022-08-16 Created: 2022-08-16 Last updated: 2022-08-29Bibliographically approved
List of papers
1. Energy Management Based on Neural Networks for a Hydraulic Hybrid Wheel Loader
Open this publication in new window or tab >>Energy Management Based on Neural Networks for a Hydraulic Hybrid Wheel Loader
Show others...
2020 (English)In: 2020 IEEE Global Fluid Power Society PhD Symposium, 2020Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents a method to derive optimized energy management strategies for a hydraulic hybrid wheel loader. Energy efficiency is a key aspect for the sustainability of off-road mobile machines. Energy management strategies for on-road hybrid vehicles cannot be directly applied to off-road hybrid machines. One significant reason is that there are added degrees of freedom with respect to how power can be recovered, exchanged and reused in the different functions, such as drivetrain or work functions. This results in more complex energy management strategies being derived. This paper presents an analysis and preliminary conclusions for a proposed method to derive optimised online energy management strategies for a hydraulic hybrid wheel loader. Dynamic programming is used to obtain optimal offline energy management strategies for a series of drive cycles. The results are used as examples to train a neural network. The trained neural network then implements the energy management strategy and is used to make optimised control decisions. Through simulation, the neural network’s ability to learn the dynamic programming decision-making process is shown, resulting in the machine operating with fuel consumption similar to that of the offline optimal energy management strategy. Aspects of simplicity to model these machines for dynamic programming optimisation, the data necessary to train the network, the training process, variables used to learn the dynamic programming decision-making process and the robustness of the network when facing unseen operational conditions are discussed. The paper demonstrates the simplicity of the method for taking into account variables that affect the control decisions, therefore achieving optimised solutions.

Keywords
Construction Machines, Hydraulic Hybrid, Energy Management Strategies
National Category
Energy Systems
Identifiers
urn:nbn:se:liu:diva-173170 (URN)9781728141381 (ISBN)
Conference
2020 IEEE Global Fluid Power Society PhD Symposium, Guilin China, October 19-21, 2020
Available from: 2021-02-08 Created: 2021-02-08 Last updated: 2022-08-16Bibliographically approved
2. DESIGN OPTIMISATION STRATEGIES FOR A HYDRAULIC HYBRID WHEEL LOADER
Open this publication in new window or tab >>DESIGN OPTIMISATION STRATEGIES FOR A HYDRAULIC HYBRID WHEEL LOADER
2018 (English)In: PROCEEDINGS OF THE BATH/ASME SYMPOSIUM ON FLUID POWER AND MOTION CONTROL, 2018, AMER SOC MECHANICAL ENGINEERS , 2018, article id V001T01A001Conference paper, Published paper (Refereed)
Abstract [en]

This paper deals with design optimisation of hydraulic hybrid drivelines during early concept design phases. To set the design parameters of a hybrid driveline such as gear ratios, pump/motor displacements and size of energy storage, the energy management of the hybrid machine needs to be considered as well. This is problematic since a nested design and control optimisation normally requires substantial computer power and is time-consuming. Few previous studies have treated combined design and control optimisation of hydraulic hybrid vehicles using detailed, non-linear component driveline models. Furthermore, previously proposed design optimisation methods for on road vehicles are not suitable for heavy off-road machines operating in short repetitive cycles with high transient power output. The paper demonstrates and compares different optimisation approaches for design and control optimisation combining deterministic dynamic programming and non-gradient based numerical optimisation. The results show that a simple rule-based energy management strategy can be sufficient to find the optimal hardware design even though non-optimal control laws are used.

Place, publisher, year, edition, pages
AMER SOC MECHANICAL ENGINEERS, 2018
Series
Proceedings of the ASME-BATH Symposium on Fluid Power and Motion Control, ISSN 2475-7004
National Category
Aerospace Engineering
Identifiers
urn:nbn:se:liu:diva-155963 (URN)10.1115/FPMC2018-8802 (DOI)000460491500001 ()978-0-7918-5196-8 (ISBN)
Conference
BATH/ASME Symposium on Fluid Power and Motion Control
Available from: 2019-04-01 Created: 2019-04-01 Last updated: 2022-08-16
3. Extended Analysis of a Valve-Controlled System with Multi-Chamber Actuator
Open this publication in new window or tab >>Extended Analysis of a Valve-Controlled System with Multi-Chamber Actuator
Show others...
2022 (English)In: International Journal of Fluid Power, ISSN 1439-9776, Vol. 23, no 1, p. 79-108Article in journal (Refereed) Published
Abstract [en]

This paper outlines an extended analysis on how multi-chamber actuators can improve the efficiency of valve-controlled systems. Resistive control is a major source of energy losses in valve-controlled systems that share the same pump to drive multiple loads. By combining different chambers, the load on multi-chamber actuators can be transformed into different pressure and flow rate levels. This allows the adaptation of its load to the loads on other actuators. This can lead to a reduction of resistive control energy losses that occur between pump and actuators when driven simultaneously. As a case study to highlight how the system efficiency can be improved, a load sensing system with a conventional and a multi-chamber actuator is analysed. The equations that describe the system steady state behaviour are presented to evaluate the effect of the load transformations on the system efficiency. A disadvantage of such architecture is the fact that load transformations result in different actuator speeds. To reduce this effect, a compensation factor for the command signal to the proportional valve is presented. The highlight from this paper is the potential for efficiency improvement enabled by the adoption of multi-chamber actuators in a valve-controlled architecture. Further research is required for the selection of number of chambers and their areas since they directly affect the system efficiency.

Place, publisher, year, edition, pages
RIVER PUBLISHERS, 2022
Keywords
Digital fluid power; multi-chamber actuators; resistive control losses
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:liu:diva-181633 (URN)10.13052/ijfp1439-9776.2314 (DOI)000722192000004 ()2-s2.0-85136391529 (Scopus ID)
Note

Funding Agencies|Brazilian Coordination for the Improvement of Higher Education Personnel (CAPES)Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (CAPES); Brazilian National Council forScientific and Technological Development (CNPq)Conselho Nacional de Desenvolvimento Cientifico e Tecnologico (CNPQ); Swedish Energy Agency (Energimyndigheten)Swedish Energy Agency [P49119-1]

Available from: 2021-12-06 Created: 2021-12-06 Last updated: 2025-09-04Bibliographically approved
4. Boom energy recuperation system and control strategy for hydraulic hybrid excavators
Open this publication in new window or tab >>Boom energy recuperation system and control strategy for hydraulic hybrid excavators
Show others...
2022 (English)In: Automation in Construction, ISSN 0926-5805, E-ISSN 1872-7891, Vol. 135, article id 104046Article in journal (Refereed) Published
Abstract [en]

In this paper, a boom potential energy recovery hydraulic system for an excavator and its controller is proposed and evaluated. It is a trend in the construction machinery sector to adopt hybrid systems to recuperate potential energy from heavy loads. Many studies have been conducted to improve the efficiency of boom potential energy recovery. However, most of the proposed solutions have limitations regarding commercialization due to low controllability and high cost. The proposed system in this paper uses only electronically controlled hydraulic components. Different operation modes are defined to increase performance, efficiency or a balance between the two. The system is mathematically analysed to derive a control strategy that is able to increase machine efficiency and control performance while maintaining its controllability. The system and control strategy are applied to a prototype machine, a Volvo 30-ton class excavator, to verify the effectiveness of the proposed approach. Experimental results demonstrate that the working cycle becomes around 3% faster, and the fuel consumption becomes around 9% lower than the operation in non-hybrid mode.

Place, publisher, year, edition, pages
ELSEVIER, 2022
Keywords
Hydraulic excavator; Hydraulic hybrid; Boom energy recuperation; Control strategy; Energy efficiency
National Category
Construction Management
Identifiers
urn:nbn:se:liu:diva-184748 (URN)10.1016/j.autcon.2021.104046 (DOI)000781039500002 ()
Note

Funding Agencies|Brazilian Coordination for the Improvement of Higher Education Personnel (CAPES)Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior (CAPES) [P49119-1]; Brazilian National Council for Scientific and Technological Development (CNPq)Conselho Nacional de Desenvolvimento Cientifico e Tecnologico (CNPQ); Swedish Energy Agency (Energimyndigheten)Swedish Energy Agency

Available from: 2022-05-11 Created: 2022-05-11 Last updated: 2022-08-16

Open Access in DiVA

fulltext(7402 kB)779 downloads
File information
File name FULLTEXT01.pdfFile size 7402 kBChecksum SHA-512
9da1484daaf742e3590cf76d1829392d0394e4f2d7f67f56cbf58ac527f5686d420c7d95afc8b04b14042b14fbfbe1a79bc0d69afa806bfdd52138b645032cf9
Type fulltextMimetype application/pdf
Order online >>

Other links

Publisher's full text

Authority records

Raduenz, Henrique

Search in DiVA

By author/editor
Raduenz, Henrique
By organisation
Fluid and Mechatronic SystemsFaculty of Science & Engineering
Mechanical Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 779 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1344 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • oxford
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf