Multi-agent task planning and resource apportionment in a smart grid
- Original article
- Published: 09 November 2021
- Volume 13 , pages 444–455, ( 2022 )
Cite this article
- Min Chen 1 ,
- Ashutosh Sharma 2 ,
- Jyoti Bhola 3 ,
- Tien V. T. Nguyen ORCID: orcid.org/0000-0002-2534-5465 4 &
- Chinh V. Truong 4
321 Accesses
20 Citations
Explore all metrics
Nowadays, in different fields, tremendous attention is received by the Multi-agent systems for complex problem solutions with smaller task subdivision. Multiple inputs are utilized, e.g., history of actions, interactions with its neighboring agents by an agent. By the existing techniques for the task planning of the control structure the low efficiency is exhibited. By utilizing the sole numerical analysis method for a complicated distributed resource planning problem, the satisfactory optimal solution is impossible to obtain. In this paper, the control structure model is presented based on the multi-agents, in which the multi-agents superiority is exploited for complex task achievement. The collaboration of multi-agent framework is redefined, and the local conflict coordination mechanism is developed. Moreover, the high adaptability and superior cooperation are exhibited by the presented technique. The function value and its time–space complexity are analyzed, and it is obtained that the lower objective function value is achieved by the algorithm and the better convergence and adaptability are exhibited. The presented technique is 37–43% better than the Hierarchical Task Network Planning (HTN) technique for different time slots. The performance of the presented technique is 29–34% better compared to the Time Preference HTN technique in terms of function value. The performance of the proposed technique is better compared to the existing techniques in terms of obtained function values.
This is a preview of subscription content, log in via an institution to check access.
Access this article
Price includes VAT (Russian Federation)
Instant access to the full article PDF.
Rent this article via DeepDyve
Institutional subscriptions
Similar content being viewed by others
Multi-Agent Systems for Resource Allocation and Scheduling in a Smart Grid
Hybrid Intelligent Multi-agent System for Power Restoration
Multi-agent Based Planning Considering the Behavior of Individual End-Users
Ajaz F, Naseem M, Sharma S, Shabaz M, Dhiman G (2021) COVID-19: challenges and its technological solutions using IoT. Curr Med Imaging Curr Med Imaging Rev. https://doi.org/10.2174/1573405617666210215143503
Article Google Scholar
Al-Ayyoub M, Jararweh Y, Daraghmeh M, Althebyan Q (2015) Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure. Clust Comput 18(2):919–932. https://doi.org/10.1007/s10586-015-0449-5
Arora M, Devi MS (2011) Design of multi agent system for resource allocation and monitoring. Int J Agent Technol Syst 3(1):1–10. https://doi.org/10.4018/jats.2011010101
Banerjee S, Hecker JP (2017) A multi-agent system approach to load-balancing and resource allocation for distributed computing. In: First complex systems digital campus world E-conference 2015. Springer, pp 41–54. https://doi.org/10.1007/978-3-319-45901-1_4
Bhola J, Soni S, Cheema GK (2019) Recent trends for security applications in wireless sensor networks–a technical review. In: 2019 6th International Conference on Computing for Sustainable Global Development (INDIACom), pp 707–712
Boussaada Z, Curea O, Camblong H, Bellaaj Mrabet N, Hacala A (2014) Multi-agent systems for the dependability and safety of microgrids. Int J Interact Des Manuf (IJIDeM) 10(1):1–13. https://doi.org/10.1007/s12008-014-0257-9
Brazier F, Ogston E, Warnier M (2009) The future of energy markets and the challenge of decentralized self-management. In: Agents and peer-to-peer computing. Springer, Berlin, Heidelberg, pp 95–103
Google Scholar
Brenna M, Foiadelli F, Longo M (2014) The exploitation of vehicle-to-grid function for power quality improvement in a smart grid. IEEE Trans Intell Transp Syst 15(5):2169–2177. https://doi.org/10.1109/tits.2014.2312206
Chen L, Jagota V, Kumar A (2021) Research on optimization of scientific research performance management based on BP neural network. Int J Syst Assur Eng Manag. https://doi.org/10.1007/s13198-021-01263-z
Cui J, Liu Y, Nallanathan A (2020) Multi-agent reinforcement learning-based resource allocation for UAV networks. IEEE Trans Wirel Commun 19(2):729–743. https://doi.org/10.1109/twc.2019.2935201
Dou C-X, Liu B (2013) Multi-agent based hierarchical hybrid control for smart microgrid. IEEE Trans Smart Grid 4(2):771–778. https://doi.org/10.1109/tsg.2012.2230197
Ellabban O, Abu-Rub H (2016) Smart grid customers’ acceptance and engagement: an overview. Renew Sustain Energy Rev 65:1285–1298. https://doi.org/10.1016/j.rser.2016.06.021
Farooq KM, Younus M, Moizuddin M, Hassan I (2015) Optimal routing multi-agent system approach for congestion control in high speed networks. Int J Manag IT and Eng 5(2):67–71
González-Briones A, De La Prieta F, Mohamad M, Omatu S, Corchado J (2018) Multi-agent systems applications in energy optimization problems: a state-of-the-art review. Energies 11(8):1928. https://doi.org/10.3390/en11081928
Grachev S, Skobelev P, Mayorov I, Simonova E (2020) Adaptive clustering through multi-agent technology: development and perspectives. Mathematics 8(10):1664. https://doi.org/10.3390/math8101664
Guoxiang Gu, Marinovici L, Lewis FL (2012) Consensusability of discrete-time dynamic multiagent systems. IEEE Trans Autom Control 57(8):2085–2089. https://doi.org/10.1109/tac.2011.2179431
Article MathSciNet MATH Google Scholar
Hovhannisyan T, Efendyan P, Vardanyan M (2018) Creation of a digital model of fields with application of DJI phantom 3 drone and the opportunities of its utilization in agriculture. Ann Agrar Sci 16(2):177–180. https://doi.org/10.1016/j.aasci.2018.03.006
Hoyas S, Gil A, Margot X, Khuong-Anh D, Ravet F (2013) Evaluation of the Eulerian-Lagrangian Spray Atomization (ELSA) model in spray simulations: 2D cases. Math Comput Model 57(7–8):1686–1693. https://doi.org/10.1016/j.mcm.2011.11.006
Jagota V, Sethi APS, Kumar K (2013) Finite element method: an overview, Walailak. J Sci Technol 10(1):1–8
Kabir SR (2017) Computation of multi-agent based relative direction learning specification. Doctoral dissertation, B. Sc. thesis, Daffodil International University, Bangladesh
Kahraman C, Kaya İ, Çevikcan E (2011) Intelligence decision systems in enterprise information management. J Enterp Inf Manag 24(4):360–379. https://doi.org/10.1108/17410391111148594
Kaur A, Kumar K (2020) Energy-efficient resource allocation in cognitive radio networks under cooperative multi-agent model-free reinforcement learning schemes. IEEE Trans Netw Serv Manage 17(3):1337–1348. https://doi.org/10.1109/tnsm.2020.3000274
Kishor A, Chakarbarty C (2021) Task offloading in fog computing for using smart ant colony optimization. Wirel Pers Commun. https://doi.org/10.1007/s11277-021-08714-7
Kishor A, Chakraborty C (2021) Artificial intelligence and internet of things based healthcare 4.0 monitoring system. Wirel Pers Commun. https://doi.org/10.1007/s11277-021-08708-5
Kishor A, Chakraborty C, Jeberson W (2021a) Intelligent healthcare data segregation using fog computing with internet of things and machine learning. Int J Eng Syst Model Simul 12(2/3):188. https://doi.org/10.1504/ijesms.2021.115533
Kishor A, Chakraborty C, Jeberson W (2021b) A novel fog computing approach for minimization of latency in healthcare using machine learning. Int J Interact Multimed Artif Intell 6(7):7. https://doi.org/10.9781/ijimai.2020.12.00
Kishor A, Chakraborty C, Jeberson W (2021c) Reinforcement learning for medical information processing over heterogeneous networks. Multimed Tools Appl 80(16):23983–24004. https://doi.org/10.1007/s11042-021-10840-0
Kovács G, Yussupova N, Rizvanov D (2017) Resource management simulation using multi-agent approach and semantic constraints. Pollack Periodica 12(1):45–58. https://doi.org/10.1556/606.2017.12.1.4
Kumar A, Jagota V, Shawl RQ, Sharma V, Sargam K, Shabaz M, Khan MT, Rabani B, Gandhi S (2021) Wire EDM process parameter optimization for D2 steel. Mater Today Proc 37:2478–2482. https://doi.org/10.1016/j.matpr.2020.08.295
Li H (2009) Multi-agent Q-learning of channel selection in multi-user cognitive radio systems: A two by two case. In: 2009 IEEE international conference on Systems, Man and Cybernetics—SMC. https://doi.org/10.1109/icsmc.2009.5346172
Liang L, Ye H, Li GY (2019) Spectrum sharing in vehicular networks based on multi-agent reinforcement learning. IEEE J Sel Areas Commun 37(10):2282–2292. https://doi.org/10.1109/jsac.2019.2933962
Lin Y-I, Tien K-W, Chu C-H (2012) Multi-agent hierarchical negotiation based on augmented price schedules decomposition for distributed design. Comput Ind 63(6):597–609. https://doi.org/10.1016/j.compind.2012.02.017
Liu K, Ni Y, Wu FF, Bi TS (2007) Decentralized congestion management for multilateral transactions based on optimal resource allocation. IEEE Trans Power Syst 22(4):1835–1842. https://doi.org/10.1109/tpwrs.2007.907540
Liu Y, Mohamed Y (2008) Multi-Agent Resource Allocation (MARA) for modeling construction processes. In: 2008 Winter Simulation Conference (WSC). https://doi.org/10.1109/wsc.2008.4736343
Liu H, Shao Z, Li S, Tan X (2017) A study of multiagent systems for resource allocation. In: 11th Asian Conference on Chemical Sensors: (ACCS2015). https://doi.org/10.1063/1.4977386
Luo F, Dong ZY, Liang G, Murata J, Xu Z (2019) A distributed electricity trading system in active distribution networks based on multi-agent coalition and blockchain. IEEE Trans Power Syst 34(5):4097–4108. https://doi.org/10.1109/tpwrs.2018.2876612
Nasir YS, Guo D (2019) Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks. IEEE J Sel Areas Commun 37(10):2239–2250. https://doi.org/10.1109/jsac.2019.2933973
Nedic A, Ozdaglar A (2009) Distributed subgradient methods for multi-agent optimization. IEEE Trans Autom Control 54(1):48–61. https://doi.org/10.1109/tac.2008.2009515
Nunna HSVSK, Saklani AM, Sesetti A, Battula S, Doolla S, Srinivasan D (2016) Multi-agent based demand response management system for combined operation of smart microgrids. Sustain Energy Grids Netw 6:25–34. https://doi.org/10.1016/j.segan.2016.01.002
Olofsson M (2009) Power quality and EMC in smart grid. In: 2009 10th International Conference on Electrical Power Quality and Utilisation (EPQU). https://doi.org/10.1109/epqu.2009.5318811
Oueida S, Aloqaily M, Ionescu S (2018) A smart healthcare reward model for resource allocation in smart city. Multimed Tools Appl 78(17):24573–24594. https://doi.org/10.1007/s11042-018-6647-4
Park J, Simpson TW, Moon SK, Kumara SRT (2008) A dynamic multiagent system based on a negotiation mechanism for product family design. IEEE Trans Autom Sci Eng 5(2):234–244. https://doi.org/10.1109/tase.2007.896902
Poveda J, Quijano N (2013) Distributed extremum seeking for real-time resource allocation. In: 2013 American Control Conference (ACC). https://doi.org/10.1109/acc.2013.6580254
Qiu L, Gu G, Chen W (2013) Stabilization of networked multi-input systems with channel resource allocation. IEEE Trans Autom Control 58(3):554–568. https://doi.org/10.1109/tac.2012.2218065
Roesch M, Linder C, Zimmermann R, Rudolf A, Hohmann A, Reinhart G (2020) Smart grid for industry using multi-agent reinforcement learning. Appl Sci 10(19):6900. https://doi.org/10.3390/app10196900
Sharma C, Bagga A, Singh BK, Shabaz M (2021a) A novel optimized graph-based transform watermarking technique to address security issues in real-time application. Math Probl Eng 2021:1–27. https://doi.org/10.1155/2021/5580098
Sharma C, Amandeep B, Sobti R, Lohani TK, Shabaz M (2021b) A Secured frame selection based video watermarking technique to address quality loss of data: combining graph based transform, singular valued decomposition, and hyperchaotic encryption. Secur Commun Netw 2021:1–19. https://doi.org/10.1155/2021/5536170
Shaw R, Howley E, Barrett E (2017) An advanced reinforcement learning approach for energy-aware virtual machine consolidation in cloud data centers. In: 2017 12th International Conference for Internet Technology and Secured Transactions (ICITST). https://doi.org/10.23919/icitst.2017.8356347
Tan G, Yan J, Gao C, Yang S (2012) Prediction of water quality time series data based on least squares support vector machine. Proc Eng 31:1194–1199. https://doi.org/10.1016/j.proeng.2012.01.1162
Tang S, Shabaz M (2021) A new face image recognition algorithm based on cerebellum-basal ganglia mechanism. J Healthc Eng 2021:1–11. https://doi.org/10.1155/2021/3688881
Wang D, Song B, Chen D, Du X (2019) Intelligent cognitive radio in 5G: AI-based hierarchical cognitive cellular networks. IEEE Wirel Commun 26(3):54–61. https://doi.org/10.1109/mwc.2019.1800353
Wang D, Zhang W, Song B, Du X, Guizani M (2020) Market-based model in CR-IoT: a Q-Probabilistic multi-agent reinforcement learning approach. IEEE Trans Cognit Commun Netw 6(1):179–188. https://doi.org/10.1109/tccn.2019.2950242
Wang B, Yao X, Jiang Y, Sun C, Shabaz M (2021) Design of a real-time monitoring system for smoke and dust in thermal power plants based on improved genetic algorithm. J Healthc Eng 2021:1–10. https://doi.org/10.1155/2021/7212567
Xiao Y, Bhola J (2021) Design and optimization of prefabricated building system based on BIM technology. Int J Syst Assur Eng Manag. https://doi.org/10.1007/s13198-021-01288-4
Xu Y, Han T, Cai K, Lin Z, Yan G, Fu M (2017) A distributed algorithm for resource allocation over dynamic digraphs. IEEE Trans Signal Process 65(10):2600–2612. https://doi.org/10.1109/tsp.2017.2669896
Download references
There is no funding associated with this research work.
Author information
Authors and affiliations.
Railway Department, Hohhot Vocational College, Hohhot, 010051, China
Institute of Computer Technology and Information Security, Southern Federal University, Rostov-on-Don, Russia
Ashutosh Sharma
Department of Electronics and Communication Engineering, National Institute of Technology, Hamirpur, India
Jyoti Bhola
Industrial University of Ho Chi Minh City, Chi Minh, 70000, Vietnam
Tien V. T. Nguyen & Chinh V. Truong
You can also search for this author in PubMed Google Scholar
Corresponding author
Correspondence to Tien V. T. Nguyen .
Ethics declarations
Conflict of interest.
The authors declare that they have no conflict of interest and all ethical issues including human or animal participation have been done. No such consent is applicable.
Additional information
Publisher's note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Reprints and permissions
About this article
Chen, M., Sharma, A., Bhola, J. et al. Multi-agent task planning and resource apportionment in a smart grid. Int J Syst Assur Eng Manag 13 (Suppl 1), 444–455 (2022). https://doi.org/10.1007/s13198-021-01467-3
Download citation
Received : 12 September 2021
Revised : 30 September 2021
Accepted : 13 October 2021
Published : 09 November 2021
Issue Date : March 2022
DOI : https://doi.org/10.1007/s13198-021-01467-3
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Multi-agent systems
- Hierarchical task network planning
- Time preference
- Multi-agents superiority
- Find a journal
- Publish with us
- Track your research
Multi-Agent Neural Rearrangement Planning of Objects in Cluttered Environments
Object rearrangement is a fundamental problem in robotics with various practical applications ranging from managing warehouses to cleaning and organizing home kitchens. While existing research has primarily focused on single-agent solutions, real-world scenarios often require multiple robots to work together on rearrangement tasks. We propose a comprehensive learning-based framework for multi-agent object rearrangement planning, addressing the challenges of task sequencing and path planning in complex environments. The proposed method iteratively selects objects, determines their relocation regions, and pairs them with available robots under kinematic feasibility and task reachability for execution to achieve the target arrangement. Our experiments on a diverse range of environments demonstrate the effectiveness and robustness of the proposed framework. Furthermore, results indicate improved performance in terms of traversal time and success rate compared to baseline approaches. The videos and supplementary material are available at https://sites.google.com/view/maner-supplementary
Degree Type
- Master of Science
- Computer Science
Campus location
- West Lafayette
Advisor/Supervisor/Committee Chair
Advisor/supervisor/committee co-chair, additional committee member 2, usage metrics.
- Computer vision
- Intelligent robotics
IMAGES
VIDEO
COMMENTS
Multi-agent control and path-planning strategies are broken into two categories: centralized and decentralized (De-wangan, Shukla, and Godfrey,2017). The centralized approach models the multi-agent team or swarm as a singular unit. The decentralized approach, often also referred to as a distributed approach, calculates each agent's control ...
This thesis addresses a multi-agent planning problem, where each agent aims to achieve an individual task while avoiding collisions with other agents in the en-vironment. It is assumed that each agent's task is expressed as a Time-Window Temporal Logic (TWTL) speci cation de ned over a 3D environment. A dis-
This thesis presents real-time robust distributed planning strategies that can be used to plan for multi-agent networked teams operating in stochastic and dynamic environments. One class of distributed combinatorial planning algorithms involves using auction algorithms augmented with consensus protocols to allocate tasks amongst a team of ...
an environment. In general, the complexity of centralized multi-agent planning (MAP) is exponential in the number of agents. Therefore, a decentralized planning approach is taken to enable UAV teaming. The developed framework uses BHPN as a method of implementing this loosely-coupled MAP e ort. BHPN uses preconditions to bind objects in the ...
This thesis aims to address the issues of the issues of scalability and adaptability within teams of such inter-dependent agents while planning, coordinating, and learning in a decentralized environment. In doing so, the first focus is the integration of learning and adaptation algorithms into a multi-agent planning architecture to enable ...
A. Multi-agent Motion Planning Multi-agent motion planning is generally classified into two categories: cooperative motion planning and non-cooperative motion planning based on how agents interact with each other in the environment. Cooperative motion planning as the name suggests is an approach where agents are all part of the same team.
This thesis explores probabilistic driven multi-agent planning approaches, motivated by the challenges posed by SaR missions.First, we investigate the problem of multi-robot non-adversarial search. Uncertainty is present in the victim's true location as only probabilistic information is available a priori.
3 Multiagent planning techniques Multi-agent planning techniques cover quite a range of solutions to di erent phases of the problem. This section structures existing work using these steps in the process of solving a multiagent planning problem. In general, the following phases can be distinguished (generalizing the main steps in task sharing ...
The Eighth International Joint Conference on Autonomous Agents and Multi Agent Systems (AAMAS 2009), May 10 -15, 2009, Budapest, Hungary. 2. J. F. Zhang, X. T. Nguyen, R. Kowalczyk A Graph-based Multi-agent Planning Al-gorithm with QoS guarantees. The 2007 IEEE/WIC/ACM International Conference
A Hybrid Method for Distributed Multi-Agent Mission Planning System. The goal of this research is to develop a method of control for a team of unmanned aerial and ground robots that is resilient, robust, and scalable given both complete and incomplete information of the environment. The method presented in this paper integrates approximate and ...
Multi-agent planning using HTN and GOAP. Glenn Wissing. Published 2007. Computer Science. This thesis examines how Hierarchical Task Networks (HTNs) can be used to plan for overall strategies in a game environment where the agents are controlled by GOAP (Goal Oriented Action Plannin ... diva-portal.org.
In the field of multi-agent systems (MAS), multi-agent planning (MAP) [16, 17] has been presented as a methodology to integrate the planning capabilities of intelligent agents so that a group of ...
Multi-agent path planning with multiple tasks and distance constraints. S. Bhattacharya, M. Likhachev, Vijay R. Kumar. Published in IEEE International Conference… 3 May 2010. Computer Science, Engineering. The DPC algorithm developed in our previous work is an efficient way of computing optimal trajectories for multiple robots in a ...
Multi-agent planning (MAP) deals with planning systems that reason on long-term goals by multiple collaborative agents which want to maintain privacy on their knowledge. Recently, new MAP techniques have been devised to provide efficient solutions. Most approaches expand distributed searches using modified planners, where agents exchange public information. They present two drawbacks: they are ...
Thesis submitted in partial fulfillment ... multi-agent planning & pathfinding (MAPF) and heuristic search, improving my research skills immensely. Their motivation, knowledge, and hard work truly inspire me. A big thank goes to all my friends in Ben-Gurion University of the Negev for their
An embodied multi-agent task planning framework is proposed to utilize external knowledge sources and dynamically perceived visual information to resolve the high-level instructions, and dynamically allocate the decomposed tasks to multiple agents, and dynamically allocate the decomposed tasks to multiple agents. —In human-robots collaboration scenarios, a human would give robots an ...
The multi-agent pursuit problem was processed by using several methods of coordination such as cooperation [6], MAS organizational models [7]. PEG was developed in the extensive research [8, 9,10 ...
BACHELOR'S THESIS Multi-agent planning using HTN and GOAP Glenn Wissing Luleå University of Technology BSc Programmes in Engineering BSc programme in Computer Engineering Department of Skellefteå Campus Division of Leisure and Entertainment 2007:16 HIP - ISSN: 1404-5494 - ISRN: LTU-HIP-EX--07/16--SE.
This thesis deals with the formal definition of two particular Multi-Robot Task Allocation (MRTA) problem configurations used to represent multi-agent mission planning problems. More specifically, the contribution of this thesis can be grouped into three categories.
Nowadays, in different fields, tremendous attention is received by the Multi-agent systems for complex problem solutions with smaller task subdivision. Multiple inputs are utilized, e.g., history of actions, interactions with its neighboring agents by an agent. By the existing techniques for the task planning of the control structure the low efficiency is exhibited. By utilizing the sole ...
Malardalen University Doctoral Thesis¨ No.353 Multi-Agent Mission Planning ... Multi-agent-system (MAS) har anv¨ants i olika omgivningar och ramverk och har pa s˚ a s˚ att framg¨ angsrikt till˚ ampats i en m¨ angd applikationer f¨ or att uppn¨ ˚a olika m˚al. Det har visat sig att MAS ¨ar mer kostnadseffektiva j amf¨ ort med att¨
Multi-agent planning can be seen as an extension of classical planning and in [1] is defined as "the problem of planning by and for a group of agents". This definition is in- ... research for the PhD thesis of the author. 2 Problem Definition Different authors use some slightly different definition of multi-agent planning, how-
Object rearrangement is a fundamental problem in robotics with various practical applications ranging from managing warehouses to cleaning and organizing home kitchens. While existing research has primarily focused on single-agent solutions, real-world scenarios often require multiple robots to work together on rearrangement tasks. We propose a comprehensive learning-based framework for multi ...