A market oriented, reinforcement learning based approach for electric vehicles integration in smart micro grids

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

In an independent self-sustained micro grid (MG) with limited energy resources, plugged-in electric vehicles (EV) must compete for available excess power supply or demand, modeled as a random variable. This paper proposes a distributed machine learning algorithm based on a Markov decision process (MDP) and non-cooperative game theory, that maximizes the EV's profit under uncertainty of future MG supply/demand states, while satisfying specific battery constraints imposed by the EV owner. Performance evaluation of the proposed algorithm shows that even with no a priori knowledge of future MG supply/demand states, it achieves average profits of only 43% less than the global optimal profit. Results also show that using a cooperative version of the algorithm leads to a 12% increase in average profits.

Details

Original languageEnglish
Title of host publication2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
ISBN (electronic)9781538680995
Publication statusPublished - Oct 2019
Peer-reviewedYes

Conference

Title2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019
Duration21 - 23 October 2019
CityBeijing
CountryChina

External IDs

ORCID /0000-0001-8469-9573/work/161891211

Keywords